Sep 25 11:30:52 devstack cinder-volume[76030]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 25 11:30:52 devstack cinder-volume[76030]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 25 11:30:52 devstack cinder-volume[76030]: we strongly recommend against using it for new projects. Sep 25 11:30:52 devstack cinder-volume[76030]: If you are already using Eventlet, we recommend migrating to a different Sep 25 11:30:52 devstack cinder-volume[76030]: framework. For more detail see Sep 25 11:30:52 devstack cinder-volume[76030]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 25 11:30:52 devstack cinder-volume[76030]: import eventlet # noqa Sep 25 11:30:55 devstack cinder-volume[76030]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76030) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 11:30:55 devstack cinder-volume[76030]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76030) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 11:30:55 devstack cinder-volume[76030]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76030) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 11:30:56 devstack cinder-volume[76030]: INFO dbcounter [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] Registered counter for database cinder Sep 25 11:30:56 devstack cinder-volume[76030]: DEBUG oslo_db.sqlalchemy.engines [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76030) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 11:30:57 devstack cinder-volume[76030]: DEBUG dbcounter [-] [76030] Writer thread running {{(pid=76030) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 11:30:57 devstack cinder-volume[76030]: INFO cinder.rpc [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 25 11:30:57 devstack cinder-volume[76030]: INFO cinder.rpc [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 25 11:30:57 devstack cinder-volume[76030]: DEBUG oslo_db.sqlalchemy.engines [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76030) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 11:30:57 devstack cinder-volume[76030]: INFO cinder.volume.manager [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] Determined volume DB was empty at startup. Sep 25 11:30:57 devstack cinder-volume[76030]: DEBUG cinder.volume.manager [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76030) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 25 11:30:57 devstack cinder-volume[76030]: INFO cinder.volume.manager [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 25 11:30:57 devstack cinder-volume[76030]: WARNING stevedore.named [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 25 11:30:57 devstack cinder-volume[76030]: WARNING castellan.key_manager [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 11:30:57 devstack cinder-volume[76030]: WARNING cinder.keymgr.conf_key_mgr [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 11:30:57 devstack cinder-volume[76030]: DEBUG cinder.volume.drivers.lvm [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76030) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 25 11:30:57 devstack cinder-volume[76030]: DEBUG oslo_concurrency.processutils [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:30:57 devstack cinder-volume[76030]: DEBUG oslo_concurrency.processutils [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] CMD "cinder-rtstool verify" returned: 0 in 0.479s {{(pid=76030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_db.sqlalchemy.engines [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76030) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 11:30:58 devstack cinder-volume[76030]: INFO cinder.rpc [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 25 11:30:58 devstack cinder-volume[76030]: INFO cinder.rpc [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 25 11:30:58 devstack cinder-volume[76030]: WARNING stevedore.named [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 25 11:30:58 devstack cinder-volume[76030]: WARNING castellan.key_manager [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 11:30:58 devstack cinder-volume[76030]: INFO cinder.volume.manager [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_db.sqlalchemy.engines [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76030) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 11:30:58 devstack cinder-volume[76030]: INFO oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] Starting 1 workers Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] Started child 76192 {{(pid=76030) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] Full set of CONF: {{(pid=76030) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] ******************************************************************************** {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] Configuration options gathered from: {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] ================================================================================ {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] allow_availability_zone_fallback = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] allow_compression_on_image_upload = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] allowed_direct_url_schemes = [] {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] api_rate_limit = True {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] auth_strategy = keystone {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] az_cache_duration = 3600 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] backend_availability_zone = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] backend_host = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] backend_name = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] backend_stats_polling_interval = 60 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] backup_api_class = cinder.backup.api.API {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] backup_name_template = backup-%s {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] backup_use_same_host = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] backup_use_temp_snapshot = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] chap_password = **** {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] chap_username = {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] cinder_internal_tenant_project_id = b7eaff659baa4ad8b65781b7b648a1d5 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] cinder_internal_tenant_user_id = 2c9aff709ae246cabe63976b8bbadcd0 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] cloned_volume_same_az = True {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] cluster = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] compression_format = gzip {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] compute_api_class = cinder.compute.nova.API {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] config_dir = [] {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] config_source = [] {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] control_exchange = openstack {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] debug = True {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76192]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] default_availability_zone = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] default_group_type = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] default_volume_type = lvmdriver-1 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] disk_geometry = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] driver_client_cert = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] driver_client_cert_key = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] driver_data_namespace = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] driver_ssl_cert_path = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] driver_ssl_cert_verify = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] driver_use_ssl = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] enable_force_upload = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] enable_new_services = True {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] enable_unsupported_driver = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] enabled_backends = ['lvmdriver-1'] {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] enforce_multipath_for_image_xfer = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] filter_function = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] glance_api_insecure = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] glance_api_servers = ['http://192.168.122.58/image'] {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] glance_api_ssl_compression = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] glance_ca_certificates_file = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] glance_catalog_info = image:glance:publicURL {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] glance_certfile = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] glance_keyfile = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] glance_num_retries = 3 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] glance_request_timeout = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] goodness_function = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] graceful_shutdown_timeout = 5 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] group_api_class = cinder.group.api.API {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] host = devstack {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] image_compress_on_upload = True {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] image_conversion_address_space_limit = 1 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] image_conversion_cpu_limit = 60 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] image_conversion_disable = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] image_introspection_address_space_limit = 1 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] image_introspection_cpu_limit = 60 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] image_upload_use_cinder_backend = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] image_upload_use_internal_tenant = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] image_volume_cache_enabled = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] image_volume_cache_max_count = 0 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] image_volume_cache_max_size_gb = 0 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] init_host_max_objects_retrieval = 0 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] instance_format = [instance: %(uuid)s] {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] iscsi_target_flags = {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] iscsi_write_cache = on {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] iser_helper = tgtadm {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] iser_ip_address = 192.168.122.58 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] iser_port = 3260 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] log_color = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] log_config_append = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] log_dir = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] log_file = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] log_options = True {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] log_rotate_interval = 1 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] log_rotate_interval_type = days {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] log_rotation_type = none {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] max_age = 0 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] max_logfile_count = 30 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] max_logfile_size_mb = 200 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] max_over_subscription_ratio = 20.0 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] message_reap_interval = 86400 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] message_ttl = 2592000 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] migration_create_volume_timeout_secs = 300 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] monkey_patch = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] monkey_patch_modules = [] {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] my_ip = 192.168.122.58 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] no_snapshot_gb_quota = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] num_iser_scan_tries = 3 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] num_shell_tries = 3 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] num_volume_device_scan_tries = 3 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] nvmeof_conn_info_version = 1 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] nvmet_ns_id = 10 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] nvmet_port_id = 1 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] osapi_max_limit = 1000 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] osapi_volume_ext_list = [] {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] osapi_volume_listen = 0.0.0.0 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] osapi_volume_listen_port = 8776 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] osapi_volume_use_ssl = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] osapi_volume_workers = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] per_volume_size_limit = -1 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] periodic_fuzzy_delay = 60 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] periodic_interval = 60 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] project_id_regex = [0-9a-f\-]+ {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] public_endpoint = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] publish_errors = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] quota_backup_gigabytes = 1000 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] quota_backups = 10 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] quota_gigabytes = 1000 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] quota_groups = 10 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] quota_snapshots = 10 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] quota_volumes = 10 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] rate_limit_burst = 0 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76192]: INFO cinder.volume.manager [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] rate_limit_except_level = CRITICAL {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] rate_limit_interval = 0 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] reinit_driver_count = 3 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] replication_device = **** {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] report_discard_supported = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] report_interval = 120 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] reservation_clean_interval = 86400 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] reservation_expire = 86400 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] reserved_image_namespaces = [] {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] reserved_percentage = 0 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] rpc_response_timeout = 120 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] run_external_periodic_tasks = True {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] scst_target_driver = iscsi {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] scst_target_iqn_name = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] service_down_time = 720 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] shell_completion = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] snapshot_name_template = snapshot-%s {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] snapshot_same_host = True {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] split_loggers = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] state_path = /opt/stack/data/cinder {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] storage_availability_zone = nova {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] storage_protocol = iSCSI {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] syslog_log_facility = LOG_USER {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] target_helper = lioadm {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] target_ip_address = 192.168.122.58 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] target_port = 3260 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] target_protocol = iscsi {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] target_secondary_ip_addresses = [] {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] trace_flags = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] transfer_api_class = cinder.transfer.api.API {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] transport_url = **** {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] until_refresh = 0 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] use_chap_auth = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] use_default_quota_class = True {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] use_journal = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] use_json = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] use_multipath_for_image_xfer = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] use_stderr = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] use_syslog = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] verify_glance_signatures = enabled {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] volume_api_class = cinder.volume.api.API {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] volume_backend_name = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] volume_clear = zero {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] volume_clear_ionice = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] volume_clear_size = 0 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] volume_copy_bps_limit = 0 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] volume_dd_blocksize = 1M {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] volume_name_template = volume-%s {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] volume_service_inithost_offload = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] volume_usage_audit_period = month {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] zoning_mode = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] oslo_concurrency.disable_process_locking = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] keystone_authtoken.auth_section = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] keystone_authtoken.auth_type = password {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] keystone_authtoken.auth_version = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] keystone_authtoken.cache = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] keystone_authtoken.certfile = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] keystone_authtoken.delay_auth_decision = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] keystone_authtoken.http_connect_timeout = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] keystone_authtoken.include_service_catalog = True {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] keystone_authtoken.insecure = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] keystone_authtoken.interface = public {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] keystone_authtoken.keyfile = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] keystone_authtoken.memcache_password = **** {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.076s {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:30:58 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] keystone_authtoken.memcache_username = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] keystone_authtoken.region_name = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] keystone_authtoken.service_token_roles_required = True {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] keystone_authtoken.service_type = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] keystone_authtoken.token_cache_time = 300 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.58/identity {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] cache.backend = dogpile.cache.null {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] cache.backend_argument = **** {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] cache.backend_expiration_time = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] cache.config_prefix = cache.oslo {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] cache.debug_cache_backend = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] cache.enable_retry_client = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] cache.enable_socket_keepalive = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] cache.enabled = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] cache.expiration_time = 600 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] cache.hashclient_retry_attempts = 2 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] cache.memcache_dead_retry = 300 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] cache.memcache_pool_maxsize = 10 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] cache.memcache_sasl_enabled = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] cache.password = **** {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] cache.proxies = [] {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] cache.redis_db = 0 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] cache.redis_sentinel_service_name = mymaster {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] cache.redis_server = localhost:6379 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] cache.retry_attempts = 2 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] cache.retry_delay = 0.0 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] cache.socket_keepalive_count = 1 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] cache.socket_keepalive_idle = 1 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] cache.socket_keepalive_interval = 1 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] cache.socket_timeout = 1.0 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] cache.tls_allowed_ciphers = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] cache.tls_cafile = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] cache.tls_certfile = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] cache.tls_enabled = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] cache.tls_keyfile = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] cache.username = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] coordination.backend_url = **** {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] database.asyncio_connection = **** {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] database.asyncio_slave_connection = **** {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] database.backend = sqlalchemy {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] database.connection = **** {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] database.connection_debug = 0 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] database.connection_parameters = {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] database.connection_recycle_time = 3600 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.046s {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] database.connection_trace = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] database.db_inc_retry_interval = True {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] database.db_max_retries = 20 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] database.db_max_retry_interval = 10 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] database.db_retry_interval = 1 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] database.max_overflow = 50 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] database.max_pool_size = 5 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] database.max_retries = 10 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] database.mysql_wsrep_sync_wait = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] database.pool_timeout = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] database.retry_interval = 10 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] database.slave_connection = **** {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] database.sqlite_synchronous = True {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] database.synchronous_reader = True {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] database.use_db_reconnect = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] oslo_messaging_tracing.insecure = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] profiler.connection_string = messaging:// {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] profiler.enabled = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] profiler.es_doc_type = notification {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] profiler.es_scroll_size = 10000 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] profiler.es_scroll_time = 2m {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] profiler.filter_error_trace = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] profiler.hmac_keys = **** {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] profiler.sentinel_service_name = mymaster {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] profiler.socket_timeout = 0.1 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] profiler.trace_requests = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] profiler.trace_sqlalchemy = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] profiler_jaeger.process_tags = {} {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] profiler_jaeger.service_name_prefix = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] profiler_otlp.service_name_prefix = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] oslo_policy.enforce_new_defaults = True {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] oslo_policy.policy_default_rule = default {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] oslo_policy.policy_file = policy.yaml {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] oslo_policy.remote_timeout = 60.0 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] privsep_osbrick.group = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] privsep_osbrick.helper_command = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] privsep_osbrick.user = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] cinder_sys_admin.group = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] cinder_sys_admin.helper_command = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack sudo[76200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 25 11:30:58 devstack sudo[76200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] cinder_sys_admin.user = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] service_user.auth_section = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] service_user.auth_type = password {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] service_user.cafile = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] service_user.certfile = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] service_user.collect_timing = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] service_user.insecure = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] service_user.keyfile = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] service_user.send_service_user_token = True {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] service_user.split_loggers = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] service_user.timeout = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] service_user.tls_ciphers = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] service_user.tls_min_version = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] glance.auth_section = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] glance.auth_type = password {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] glance.certfile = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] glance.collect_timing = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] glance.insecure = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] glance.keyfile = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] glance.region_name = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] glance.split_loggers = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] glance.timeout = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] glance.tls_ciphers = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] glance.tls_min_version = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] backend_defaults.backend_availability_zone = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] backend_defaults.chap_password = **** {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] backend_defaults.chap_username = {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] backend_defaults.disk_geometry = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] backend_defaults.driver_client_cert = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] backend_defaults.driver_client_cert_key = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] backend_defaults.driver_data_namespace = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] backend_defaults.driver_use_ssl = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] backend_defaults.enable_unsupported_driver = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] backend_defaults.extra_capabilities = {} {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] backend_defaults.filter_function = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] backend_defaults.goodness_function = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] backend_defaults.iscsi_target_flags = {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] backend_defaults.iscsi_write_cache = on {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] backend_defaults.iser_helper = tgtadm {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] backend_defaults.iser_ip_address = 192.168.122.58 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] backend_defaults.iser_port = 3260 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] backend_defaults.lvm_mirrors = 0 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] backend_defaults.lvm_share_target = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] backend_defaults.lvm_type = auto {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] backend_defaults.num_shell_tries = 3 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] backend_defaults.nvmet_port_id = 1 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] backend_defaults.replication_device = **** {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] backend_defaults.report_discard_supported = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] backend_defaults.reserved_percentage = 0 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] backend_defaults.scst_target_driver = iscsi {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] backend_defaults.scst_target_iqn_name = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] backend_defaults.storage_protocol = iSCSI {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] backend_defaults.target_helper = tgtadm {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] backend_defaults.target_ip_address = 192.168.122.58 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] backend_defaults.target_port = 3260 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] backend_defaults.target_protocol = iscsi {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] backend_defaults.trace_flags = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] backend_defaults.unique_fqdn_network = True {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] backend_defaults.use_chap_auth = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] backend_defaults.volume_backend_name = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] backend_defaults.volume_clear = zero {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] backend_defaults.volume_clear_ionice = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] backend_defaults.volume_clear_size = 0 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] backend_defaults.volume_group = cinder-volumes {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] oslo_reports.file_event_handler = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] oslo_reports.log_dir = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] lvmdriver-1.backend_availability_zone = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] lvmdriver-1.backend_host = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] lvmdriver-1.chap_password = **** {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] lvmdriver-1.chap_username = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] lvmdriver-1.chiscsi_conf = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] lvmdriver-1.disk_geometry = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] lvmdriver-1.driver_client_cert = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] lvmdriver-1.driver_data_namespace = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] lvmdriver-1.driver_use_ssl = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] lvmdriver-1.extra_capabilities = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] lvmdriver-1.filter_function = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] lvmdriver-1.goodness_function = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] lvmdriver-1.iser_helper = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] lvmdriver-1.iser_ip_address = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] lvmdriver-1.iser_port = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] lvmdriver-1.iser_target_prefix = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] lvmdriver-1.lvm_conf_file = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] lvmdriver-1.lvm_mirrors = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] lvmdriver-1.lvm_share_target = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] lvmdriver-1.lvm_type = auto {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] lvmdriver-1.num_shell_tries = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] lvmdriver-1.nvmet_port_id = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] lvmdriver-1.replication_device = **** {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] lvmdriver-1.report_discard_supported = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] lvmdriver-1.reserved_percentage = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] lvmdriver-1.scst_target_driver = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] lvmdriver-1.storage_protocol = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] lvmdriver-1.target_helper = lioadm {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] lvmdriver-1.target_ip_address = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] lvmdriver-1.target_port = 3260 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] lvmdriver-1.target_protocol = iscsi {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] lvmdriver-1.trace_flags = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] lvmdriver-1.use_chap_auth = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] lvmdriver-1.volume_clear = zero {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] lvmdriver-1.volume_clear_size = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] lvmdriver-1.volumes_dir = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] oslo_messaging_rabbit.ssl = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] oslo_messaging_rabbit.ssl_version = {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] oslo_messaging_notifications.driver = [] {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] oslo_messaging_notifications.retry = -1 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] oslo_messaging_notifications.transport_url = **** {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] key_manager.fixed_key = **** {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] barbican.barbican_api_version = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] barbican.barbican_endpoint = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] barbican.barbican_endpoint_type = public {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] barbican.barbican_region_name = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] barbican.cafile = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] barbican.certfile = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] barbican.collect_timing = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] barbican.insecure = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] barbican.keyfile = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] barbican.number_of_retries = 60 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] barbican.retry_delay = 1 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] barbican.send_service_user_token = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] barbican.split_loggers = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] barbican.timeout = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] barbican.tls_ciphers = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] barbican.tls_min_version = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] barbican.verify_ssl = True {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] barbican.verify_ssl_path = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] barbican_service_user.auth_section = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] barbican_service_user.auth_type = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] barbican_service_user.cafile = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] barbican_service_user.certfile = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] barbican_service_user.collect_timing = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] barbican_service_user.insecure = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] barbican_service_user.keyfile = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] barbican_service_user.split_loggers = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] barbican_service_user.timeout = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] barbican_service_user.tls_ciphers = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] barbican_service_user.tls_min_version = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] vault.approle_role_id = **** {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] vault.approle_secret_id = **** {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] vault.auth_method = approle {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] vault.auth_path = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] vault.kv_mountpoint = secret {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] vault.kv_path = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] vault.kv_version = 2 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] vault.namespace = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] vault.root_token_id = **** {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] vault.ssl_ca_crt_file = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] vault.timeout = 60.0 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] vault.token_file = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] vault.token_role = None {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] vault.use_ssl = False {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:30:58 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] ******************************************************************************** {{(pid=76030) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 25 11:30:58 devstack sudo[76200]: pam_unix(sudo:session): session closed for user root Sep 25 11:30:58 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.298s {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:30:58 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:30:58 devstack sudo[76333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 11:30:58 devstack sudo[76333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:30:59 devstack sudo[76333]: pam_unix(sudo:session): session closed for user root Sep 25 11:30:59 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.298s {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:30:59 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 11:30:59 devstack cinder-volume[76192]: INFO cinder.brick.local_dev.lvm [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 25 11:30:59 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:30:59 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:30:59 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:30:59 devstack sudo[76424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 11:30:59 devstack sudo[76424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:30:59 devstack sudo[76424]: pam_unix(sudo:session): session closed for user root Sep 25 11:30:59 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.293s {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:30:59 devstack cinder-volume[76192]: DEBUG cinder.brick.local_dev.lvm [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76192) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 25 11:30:59 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:30:59 devstack sudo[76502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 11:30:59 devstack sudo[76502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:30:59 devstack sudo[76502]: pam_unix(sudo:session): session closed for user root Sep 25 11:30:59 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.537s {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:30:59 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:30:59 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:30:59 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:30:59 devstack sudo[76686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 11:30:59 devstack sudo[76686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:31:00 devstack sudo[76686]: pam_unix(sudo:session): session closed for user root Sep 25 11:31:00 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.366s {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:31:00 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:31:00 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:31:00 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:31:00 devstack sudo[76804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 25 11:31:00 devstack sudo[76804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:31:00 devstack sudo[76804]: pam_unix(sudo:session): session closed for user root Sep 25 11:31:00 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.326s {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:31:00 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:31:00 devstack sudo[76813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 11:31:00 devstack sudo[76813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:31:01 devstack sudo[76813]: pam_unix(sudo:session): session closed for user root Sep 25 11:31:01 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.385s {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:31:01 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:31:01 devstack sudo[76891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 11:31:01 devstack sudo[76891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:31:01 devstack sudo[76891]: pam_unix(sudo:session): session closed for user root Sep 25 11:31:01 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.315s {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:31:01 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:31:01 devstack sudo[76902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 11:31:01 devstack sudo[76902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:31:01 devstack sudo[76902]: pam_unix(sudo:session): session closed for user root Sep 25 11:31:01 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.389s {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:31:01 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:31:01 devstack sudo[76983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 11:31:01 devstack sudo[76983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:31:02 devstack sudo[76983]: pam_unix(sudo:session): session closed for user root Sep 25 11:31:02 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.287s {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:31:02 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:31:02 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:31:02 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:31:02 devstack sudo[76988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 11:31:02 devstack sudo[76988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:31:02 devstack sudo[76988]: pam_unix(sudo:session): session closed for user root Sep 25 11:31:02 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.273s {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:31:02 devstack cinder-volume[76192]: INFO cinder.volume.drivers.lvm [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 25 11:31:02 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:31:02 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:31:02 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:31:02 devstack sudo[76992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 11:31:02 devstack sudo[76992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:31:02 devstack sudo[76992]: pam_unix(sudo:session): session closed for user root Sep 25 11:31:02 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.292s {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:31:02 devstack cinder-volume[76192]: DEBUG cinder.volume.drivers.lvm [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] Updating volume stats {{(pid=76192) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 11:31:02 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:31:02 devstack sudo[76995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 11:31:02 devstack sudo[76995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:31:02 devstack sudo[76995]: pam_unix(sudo:session): session closed for user root Sep 25 11:31:02 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.312s {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:31:02 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:31:02 devstack sudo[76998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 11:31:02 devstack sudo[76998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:31:03 devstack sudo[76998]: pam_unix(sudo:session): session closed for user root Sep 25 11:31:03 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.290s {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:31:03 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:31:03 devstack sudo[77007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 11:31:03 devstack sudo[77007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:31:03 devstack sudo[77007]: pam_unix(sudo:session): session closed for user root Sep 25 11:31:03 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.297s {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:31:03 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:31:03 devstack sudo[77011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 11:31:03 devstack sudo[77011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:31:03 devstack sudo[77011]: pam_unix(sudo:session): session closed for user root Sep 25 11:31:03 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:31:03 devstack cinder-volume[76192]: INFO cinder.volume.driver [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] Driver hasn't implemented _init_vendor_properties() Sep 25 11:31:03 devstack cinder-volume[76192]: DEBUG cinder.volume.driver [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76192) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 25 11:31:03 devstack cinder-volume[76192]: DEBUG oslo_db.sqlalchemy.engines [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76192) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 11:31:03 devstack cinder-volume[76192]: DEBUG dbcounter [-] [76192] Writer thread running {{(pid=76192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 11:31:03 devstack cinder-volume[76192]: DEBUG cinder.db.api [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] Building query based on filter {{(pid=76192) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 25 11:31:03 devstack cinder-volume[76192]: DEBUG cinder.image.image_utils [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76192) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 25 11:31:03 devstack cinder-volume[76192]: INFO cinder.keymgr.migration [None req-273ab40b-96f8-489a-86e0-a19ddc0bc803 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 25 11:31:03 devstack cinder-volume[76192]: DEBUG cinder.volume.drivers.lvm [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] Updating volume stats {{(pid=76192) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 11:31:03 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:31:03 devstack sudo[77015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 11:31:03 devstack sudo[77015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:31:04 devstack sudo[77015]: pam_unix(sudo:session): session closed for user root Sep 25 11:31:04 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:31:04 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:31:04 devstack sudo[77019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 11:31:04 devstack sudo[77019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:31:04 devstack sudo[77019]: pam_unix(sudo:session): session closed for user root Sep 25 11:31:04 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:31:04 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:31:04 devstack sudo[77022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 11:31:04 devstack sudo[77022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:31:04 devstack sudo[77022]: pam_unix(sudo:session): session closed for user root Sep 25 11:31:04 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.278s {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:31:04 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:31:04 devstack sudo[77025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 11:31:04 devstack sudo[77025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:31:05 devstack sudo[77025]: pam_unix(sudo:session): session closed for user root Sep 25 11:31:05 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:31:05 devstack cinder-volume[76192]: DEBUG cinder.manager [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] Notifying Schedulers of capabilities ... {{(pid=76192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:31:05 devstack cinder-volume[76192]: INFO cinder.volume.manager [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] Driver initialization completed successfully. Sep 25 11:31:05 devstack cinder-volume[76192]: INFO cinder.manager [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] Initiating service 2 cleanup Sep 25 11:31:05 devstack cinder-volume[76192]: INFO cinder.manager [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] Service 2 cleanup completed. Sep 25 11:31:05 devstack cinder-volume[76192]: DEBUG cinder.service [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] Creating RPC server for service cinder-volume {{(pid=76192) start /opt/stack/cinder/cinder/service.py:231}} Sep 25 11:31:05 devstack cinder-volume[76192]: DEBUG cinder.service [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76192) start /opt/stack/cinder/cinder/service.py:237}} Sep 25 11:31:05 devstack cinder-volume[76192]: INFO cinder.volume.manager [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 25 11:31:05 devstack cinder-volume[76192]: DEBUG cinder.volume.drivers.lvm [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] Updating volume stats {{(pid=76192) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 11:31:05 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:31:05 devstack sudo[77028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 11:31:05 devstack sudo[77028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:31:05 devstack sudo[77028]: pam_unix(sudo:session): session closed for user root Sep 25 11:31:05 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.319s {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:31:05 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:31:05 devstack sudo[77032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 11:31:05 devstack sudo[77032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:31:05 devstack sudo[77032]: pam_unix(sudo:session): session closed for user root Sep 25 11:31:05 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:31:05 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:31:05 devstack sudo[77036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 11:31:05 devstack sudo[77036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:31:06 devstack sudo[77036]: pam_unix(sudo:session): session closed for user root Sep 25 11:31:06 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.257s {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:31:06 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:31:06 devstack sudo[77039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 11:31:06 devstack sudo[77039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:31:06 devstack sudo[77039]: pam_unix(sudo:session): session closed for user root Sep 25 11:31:06 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:31:06 devstack cinder-volume[76192]: INFO cinder.volume.manager [None req-94c5b6c7-6c23-4bb3-a52b-12f0e0fb7450 None None] Driver post RPC initialization completed successfully. Sep 25 11:31:08 devstack cinder-volume[76030]: DEBUG dbcounter [-] [76030] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76030) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:31:16 devstack cinder-volume[76192]: DEBUG dbcounter [-] [76192] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:31:16 devstack cinder-volume[76192]: DEBUG dbcounter [-] [76192] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=76192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:31:36 devstack cinder-volume[76192]: DEBUG oslo_service.periodic_task [None req-956fa11f-e5be-4f97-9823-3955e4fb063e None None] Running periodic task VolumeManager._thread_info {{(pid=76192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:31:36 devstack cinder-volume[76192]: DEBUG cinder.volume.manager [None req-956fa11f-e5be-4f97-9823-3955e4fb063e None None] thread count: 6 {{(pid=76192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 11:31:36 devstack cinder-volume[76192]: DEBUG cinder.volume.manager [None req-956fa11f-e5be-4f97-9823-3955e4fb063e None None] thread info: [<_MainThread(MainThread, started 137751088119936)>, , , , , ] {{(pid=76192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 11:32:36 devstack cinder-volume[76192]: DEBUG oslo_service.periodic_task [None req-956fa11f-e5be-4f97-9823-3955e4fb063e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:32:36 devstack cinder-volume[76192]: DEBUG cinder.volume.drivers.lvm [None req-956fa11f-e5be-4f97-9823-3955e4fb063e None None] Updating volume stats {{(pid=76192) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 11:32:36 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-956fa11f-e5be-4f97-9823-3955e4fb063e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:32:36 devstack sudo[79713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 11:32:36 devstack sudo[79713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:32:36 devstack sudo[79713]: pam_unix(sudo:session): session closed for user root Sep 25 11:32:36 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-956fa11f-e5be-4f97-9823-3955e4fb063e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:32:36 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-956fa11f-e5be-4f97-9823-3955e4fb063e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:32:36 devstack sudo[79716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 11:32:36 devstack sudo[79716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:32:36 devstack sudo[79716]: pam_unix(sudo:session): session closed for user root Sep 25 11:32:36 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-956fa11f-e5be-4f97-9823-3955e4fb063e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:32:36 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-956fa11f-e5be-4f97-9823-3955e4fb063e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:32:36 devstack sudo[79719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 11:32:36 devstack sudo[79719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:32:37 devstack sudo[79719]: pam_unix(sudo:session): session closed for user root Sep 25 11:32:37 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-956fa11f-e5be-4f97-9823-3955e4fb063e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.269s {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:32:37 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-956fa11f-e5be-4f97-9823-3955e4fb063e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:32:37 devstack sudo[79728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 11:32:37 devstack sudo[79728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:32:37 devstack sudo[79728]: pam_unix(sudo:session): session closed for user root Sep 25 11:32:37 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-956fa11f-e5be-4f97-9823-3955e4fb063e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:32:37 devstack cinder-volume[76192]: DEBUG cinder.manager [None req-956fa11f-e5be-4f97-9823-3955e4fb063e None None] Notifying Schedulers of capabilities ... {{(pid=76192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:32:37 devstack cinder-volume[76192]: DEBUG oslo_service.periodic_task [None req-956fa11f-e5be-4f97-9823-3955e4fb063e None None] Running periodic task VolumeManager._thread_info {{(pid=76192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:32:37 devstack cinder-volume[76192]: DEBUG cinder.volume.manager [None req-956fa11f-e5be-4f97-9823-3955e4fb063e None None] thread count: 6 {{(pid=76192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 11:32:37 devstack cinder-volume[76192]: DEBUG cinder.volume.manager [None req-956fa11f-e5be-4f97-9823-3955e4fb063e None None] thread info: [<_MainThread(MainThread, started 137751088119936)>, , , , , ] {{(pid=76192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 11:33:16 devstack cinder-volume[76192]: DEBUG dbcounter [-] [76192] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:33:36 devstack cinder-volume[76192]: DEBUG oslo_service.periodic_task [None req-956fa11f-e5be-4f97-9823-3955e4fb063e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:33:36 devstack cinder-volume[76192]: DEBUG cinder.volume.drivers.lvm [None req-956fa11f-e5be-4f97-9823-3955e4fb063e None None] Updating volume stats {{(pid=76192) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 11:33:36 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-956fa11f-e5be-4f97-9823-3955e4fb063e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:33:36 devstack sudo[82699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 11:33:36 devstack sudo[82699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:33:36 devstack sudo[82699]: pam_unix(sudo:session): session closed for user root Sep 25 11:33:36 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-956fa11f-e5be-4f97-9823-3955e4fb063e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.285s {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:33:36 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-956fa11f-e5be-4f97-9823-3955e4fb063e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:33:36 devstack sudo[82702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 11:33:36 devstack sudo[82702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:33:36 devstack sudo[82702]: pam_unix(sudo:session): session closed for user root Sep 25 11:33:36 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-956fa11f-e5be-4f97-9823-3955e4fb063e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:33:36 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-956fa11f-e5be-4f97-9823-3955e4fb063e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:33:36 devstack sudo[82705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 11:33:36 devstack sudo[82705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:33:37 devstack sudo[82705]: pam_unix(sudo:session): session closed for user root Sep 25 11:33:37 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-956fa11f-e5be-4f97-9823-3955e4fb063e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.287s {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:33:37 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-956fa11f-e5be-4f97-9823-3955e4fb063e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:33:37 devstack sudo[82714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 11:33:37 devstack sudo[82714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:33:37 devstack sudo[82714]: pam_unix(sudo:session): session closed for user root Sep 25 11:33:37 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-956fa11f-e5be-4f97-9823-3955e4fb063e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.305s {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:33:37 devstack cinder-volume[76192]: DEBUG cinder.manager [None req-956fa11f-e5be-4f97-9823-3955e4fb063e None None] Notifying Schedulers of capabilities ... {{(pid=76192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:33:37 devstack cinder-volume[76192]: DEBUG oslo_service.periodic_task [None req-956fa11f-e5be-4f97-9823-3955e4fb063e None None] Running periodic task VolumeManager._thread_info {{(pid=76192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:33:37 devstack cinder-volume[76192]: DEBUG cinder.volume.manager [None req-956fa11f-e5be-4f97-9823-3955e4fb063e None None] thread count: 6 {{(pid=76192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 11:33:37 devstack cinder-volume[76192]: DEBUG cinder.volume.manager [None req-956fa11f-e5be-4f97-9823-3955e4fb063e None None] thread info: [<_MainThread(MainThread, started 137751088119936)>, , , , , ] {{(pid=76192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 11:34:36 devstack cinder-volume[76192]: DEBUG oslo_service.periodic_task [None req-956fa11f-e5be-4f97-9823-3955e4fb063e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:34:36 devstack cinder-volume[76192]: DEBUG cinder.volume.drivers.lvm [None req-956fa11f-e5be-4f97-9823-3955e4fb063e None None] Updating volume stats {{(pid=76192) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 11:34:36 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-956fa11f-e5be-4f97-9823-3955e4fb063e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:34:36 devstack sudo[84784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 11:34:36 devstack sudo[84784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:34:36 devstack sudo[84784]: pam_unix(sudo:session): session closed for user root Sep 25 11:34:36 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-956fa11f-e5be-4f97-9823-3955e4fb063e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.331s {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:34:36 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-956fa11f-e5be-4f97-9823-3955e4fb063e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:34:36 devstack sudo[84787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 11:34:36 devstack sudo[84787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:34:37 devstack sudo[84787]: pam_unix(sudo:session): session closed for user root Sep 25 11:34:37 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-956fa11f-e5be-4f97-9823-3955e4fb063e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.316s {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:34:37 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-956fa11f-e5be-4f97-9823-3955e4fb063e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:34:37 devstack sudo[84802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 11:34:37 devstack sudo[84802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:34:37 devstack sudo[84802]: pam_unix(sudo:session): session closed for user root Sep 25 11:34:37 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-956fa11f-e5be-4f97-9823-3955e4fb063e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.304s {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:34:37 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-956fa11f-e5be-4f97-9823-3955e4fb063e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:34:37 devstack sudo[84815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 11:34:37 devstack sudo[84815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:34:37 devstack sudo[84815]: pam_unix(sudo:session): session closed for user root Sep 25 11:34:37 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-956fa11f-e5be-4f97-9823-3955e4fb063e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.307s {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:34:37 devstack cinder-volume[76192]: DEBUG cinder.manager [None req-956fa11f-e5be-4f97-9823-3955e4fb063e None None] Notifying Schedulers of capabilities ... {{(pid=76192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:34:37 devstack cinder-volume[76192]: DEBUG oslo_service.periodic_task [None req-956fa11f-e5be-4f97-9823-3955e4fb063e None None] Running periodic task VolumeManager._thread_info {{(pid=76192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:34:37 devstack cinder-volume[76192]: DEBUG cinder.volume.manager [None req-956fa11f-e5be-4f97-9823-3955e4fb063e None None] thread count: 6 {{(pid=76192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 11:34:37 devstack cinder-volume[76192]: DEBUG cinder.volume.manager [None req-956fa11f-e5be-4f97-9823-3955e4fb063e None None] thread info: [<_MainThread(MainThread, started 137751088119936)>, , , , , ] {{(pid=76192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 11:35:16 devstack cinder-volume[76192]: DEBUG dbcounter [-] [76192] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:35:36 devstack cinder-volume[76192]: DEBUG oslo_service.periodic_task [None req-956fa11f-e5be-4f97-9823-3955e4fb063e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:35:36 devstack cinder-volume[76192]: DEBUG cinder.volume.drivers.lvm [None req-956fa11f-e5be-4f97-9823-3955e4fb063e None None] Updating volume stats {{(pid=76192) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 11:35:36 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-956fa11f-e5be-4f97-9823-3955e4fb063e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:35:36 devstack sudo[85811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 11:35:36 devstack sudo[85811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:35:36 devstack sudo[85811]: pam_unix(sudo:session): session closed for user root Sep 25 11:35:36 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-956fa11f-e5be-4f97-9823-3955e4fb063e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:35:36 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-956fa11f-e5be-4f97-9823-3955e4fb063e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:35:36 devstack sudo[85817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 11:35:36 devstack sudo[85817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:35:36 devstack sudo[85817]: pam_unix(sudo:session): session closed for user root Sep 25 11:35:36 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-956fa11f-e5be-4f97-9823-3955e4fb063e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:35:36 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-956fa11f-e5be-4f97-9823-3955e4fb063e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:35:36 devstack sudo[85820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 11:35:36 devstack sudo[85820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:35:37 devstack sudo[85820]: pam_unix(sudo:session): session closed for user root Sep 25 11:35:37 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-956fa11f-e5be-4f97-9823-3955e4fb063e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.284s {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:35:37 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-956fa11f-e5be-4f97-9823-3955e4fb063e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:35:37 devstack sudo[85830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 11:35:37 devstack sudo[85830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:35:37 devstack sudo[85830]: pam_unix(sudo:session): session closed for user root Sep 25 11:35:37 devstack cinder-volume[76192]: DEBUG oslo_concurrency.processutils [None req-956fa11f-e5be-4f97-9823-3955e4fb063e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.285s {{(pid=76192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:35:37 devstack cinder-volume[76192]: DEBUG cinder.manager [None req-956fa11f-e5be-4f97-9823-3955e4fb063e None None] Notifying Schedulers of capabilities ... {{(pid=76192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:35:51 devstack cinder-volume[76030]: INFO oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] Caught SIGTERM, stopping children Sep 25 11:35:51 devstack cinder-volume[76030]: DEBUG oslo_concurrency.lockutils [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] Acquiring lock "singleton_lock" {{(pid=76030) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 11:35:51 devstack cinder-volume[76030]: DEBUG oslo_concurrency.lockutils [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] Acquired lock "singleton_lock" {{(pid=76030) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 11:35:51 devstack cinder-volume[76030]: DEBUG oslo_concurrency.lockutils [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] Releasing lock "singleton_lock" {{(pid=76030) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 11:35:51 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] Stop services. {{(pid=76030) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 25 11:35:51 devstack cinder-volume[76030]: DEBUG oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] Killing children. {{(pid=76030) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 25 11:35:51 devstack cinder-volume[76030]: INFO oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] Waiting on 1 children to exit Sep 25 11:35:55 devstack cinder-volume[76192]: DEBUG oslo_concurrency.lockutils [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] Acquiring lock "singleton_lock" {{(pid=76192) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 11:35:55 devstack cinder-volume[76192]: DEBUG oslo_concurrency.lockutils [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] Acquired lock "singleton_lock" {{(pid=76192) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 11:35:55 devstack cinder-volume[76192]: DEBUG oslo_concurrency.lockutils [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] Releasing lock "singleton_lock" {{(pid=76192) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 11:35:55 devstack cinder-volume[76192]: WARNING amqp [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 25 11:35:55 devstack cinder-volume[76192]: WARNING amqp [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 25 11:35:55 devstack cinder-volume[76030]: INFO oslo_service.backend._eventlet.service [None req-f0e46da0-3b19-482a-823c-4e43e11ee63b None None] Child 76192 exited with status 0 Sep 25 11:35:55 devstack cinder-volume[86268]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 25 11:35:55 devstack cinder-volume[86268]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 25 11:35:55 devstack cinder-volume[86268]: we strongly recommend against using it for new projects. Sep 25 11:35:55 devstack cinder-volume[86268]: If you are already using Eventlet, we recommend migrating to a different Sep 25 11:35:55 devstack cinder-volume[86268]: framework. For more detail see Sep 25 11:35:55 devstack cinder-volume[86268]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 25 11:35:55 devstack cinder-volume[86268]: import eventlet # noqa Sep 25 11:35:57 devstack cinder-volume[86268]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86268) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 11:35:57 devstack cinder-volume[86268]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86268) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 11:35:57 devstack cinder-volume[86268]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86268) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 11:35:58 devstack cinder-volume[86268]: INFO dbcounter [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] Registered counter for database cinder Sep 25 11:35:58 devstack cinder-volume[86268]: DEBUG oslo_db.sqlalchemy.engines [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86268) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 11:35:58 devstack cinder-volume[86268]: DEBUG dbcounter [-] [86268] Writer thread running {{(pid=86268) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 11:35:58 devstack cinder-volume[86268]: INFO cinder.rpc [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 25 11:35:58 devstack cinder-volume[86268]: INFO cinder.rpc [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 25 11:35:58 devstack cinder-volume[86268]: DEBUG oslo_db.sqlalchemy.engines [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86268) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 11:35:59 devstack cinder-volume[86268]: INFO cinder.volume.manager [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] Determined volume DB was empty at startup. Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG cinder.volume.manager [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86268) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 25 11:35:59 devstack cinder-volume[86268]: INFO cinder.volume.manager [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 25 11:35:59 devstack cinder-volume[86268]: WARNING stevedore.named [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 25 11:35:59 devstack cinder-volume[86268]: WARNING castellan.key_manager [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 11:35:59 devstack cinder-volume[86268]: WARNING cinder.keymgr.conf_key_mgr [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 11:35:59 devstack cinder-volume[86268]: INFO cinder.volume.manager [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_db.sqlalchemy.engines [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86268) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 11:35:59 devstack cinder-volume[86268]: INFO oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] Starting 1 workers Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] Started child 86482 {{(pid=86268) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] Full set of CONF: {{(pid=86268) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] ******************************************************************************** {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] Configuration options gathered from: {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] ================================================================================ {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] allow_availability_zone_fallback = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] allow_compression_on_image_upload = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] allowed_direct_url_schemes = [] {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] api_rate_limit = True {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86482]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] auth_strategy = keystone {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_availability_zone = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_host = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_name = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_stats_polling_interval = 60 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backup_api_class = cinder.backup.api.API {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backup_name_template = backup-%s {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backup_use_same_host = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backup_use_temp_snapshot = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] chap_password = **** {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] chap_username = {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] cinder_internal_tenant_project_id = b7eaff659baa4ad8b65781b7b648a1d5 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] cinder_internal_tenant_user_id = 2c9aff709ae246cabe63976b8bbadcd0 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] cluster = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] compression_format = gzip {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] compute_api_class = cinder.compute.nova.API {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] config_dir = [] {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] config_source = [] {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] control_exchange = openstack {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] debug = True {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] default_availability_zone = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] default_group_type = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] default_volume_type = QuobyteHD {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] disk_geometry = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] driver_client_cert = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] driver_client_cert_key = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] driver_data_namespace = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] driver_ssl_cert_path = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] driver_ssl_cert_verify = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] driver_use_ssl = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] enable_new_services = True {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] enable_unsupported_driver = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] enabled_backends = ['QuobyteHD'] {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] enforce_multipath_for_image_xfer = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] filter_function = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] glance_api_insecure = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] glance_api_servers = ['http://192.168.122.58/image'] {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] glance_api_ssl_compression = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] glance_ca_certificates_file = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] glance_catalog_info = image:glance:publicURL {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] glance_certfile = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] glance_keyfile = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] glance_num_retries = 3 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] glance_request_timeout = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] goodness_function = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] graceful_shutdown_timeout = 5 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] group_api_class = cinder.group.api.API {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] host = devstack {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] image_compress_on_upload = True {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] image_conversion_address_space_limit = 1 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] image_conversion_cpu_limit = 60 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] image_conversion_disable = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] image_introspection_address_space_limit = 1 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] image_introspection_cpu_limit = 60 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] image_upload_use_cinder_backend = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] image_upload_use_internal_tenant = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] image_volume_cache_enabled = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] image_volume_cache_max_count = 0 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] image_volume_cache_max_size_gb = 0 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] init_host_max_objects_retrieval = 0 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] instance_format = [instance: %(uuid)s] {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] iscsi_target_flags = {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] iscsi_write_cache = on {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] iser_helper = tgtadm {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] iser_ip_address = 192.168.122.58 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] iser_port = 3260 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] log_color = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] log_config_append = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] log_dir = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] log_file = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] log_options = True {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] log_rotate_interval = 1 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] log_rotate_interval_type = days {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] log_rotation_type = none {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] max_age = 0 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] max_logfile_count = 30 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] max_logfile_size_mb = 200 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] max_over_subscription_ratio = 20.0 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] message_reap_interval = 86400 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] message_ttl = 2592000 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] migration_create_volume_timeout_secs = 300 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] monkey_patch = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] monkey_patch_modules = [] {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] my_ip = 192.168.122.58 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] no_snapshot_gb_quota = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] num_iser_scan_tries = 3 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] num_shell_tries = 3 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] num_volume_device_scan_tries = 3 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] nvmeof_conn_info_version = 1 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] nvmet_ns_id = 10 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] nvmet_port_id = 1 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] osapi_max_limit = 1000 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] osapi_volume_ext_list = [] {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] osapi_volume_listen_port = 8776 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86482]: INFO cinder.volume.manager [None req-5dda6e15-9b8f-4656-96b4-e76afccdd755 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] osapi_volume_use_ssl = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] osapi_volume_workers = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] per_volume_size_limit = -1 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] periodic_fuzzy_delay = 60 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] periodic_interval = 60 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86482]: DEBUG cinder.volume.drivers.remotefs [None req-5dda6e15-9b8f-4656-96b4-e76afccdd755 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86482) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] public_endpoint = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] publish_errors = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] quota_backup_gigabytes = 1000 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] quota_backups = 10 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] quota_gigabytes = 1000 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] quota_groups = 10 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] quota_snapshots = 10 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] quota_volumes = 10 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] rate_limit_burst = 0 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] rate_limit_except_level = CRITICAL {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] rate_limit_interval = 0 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] reinit_driver_count = 3 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] replication_device = **** {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] report_discard_supported = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] report_interval = 120 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] reservation_clean_interval = 86400 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] reservation_expire = 86400 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] reserved_image_namespaces = [] {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] reserved_percentage = 0 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] rpc_response_timeout = 120 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] run_external_periodic_tasks = True {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] scst_target_driver = iscsi {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] scst_target_iqn_name = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] service_down_time = 720 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] shell_completion = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] snapshot_name_template = snapshot-%s {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] split_loggers = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] state_path = /opt/stack/data/cinder {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] storage_availability_zone = nova {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] storage_protocol = iSCSI {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] syslog_log_facility = LOG_USER {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] target_helper = lioadm {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] target_ip_address = 192.168.122.58 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] target_port = 3260 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] target_protocol = iscsi {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] target_secondary_ip_addresses = [] {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] trace_flags = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] transport_url = **** {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] until_refresh = 0 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] use_chap_auth = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] use_default_quota_class = True {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] use_journal = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] use_json = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] use_multipath_for_image_xfer = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] use_stderr = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] use_syslog = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] verify_glance_signatures = enabled {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] volume_api_class = cinder.volume.api.API {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] volume_backend_name = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] volume_clear = zero {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] volume_clear_ionice = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] volume_clear_size = 0 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] volume_copy_bps_limit = 0 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] volume_dd_blocksize = 1M {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] volume_name_template = volume-%s {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] volume_service_inithost_offload = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] volume_usage_audit_period = month {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] zoning_mode = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] oslo_concurrency.disable_process_locking = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] keystone_authtoken.auth_section = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] keystone_authtoken.auth_type = password {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] keystone_authtoken.auth_version = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] keystone_authtoken.cache = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] keystone_authtoken.certfile = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] keystone_authtoken.include_service_catalog = True {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] keystone_authtoken.insecure = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] keystone_authtoken.interface = public {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] keystone_authtoken.keyfile = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] keystone_authtoken.memcache_password = **** {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] keystone_authtoken.memcache_username = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] keystone_authtoken.region_name = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] keystone_authtoken.service_type = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.58/identity {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] cache.backend = dogpile.cache.null {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] cache.backend_argument = **** {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] cache.backend_expiration_time = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] cache.config_prefix = cache.oslo {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] cache.debug_cache_backend = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] cache.enable_retry_client = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] cache.enable_socket_keepalive = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] cache.enabled = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] cache.expiration_time = 600 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] cache.hashclient_retry_attempts = 2 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] cache.memcache_dead_retry = 300 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] cache.memcache_pool_maxsize = 10 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] cache.memcache_sasl_enabled = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] cache.password = **** {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] cache.proxies = [] {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] cache.redis_db = 0 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] cache.redis_server = localhost:6379 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] cache.retry_attempts = 2 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] cache.retry_delay = 0.0 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] cache.socket_keepalive_count = 1 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] cache.socket_keepalive_idle = 1 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] cache.socket_keepalive_interval = 1 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] cache.socket_timeout = 1.0 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] cache.tls_allowed_ciphers = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] cache.tls_cafile = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] cache.tls_certfile = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] cache.tls_enabled = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] cache.tls_keyfile = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] cache.username = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] coordination.backend_url = **** {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] database.asyncio_connection = **** {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] database.asyncio_slave_connection = **** {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] database.backend = sqlalchemy {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] database.connection = **** {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] database.connection_debug = 0 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] database.connection_parameters = {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] database.connection_recycle_time = 3600 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] database.connection_trace = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] database.db_inc_retry_interval = True {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] database.db_max_retries = 20 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] database.db_max_retry_interval = 10 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] database.db_retry_interval = 1 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] database.max_overflow = 50 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] database.max_pool_size = 5 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] database.max_retries = 10 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] database.mysql_wsrep_sync_wait = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] database.pool_timeout = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] database.retry_interval = 10 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] database.slave_connection = **** {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] database.sqlite_synchronous = True {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] database.synchronous_reader = True {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] database.use_db_reconnect = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] oslo_messaging_tracing.insecure = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] profiler.connection_string = messaging:// {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] profiler.enabled = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] profiler.es_doc_type = notification {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] profiler.es_scroll_size = 10000 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] profiler.es_scroll_time = 2m {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] profiler.filter_error_trace = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] profiler.hmac_keys = **** {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] profiler.sentinel_service_name = mymaster {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] profiler.socket_timeout = 0.1 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] profiler.trace_requests = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] profiler.trace_sqlalchemy = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] profiler_jaeger.process_tags = {} {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] profiler_jaeger.service_name_prefix = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] profiler_otlp.service_name_prefix = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] oslo_policy.enforce_new_defaults = True {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] oslo_policy.policy_default_rule = default {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] oslo_policy.policy_file = policy.yaml {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] privsep_osbrick.group = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] privsep_osbrick.helper_command = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] privsep_osbrick.user = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] cinder_sys_admin.group = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] cinder_sys_admin.helper_command = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] cinder_sys_admin.user = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] service_user.auth_section = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] service_user.auth_type = password {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] service_user.cafile = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] service_user.certfile = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] service_user.collect_timing = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] service_user.insecure = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] service_user.keyfile = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] service_user.send_service_user_token = True {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] service_user.split_loggers = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] service_user.timeout = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] service_user.tls_ciphers = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] service_user.tls_min_version = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] glance.auth_section = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] glance.auth_type = password {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] glance.certfile = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] glance.collect_timing = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] glance.insecure = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] glance.keyfile = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] glance.region_name = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] glance.split_loggers = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] glance.timeout = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] glance.tls_ciphers = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] glance.tls_min_version = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_defaults.backend_availability_zone = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_defaults.chap_password = **** {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_defaults.chap_username = {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_defaults.disk_geometry = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_defaults.driver_client_cert = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_defaults.driver_client_cert_key = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_defaults.driver_data_namespace = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_defaults.driver_use_ssl = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_defaults.extra_capabilities = {} {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_defaults.filter_function = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_defaults.goodness_function = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_defaults.iscsi_target_flags = {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_defaults.iscsi_write_cache = on {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_defaults.iser_helper = tgtadm {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_defaults.iser_ip_address = 192.168.122.58 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_defaults.iser_port = 3260 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_defaults.nas_host = {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_defaults.nas_login = admin {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_defaults.nas_mount_options = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_defaults.nas_password = **** {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_defaults.nas_private_key = {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_defaults.nas_share_path = {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_defaults.num_shell_tries = 3 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_defaults.quobyte_volume_url = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_defaults.replication_device = **** {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_defaults.report_discard_supported = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_defaults.reserved_percentage = 0 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_defaults.target_helper = tgtadm {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_defaults.target_ip_address = 192.168.122.58 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_defaults.target_port = 3260 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_defaults.target_protocol = iscsi {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_defaults.trace_flags = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_defaults.unique_fqdn_network = True {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_defaults.use_chap_auth = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_defaults.volume_backend_name = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_defaults.volume_clear = zero {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_defaults.volume_clear_ionice = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_defaults.volume_clear_size = 0 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] oslo_reports.file_event_handler = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] oslo_reports.log_dir = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] QuobyteHD.backend_availability_zone = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] QuobyteHD.backend_host = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] QuobyteHD.chap_password = **** {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] QuobyteHD.chap_username = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] QuobyteHD.chiscsi_conf = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] QuobyteHD.disk_geometry = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] QuobyteHD.driver_client_cert = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] QuobyteHD.driver_data_namespace = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] QuobyteHD.driver_use_ssl = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] QuobyteHD.extra_capabilities = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] QuobyteHD.filter_function = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] QuobyteHD.goodness_function = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] QuobyteHD.iser_helper = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] QuobyteHD.iser_ip_address = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] QuobyteHD.iser_port = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] QuobyteHD.iser_target_prefix = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] QuobyteHD.nas_host = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] QuobyteHD.nas_login = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] QuobyteHD.nas_mount_options = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] QuobyteHD.nas_password = **** {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] QuobyteHD.nas_private_key = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] QuobyteHD.nas_share_path = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] QuobyteHD.nas_ssh_port = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] QuobyteHD.num_shell_tries = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86482]: DEBUG cinder.volume.drivers.quobyte [None req-5dda6e15-9b8f-4656-96b4-e76afccdd755 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86482) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] QuobyteHD.nvmet_port_id = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] QuobyteHD.replication_device = **** {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] QuobyteHD.report_discard_supported = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] QuobyteHD.reserved_percentage = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] QuobyteHD.scst_target_driver = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] QuobyteHD.storage_protocol = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] QuobyteHD.target_helper = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] QuobyteHD.target_ip_address = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] QuobyteHD.target_port = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] QuobyteHD.target_prefix = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] QuobyteHD.target_protocol = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] QuobyteHD.trace_flags = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86482]: WARNING cinder.volume.drivers.quobyte [None req-5dda6e15-9b8f-4656-96b4-e76afccdd755 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 25 11:35:59 devstack cinder-volume[86482]: WARNING cinder.volume.drivers.quobyte [None req-5dda6e15-9b8f-4656-96b4-e76afccdd755 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 25 11:35:59 devstack cinder-volume[86482]: DEBUG oslo_concurrency.processutils [None req-5dda6e15-9b8f-4656-96b4-e76afccdd755 None None] Running cmd (subprocess): mount.quobyte {{(pid=86482) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] QuobyteHD.use_chap_auth = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] QuobyteHD.volume_clear = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] QuobyteHD.volume_clear_size = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] QuobyteHD.volumes_dir = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] oslo_messaging_rabbit.ssl = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] oslo_messaging_notifications.driver = [] {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] oslo_messaging_notifications.retry = -1 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] key_manager.fixed_key = **** {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] barbican.barbican_api_version = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] barbican.barbican_endpoint = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] barbican.barbican_endpoint_type = public {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] barbican.barbican_region_name = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] barbican.cafile = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] barbican.certfile = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] barbican.collect_timing = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] barbican.insecure = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] barbican.keyfile = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] barbican.number_of_retries = 60 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] barbican.retry_delay = 1 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] barbican.send_service_user_token = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] barbican.split_loggers = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] barbican.timeout = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] barbican.tls_ciphers = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] barbican.tls_min_version = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] barbican.verify_ssl = True {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] barbican.verify_ssl_path = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] barbican_service_user.auth_section = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] barbican_service_user.auth_type = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] barbican_service_user.cafile = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] barbican_service_user.certfile = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] barbican_service_user.collect_timing = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] barbican_service_user.insecure = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] barbican_service_user.keyfile = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] barbican_service_user.split_loggers = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] barbican_service_user.timeout = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] barbican_service_user.tls_ciphers = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] barbican_service_user.tls_min_version = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] vault.approle_role_id = **** {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] vault.approle_secret_id = **** {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] vault.auth_method = approle {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] vault.auth_path = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] vault.kv_mountpoint = secret {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] vault.kv_path = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] vault.kv_version = 2 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] vault.namespace = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] vault.root_token_id = **** {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] vault.ssl_ca_crt_file = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] vault.timeout = 60.0 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] vault.token_file = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] vault.token_role = None {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] vault.use_ssl = False {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:35:59 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] ******************************************************************************** {{(pid=86268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 25 11:35:59 devstack quobyte-client[86487]: Reading configuration file: /etc/quobyte/client.cfg Sep 25 11:35:59 devstack quobyte-client[86487]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 25 11:35:59 devstack cinder-volume[86482]: DEBUG oslo_concurrency.processutils [None req-5dda6e15-9b8f-4656-96b4-e76afccdd755 None None] CMD "mount.quobyte" returned: 1 in 0.087s {{(pid=86482) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:35:59 devstack cinder-volume[86482]: DEBUG oslo_concurrency.lockutils [None req-5dda6e15-9b8f-4656-96b4-e76afccdd755 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86482) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:35:59 devstack cinder-volume[86482]: DEBUG oslo_concurrency.lockutils [None req-5dda6e15-9b8f-4656-96b4-e76afccdd755 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86482) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:35:59 devstack cinder-volume[86482]: DEBUG cinder.volume.drivers.quobyte [None req-5dda6e15-9b8f-4656-96b4-e76afccdd755 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86482) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:35:59 devstack cinder-volume[86482]: INFO cinder.volume.drivers.quobyte [None req-5dda6e15-9b8f-4656-96b4-e76afccdd755 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba ... Sep 25 11:35:59 devstack cinder-volume[86482]: DEBUG oslo_concurrency.processutils [None req-5dda6e15-9b8f-4656-96b4-e76afccdd755 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a -c /etc/quobyte/client-cinder.cfg {{(pid=86482) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:35:59 devstack sudo[86488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a -c /etc/quobyte/client-cinder.cfg Sep 25 11:35:59 devstack sudo[86488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:36:00 devstack sudo[86488]: pam_unix(sudo:session): session closed for user root Sep 25 11:36:00 devstack cinder-volume[86482]: DEBUG oslo_concurrency.processutils [None req-5dda6e15-9b8f-4656-96b4-e76afccdd755 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.443s {{(pid=86482) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:36:00 devstack cinder-volume[86482]: INFO cinder.volume.drivers.quobyte [None req-5dda6e15-9b8f-4656-96b4-e76afccdd755 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba succeeded Sep 25 11:36:00 devstack cinder-volume[86482]: DEBUG cinder.volume.drivers.quobyte [None req-5dda6e15-9b8f-4656-96b4-e76afccdd755 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86482) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:36:00 devstack cinder-volume[86482]: DEBUG oslo_concurrency.lockutils [None req-5dda6e15-9b8f-4656-96b4-e76afccdd755 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.456s {{(pid=86482) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:36:00 devstack cinder-volume[86482]: DEBUG oslo_concurrency.processutils [None req-5dda6e15-9b8f-4656-96b4-e76afccdd755 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86482) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:36:00 devstack sudo[86587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:36:00 devstack sudo[86587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:36:00 devstack sudo[86587]: pam_unix(sudo:session): session closed for user root Sep 25 11:36:00 devstack cinder-volume[86482]: DEBUG oslo_concurrency.processutils [None req-5dda6e15-9b8f-4656-96b4-e76afccdd755 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.271s {{(pid=86482) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:36:00 devstack cinder-volume[86482]: INFO cinder.volume.driver [None req-5dda6e15-9b8f-4656-96b4-e76afccdd755 None None] Driver hasn't implemented _init_vendor_properties() Sep 25 11:36:00 devstack cinder-volume[86482]: DEBUG cinder.volume.driver [None req-5dda6e15-9b8f-4656-96b4-e76afccdd755 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.4321403503418, 'free_capacity_gb': 1775.4321403503418, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86482) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 25 11:36:00 devstack cinder-volume[86482]: DEBUG oslo_db.sqlalchemy.engines [None req-5dda6e15-9b8f-4656-96b4-e76afccdd755 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86482) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 11:36:00 devstack cinder-volume[86482]: DEBUG dbcounter [-] [86482] Writer thread running {{(pid=86482) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 11:36:00 devstack cinder-volume[86482]: DEBUG cinder.db.api [None req-5dda6e15-9b8f-4656-96b4-e76afccdd755 None None] Building query based on filter {{(pid=86482) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 25 11:36:00 devstack cinder-volume[86482]: DEBUG cinder.image.image_utils [None req-5dda6e15-9b8f-4656-96b4-e76afccdd755 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86482) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 25 11:36:00 devstack cinder-volume[86482]: INFO cinder.keymgr.migration [None req-9286a12e-89dd-45c3-a465-0a2a3c0213e1 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 25 11:36:00 devstack cinder-volume[86482]: DEBUG oslo_concurrency.lockutils [None req-5dda6e15-9b8f-4656-96b4-e76afccdd755 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86482) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:36:00 devstack cinder-volume[86482]: DEBUG oslo_concurrency.lockutils [None req-5dda6e15-9b8f-4656-96b4-e76afccdd755 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86482) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:36:00 devstack cinder-volume[86482]: DEBUG cinder.volume.drivers.quobyte [None req-5dda6e15-9b8f-4656-96b4-e76afccdd755 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86482) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:36:00 devstack cinder-volume[86482]: DEBUG cinder.volume.drivers.quobyte [None req-5dda6e15-9b8f-4656-96b4-e76afccdd755 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86482) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:36:00 devstack cinder-volume[86482]: DEBUG oslo_concurrency.lockutils [None req-5dda6e15-9b8f-4656-96b4-e76afccdd755 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86482) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:36:00 devstack cinder-volume[86482]: DEBUG oslo_concurrency.processutils [None req-5dda6e15-9b8f-4656-96b4-e76afccdd755 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86482) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:36:00 devstack sudo[86590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:36:00 devstack sudo[86590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:36:00 devstack sudo[86590]: pam_unix(sudo:session): session closed for user root Sep 25 11:36:00 devstack cinder-volume[86482]: DEBUG oslo_concurrency.processutils [None req-5dda6e15-9b8f-4656-96b4-e76afccdd755 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.314s {{(pid=86482) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:36:00 devstack cinder-volume[86482]: DEBUG cinder.manager [None req-5dda6e15-9b8f-4656-96b4-e76afccdd755 None None] Notifying Schedulers of capabilities ... {{(pid=86482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:36:00 devstack cinder-volume[86482]: INFO cinder.volume.manager [None req-5dda6e15-9b8f-4656-96b4-e76afccdd755 None None] Driver initialization completed successfully. Sep 25 11:36:00 devstack cinder-volume[86482]: INFO cinder.manager [None req-5dda6e15-9b8f-4656-96b4-e76afccdd755 None None] Initiating service 3 cleanup Sep 25 11:36:00 devstack cinder-volume[86482]: INFO cinder.manager [None req-5dda6e15-9b8f-4656-96b4-e76afccdd755 None None] Service 3 cleanup completed. Sep 25 11:36:00 devstack cinder-volume[86482]: DEBUG cinder.service [None req-5dda6e15-9b8f-4656-96b4-e76afccdd755 None None] Creating RPC server for service cinder-volume {{(pid=86482) start /opt/stack/cinder/cinder/service.py:231}} Sep 25 11:36:00 devstack cinder-volume[86482]: DEBUG cinder.service [None req-5dda6e15-9b8f-4656-96b4-e76afccdd755 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86482) start /opt/stack/cinder/cinder/service.py:237}} Sep 25 11:36:01 devstack cinder-volume[86482]: INFO cinder.volume.manager [None req-5dda6e15-9b8f-4656-96b4-e76afccdd755 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 25 11:36:01 devstack cinder-volume[86482]: DEBUG oslo_concurrency.lockutils [None req-5dda6e15-9b8f-4656-96b4-e76afccdd755 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86482) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:36:01 devstack cinder-volume[86482]: DEBUG oslo_concurrency.lockutils [None req-5dda6e15-9b8f-4656-96b4-e76afccdd755 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86482) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:36:01 devstack cinder-volume[86482]: DEBUG cinder.volume.drivers.quobyte [None req-5dda6e15-9b8f-4656-96b4-e76afccdd755 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86482) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:36:01 devstack cinder-volume[86482]: DEBUG cinder.volume.drivers.quobyte [None req-5dda6e15-9b8f-4656-96b4-e76afccdd755 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86482) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:36:01 devstack cinder-volume[86482]: DEBUG oslo_concurrency.lockutils [None req-5dda6e15-9b8f-4656-96b4-e76afccdd755 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86482) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:36:01 devstack cinder-volume[86482]: DEBUG oslo_concurrency.processutils [None req-5dda6e15-9b8f-4656-96b4-e76afccdd755 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86482) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:36:01 devstack sudo[86594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:36:01 devstack sudo[86594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:36:01 devstack sudo[86594]: pam_unix(sudo:session): session closed for user root Sep 25 11:36:01 devstack cinder-volume[86482]: DEBUG oslo_concurrency.processutils [None req-5dda6e15-9b8f-4656-96b4-e76afccdd755 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.319s {{(pid=86482) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:36:01 devstack cinder-volume[86482]: INFO cinder.volume.manager [None req-5dda6e15-9b8f-4656-96b4-e76afccdd755 None None] Driver post RPC initialization completed successfully. Sep 25 11:36:04 devstack cinder-volume[86268]: INFO oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] Caught SIGTERM, stopping children Sep 25 11:36:04 devstack cinder-volume[86268]: DEBUG oslo_concurrency.lockutils [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] Acquiring lock "singleton_lock" {{(pid=86268) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 11:36:04 devstack cinder-volume[86268]: DEBUG oslo_concurrency.lockutils [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] Acquired lock "singleton_lock" {{(pid=86268) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 11:36:04 devstack cinder-volume[86268]: DEBUG oslo_concurrency.lockutils [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] Releasing lock "singleton_lock" {{(pid=86268) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 11:36:04 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] Stop services. {{(pid=86268) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 25 11:36:04 devstack cinder-volume[86268]: DEBUG oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] Killing children. {{(pid=86268) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 25 11:36:04 devstack cinder-volume[86268]: INFO oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] Waiting on 1 children to exit Sep 25 11:36:05 devstack cinder-volume[86482]: DEBUG oslo_concurrency.lockutils [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] Acquiring lock "singleton_lock" {{(pid=86482) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 11:36:05 devstack cinder-volume[86482]: DEBUG oslo_concurrency.lockutils [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] Acquired lock "singleton_lock" {{(pid=86482) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 11:36:05 devstack cinder-volume[86482]: DEBUG oslo_concurrency.lockutils [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] Releasing lock "singleton_lock" {{(pid=86482) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 11:36:05 devstack cinder-volume[86482]: WARNING amqp [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 25 11:36:05 devstack cinder-volume[86482]: WARNING amqp [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 25 11:36:05 devstack cinder-volume[86268]: INFO oslo_service.backend._eventlet.service [None req-6748e8a5-8a97-491c-a1cb-f406115998b3 None None] Child 86482 exited with status 0 Sep 25 11:36:05 devstack cinder-volume[86784]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 25 11:36:05 devstack cinder-volume[86784]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 25 11:36:05 devstack cinder-volume[86784]: we strongly recommend against using it for new projects. Sep 25 11:36:05 devstack cinder-volume[86784]: If you are already using Eventlet, we recommend migrating to a different Sep 25 11:36:05 devstack cinder-volume[86784]: framework. For more detail see Sep 25 11:36:05 devstack cinder-volume[86784]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 25 11:36:05 devstack cinder-volume[86784]: import eventlet # noqa Sep 25 11:36:08 devstack cinder-volume[86784]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86784) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 11:36:08 devstack cinder-volume[86784]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86784) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 11:36:08 devstack cinder-volume[86784]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86784) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 11:36:09 devstack cinder-volume[86784]: INFO dbcounter [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] Registered counter for database cinder Sep 25 11:36:09 devstack cinder-volume[86784]: DEBUG oslo_db.sqlalchemy.engines [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86784) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG dbcounter [-] [86784] Writer thread running {{(pid=86784) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 11:36:10 devstack cinder-volume[86784]: INFO cinder.rpc [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 25 11:36:10 devstack cinder-volume[86784]: INFO cinder.rpc [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_db.sqlalchemy.engines [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86784) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 11:36:10 devstack cinder-volume[86784]: INFO cinder.volume.manager [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] Determined volume DB was empty at startup. Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG cinder.volume.manager [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86784) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 25 11:36:10 devstack cinder-volume[86784]: WARNING stevedore.named [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 25 11:36:10 devstack cinder-volume[86784]: WARNING castellan.key_manager [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 11:36:10 devstack cinder-volume[86784]: WARNING cinder.keymgr.conf_key_mgr [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 11:36:10 devstack cinder-volume[86784]: INFO cinder.volume.manager [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_db.sqlalchemy.engines [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86784) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 11:36:10 devstack cinder-volume[86784]: INFO oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] Starting 1 workers Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] Started child 86984 {{(pid=86784) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] Full set of CONF: {{(pid=86784) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] ******************************************************************************** {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] Configuration options gathered from: {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] ================================================================================ {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] allow_availability_zone_fallback = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] allow_compression_on_image_upload = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] allowed_direct_url_schemes = [] {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] api_rate_limit = True {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] auth_strategy = keystone {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86984]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_availability_zone = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_host = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_name = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_stats_polling_interval = 60 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backup_api_class = cinder.backup.api.API {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backup_name_template = backup-%s {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backup_use_same_host = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backup_use_temp_snapshot = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] chap_password = **** {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] chap_username = {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] cinder_internal_tenant_project_id = b7eaff659baa4ad8b65781b7b648a1d5 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] cinder_internal_tenant_user_id = 2c9aff709ae246cabe63976b8bbadcd0 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] cluster = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] compression_format = gzip {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] compute_api_class = cinder.compute.nova.API {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] config_dir = [] {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] config_source = [] {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] control_exchange = openstack {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] debug = True {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] default_availability_zone = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] default_group_type = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] default_volume_type = QuobyteHD {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] disk_geometry = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] driver_client_cert = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] driver_client_cert_key = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] driver_data_namespace = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] driver_ssl_cert_path = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] driver_ssl_cert_verify = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] driver_use_ssl = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] enable_new_services = True {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] enable_unsupported_driver = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] enabled_backends = ['QuobyteHD'] {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] enforce_multipath_for_image_xfer = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] filter_function = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] glance_api_insecure = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] glance_api_servers = ['http://192.168.122.58/image'] {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] glance_api_ssl_compression = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] glance_ca_certificates_file = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] glance_catalog_info = image:glance:publicURL {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] glance_certfile = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] glance_keyfile = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] glance_num_retries = 3 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] glance_request_timeout = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] goodness_function = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] graceful_shutdown_timeout = 5 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] group_api_class = cinder.group.api.API {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] host = devstack {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] image_compress_on_upload = True {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] image_conversion_address_space_limit = 1 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] image_conversion_cpu_limit = 60 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] image_conversion_disable = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] image_introspection_address_space_limit = 1 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] image_introspection_cpu_limit = 60 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] image_upload_use_cinder_backend = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] image_upload_use_internal_tenant = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] image_volume_cache_enabled = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] image_volume_cache_max_count = 0 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] image_volume_cache_max_size_gb = 0 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] init_host_max_objects_retrieval = 0 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] instance_format = [instance: %(uuid)s] {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] iscsi_target_flags = {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] iscsi_write_cache = on {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] iser_helper = tgtadm {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] iser_ip_address = 192.168.122.58 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] iser_port = 3260 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] log_color = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] log_config_append = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] log_dir = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] log_file = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] log_options = True {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] log_rotate_interval = 1 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] log_rotate_interval_type = days {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-4ef2f0ea-5cc1-4375-b411-a09f94e575a7 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 25 11:36:10 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-4ef2f0ea-5cc1-4375-b411-a09f94e575a7 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86984) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] log_rotation_type = none {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] max_age = 0 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] max_logfile_count = 30 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] max_logfile_size_mb = 200 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] max_over_subscription_ratio = 20.0 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] message_reap_interval = 86400 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] message_ttl = 2592000 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] migration_create_volume_timeout_secs = 300 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] monkey_patch = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] monkey_patch_modules = [] {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] my_ip = 192.168.122.58 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] no_snapshot_gb_quota = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] num_iser_scan_tries = 3 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] num_shell_tries = 3 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] num_volume_device_scan_tries = 3 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] nvmeof_conn_info_version = 1 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] nvmet_ns_id = 10 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] nvmet_port_id = 1 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] osapi_max_limit = 1000 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] osapi_volume_ext_list = [] {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] osapi_volume_listen_port = 8776 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] osapi_volume_use_ssl = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] osapi_volume_workers = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] per_volume_size_limit = -1 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] periodic_fuzzy_delay = 60 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] periodic_interval = 60 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] public_endpoint = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] publish_errors = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] quota_backup_gigabytes = 1000 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] quota_backups = 10 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] quota_gigabytes = 1000 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] quota_groups = 10 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] quota_snapshots = 10 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] quota_volumes = 10 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] rate_limit_burst = 0 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] rate_limit_except_level = CRITICAL {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] rate_limit_interval = 0 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] reinit_driver_count = 3 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] replication_device = **** {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] report_discard_supported = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] report_interval = 120 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] reservation_clean_interval = 86400 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] reservation_expire = 86400 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] reserved_image_namespaces = [] {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] reserved_percentage = 0 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] rpc_response_timeout = 120 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] run_external_periodic_tasks = True {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] scst_target_driver = iscsi {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] scst_target_iqn_name = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] service_down_time = 720 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] shell_completion = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] snapshot_name_template = snapshot-%s {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] split_loggers = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] state_path = /opt/stack/data/cinder {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] storage_availability_zone = nova {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] storage_protocol = iSCSI {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] syslog_log_facility = LOG_USER {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] target_helper = lioadm {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] target_ip_address = 192.168.122.58 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] target_port = 3260 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] target_protocol = iscsi {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] target_secondary_ip_addresses = [] {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] trace_flags = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] transport_url = **** {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] until_refresh = 0 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] use_chap_auth = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] use_default_quota_class = True {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] use_journal = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] use_json = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] use_multipath_for_image_xfer = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] use_stderr = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] use_syslog = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] verify_glance_signatures = enabled {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] volume_api_class = cinder.volume.api.API {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] volume_backend_name = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] volume_clear = zero {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] volume_clear_ionice = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] volume_clear_size = 0 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] volume_copy_bps_limit = 0 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] volume_dd_blocksize = 1M {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] volume_name_template = volume-%s {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] volume_service_inithost_offload = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] volume_usage_audit_period = month {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] zoning_mode = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] oslo_concurrency.disable_process_locking = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] keystone_authtoken.auth_section = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] keystone_authtoken.auth_type = password {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] keystone_authtoken.auth_version = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] keystone_authtoken.cache = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] keystone_authtoken.certfile = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] keystone_authtoken.include_service_catalog = True {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] keystone_authtoken.insecure = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] keystone_authtoken.interface = public {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] keystone_authtoken.keyfile = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] keystone_authtoken.memcache_password = **** {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] keystone_authtoken.memcache_username = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] keystone_authtoken.region_name = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] keystone_authtoken.service_type = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.58/identity {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] cache.backend = dogpile.cache.null {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] cache.backend_argument = **** {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] cache.backend_expiration_time = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] cache.config_prefix = cache.oslo {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] cache.debug_cache_backend = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] cache.enable_retry_client = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] cache.enable_socket_keepalive = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] cache.enabled = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] cache.expiration_time = 600 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] cache.hashclient_retry_attempts = 2 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] cache.memcache_dead_retry = 300 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] cache.memcache_pool_maxsize = 10 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] cache.memcache_sasl_enabled = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-4ef2f0ea-5cc1-4375-b411-a09f94e575a7 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86984) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 25 11:36:10 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.quobyte [None req-4ef2f0ea-5cc1-4375-b411-a09f94e575a7 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 25 11:36:10 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.quobyte [None req-4ef2f0ea-5cc1-4375-b411-a09f94e575a7 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] cache.password = **** {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] cache.proxies = [] {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] cache.redis_db = 0 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] cache.redis_server = localhost:6379 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] cache.retry_attempts = 2 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] cache.retry_delay = 0.0 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] cache.socket_keepalive_count = 1 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] cache.socket_keepalive_idle = 1 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] cache.socket_keepalive_interval = 1 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] cache.socket_timeout = 1.0 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] cache.tls_allowed_ciphers = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] cache.tls_cafile = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] cache.tls_certfile = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] cache.tls_enabled = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] cache.tls_keyfile = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] cache.username = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] coordination.backend_url = **** {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] database.asyncio_connection = **** {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-4ef2f0ea-5cc1-4375-b411-a09f94e575a7 None None] Running cmd (subprocess): mount.quobyte {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] database.asyncio_slave_connection = **** {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] database.backend = sqlalchemy {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] database.connection = **** {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] database.connection_debug = 0 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] database.connection_parameters = {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] database.connection_recycle_time = 3600 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] database.connection_trace = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] database.db_inc_retry_interval = True {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] database.db_max_retries = 20 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] database.db_max_retry_interval = 10 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] database.db_retry_interval = 1 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] database.max_overflow = 50 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] database.max_pool_size = 5 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] database.max_retries = 10 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] database.mysql_wsrep_sync_wait = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] database.pool_timeout = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] database.retry_interval = 10 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] database.slave_connection = **** {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] database.sqlite_synchronous = True {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] database.synchronous_reader = True {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] database.use_db_reconnect = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] oslo_messaging_tracing.insecure = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] profiler.connection_string = messaging:// {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] profiler.enabled = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] profiler.es_doc_type = notification {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] profiler.es_scroll_size = 10000 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] profiler.es_scroll_time = 2m {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] profiler.filter_error_trace = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] profiler.hmac_keys = **** {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] profiler.sentinel_service_name = mymaster {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] profiler.socket_timeout = 0.1 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] profiler.trace_requests = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] profiler.trace_sqlalchemy = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] profiler_jaeger.process_tags = {} {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] profiler_jaeger.service_name_prefix = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] profiler_otlp.service_name_prefix = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] oslo_policy.enforce_new_defaults = True {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] oslo_policy.policy_default_rule = default {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] oslo_policy.policy_file = policy.yaml {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] privsep_osbrick.group = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] privsep_osbrick.helper_command = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] privsep_osbrick.user = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] cinder_sys_admin.group = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] cinder_sys_admin.helper_command = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] cinder_sys_admin.user = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] service_user.auth_section = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] service_user.auth_type = password {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] service_user.cafile = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] service_user.certfile = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] service_user.collect_timing = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] service_user.insecure = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] service_user.keyfile = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] service_user.send_service_user_token = True {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] service_user.split_loggers = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] service_user.timeout = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] service_user.tls_ciphers = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] service_user.tls_min_version = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] glance.auth_section = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] glance.auth_type = password {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] glance.certfile = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] glance.collect_timing = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] glance.insecure = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] glance.keyfile = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] glance.region_name = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] glance.split_loggers = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] glance.timeout = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] glance.tls_ciphers = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] glance.tls_min_version = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_defaults.backend_availability_zone = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_defaults.chap_password = **** {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_defaults.chap_username = {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_defaults.disk_geometry = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_defaults.driver_client_cert = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_defaults.driver_client_cert_key = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_defaults.driver_data_namespace = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_defaults.driver_use_ssl = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_defaults.extra_capabilities = {} {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_defaults.filter_function = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_defaults.goodness_function = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_defaults.iscsi_target_flags = {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_defaults.iscsi_write_cache = on {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_defaults.iser_helper = tgtadm {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_defaults.iser_ip_address = 192.168.122.58 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_defaults.iser_port = 3260 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_defaults.nas_host = {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_defaults.nas_login = admin {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_defaults.nas_mount_options = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_defaults.nas_password = **** {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_defaults.nas_private_key = {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_defaults.nas_share_path = {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack quobyte-client[87016]: Reading configuration file: /etc/quobyte/client.cfg Sep 25 11:36:10 devstack quobyte-client[87016]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_defaults.num_shell_tries = 3 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-4ef2f0ea-5cc1-4375-b411-a09f94e575a7 None None] CMD "mount.quobyte" returned: 1 in 0.124s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-4ef2f0ea-5cc1-4375-b411-a09f94e575a7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-4ef2f0ea-5cc1-4375-b411-a09f94e575a7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:36:10 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-4ef2f0ea-5cc1-4375-b411-a09f94e575a7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_defaults.quobyte_volume_url = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_defaults.replication_device = **** {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_defaults.report_discard_supported = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_defaults.reserved_percentage = 0 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_defaults.target_helper = tgtadm {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_defaults.target_ip_address = 192.168.122.58 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_defaults.target_port = 3260 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-4ef2f0ea-5cc1-4375-b411-a09f94e575a7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-4ef2f0ea-5cc1-4375-b411-a09f94e575a7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:36:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-4ef2f0ea-5cc1-4375-b411-a09f94e575a7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_defaults.target_protocol = iscsi {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_defaults.trace_flags = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_defaults.unique_fqdn_network = True {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_defaults.use_chap_auth = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_defaults.volume_backend_name = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_defaults.volume_clear = zero {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_defaults.volume_clear_ionice = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_defaults.volume_clear_size = 0 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] oslo_reports.file_event_handler = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] oslo_reports.log_dir = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] QuobyteHD.backend_availability_zone = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] QuobyteHD.backend_host = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] QuobyteHD.chap_password = **** {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] QuobyteHD.chap_username = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] QuobyteHD.chiscsi_conf = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] QuobyteHD.disk_geometry = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] QuobyteHD.driver_client_cert = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] QuobyteHD.driver_data_namespace = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] QuobyteHD.driver_use_ssl = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] QuobyteHD.extra_capabilities = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] QuobyteHD.filter_function = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] QuobyteHD.goodness_function = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack sudo[87026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] QuobyteHD.iser_helper = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] QuobyteHD.iser_ip_address = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] QuobyteHD.iser_port = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] QuobyteHD.iser_target_prefix = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack sudo[87026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] QuobyteHD.nas_host = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] QuobyteHD.nas_login = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] QuobyteHD.nas_mount_options = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] QuobyteHD.nas_password = **** {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] QuobyteHD.nas_private_key = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] QuobyteHD.nas_share_path = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] QuobyteHD.nas_ssh_port = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] QuobyteHD.num_shell_tries = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] QuobyteHD.nvmet_port_id = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] QuobyteHD.replication_device = **** {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] QuobyteHD.report_discard_supported = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] QuobyteHD.reserved_percentage = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] QuobyteHD.scst_target_driver = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] QuobyteHD.storage_protocol = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] QuobyteHD.target_helper = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] QuobyteHD.target_ip_address = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] QuobyteHD.target_port = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] QuobyteHD.target_prefix = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] QuobyteHD.target_protocol = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] QuobyteHD.trace_flags = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] QuobyteHD.use_chap_auth = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] QuobyteHD.volume_clear = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] QuobyteHD.volume_clear_size = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] QuobyteHD.volumes_dir = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:10 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:11 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:11 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:11 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:11 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:11 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:11 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:11 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:11 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] oslo_messaging_rabbit.ssl = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:11 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:11 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:11 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:11 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:11 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:11 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:11 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:11 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] oslo_messaging_notifications.driver = [] {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:11 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] oslo_messaging_notifications.retry = -1 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:11 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:11 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:11 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:11 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] key_manager.fixed_key = **** {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:11 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:11 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] barbican.barbican_api_version = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:11 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] barbican.barbican_endpoint = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:11 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] barbican.barbican_endpoint_type = public {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:11 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] barbican.barbican_region_name = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:11 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] barbican.cafile = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:11 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] barbican.certfile = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:11 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] barbican.collect_timing = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:11 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] barbican.insecure = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:11 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] barbican.keyfile = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:11 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] barbican.number_of_retries = 60 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:11 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] barbican.retry_delay = 1 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:11 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] barbican.send_service_user_token = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:11 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] barbican.split_loggers = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:11 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] barbican.timeout = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:11 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] barbican.tls_ciphers = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:11 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] barbican.tls_min_version = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:11 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] barbican.verify_ssl = True {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:11 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] barbican.verify_ssl_path = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:11 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] barbican_service_user.auth_section = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:11 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] barbican_service_user.auth_type = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:11 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] barbican_service_user.cafile = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:11 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] barbican_service_user.certfile = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:11 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] barbican_service_user.collect_timing = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:11 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] barbican_service_user.insecure = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:11 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] barbican_service_user.keyfile = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:11 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] barbican_service_user.split_loggers = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:11 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] barbican_service_user.timeout = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:11 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] barbican_service_user.tls_ciphers = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:11 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] barbican_service_user.tls_min_version = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:11 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] vault.approle_role_id = **** {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:11 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] vault.approle_secret_id = **** {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:11 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] vault.auth_method = approle {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:11 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] vault.auth_path = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:11 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] vault.kv_mountpoint = secret {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:11 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] vault.kv_path = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:11 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] vault.kv_version = 2 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:11 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] vault.namespace = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:11 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] vault.root_token_id = **** {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:11 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] vault.ssl_ca_crt_file = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:11 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] vault.timeout = 60.0 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:11 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] vault.token_file = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:11 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] vault.token_role = None {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:11 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] vault.use_ssl = False {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:11 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 11:36:11 devstack cinder-volume[86784]: DEBUG oslo_service.backend._eventlet.service [None req-209a392f-6a39-46e9-aae0-d8dd8be305d3 None None] ******************************************************************************** {{(pid=86784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 25 11:36:11 devstack sudo[87026]: pam_unix(sudo:session): session closed for user root Sep 25 11:36:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-4ef2f0ea-5cc1-4375-b411-a09f94e575a7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.510s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:36:11 devstack cinder-volume[86984]: INFO cinder.volume.driver [None req-4ef2f0ea-5cc1-4375-b411-a09f94e575a7 None None] Driver hasn't implemented _init_vendor_properties() Sep 25 11:36:11 devstack cinder-volume[86984]: DEBUG cinder.volume.driver [None req-4ef2f0ea-5cc1-4375-b411-a09f94e575a7 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.4309730529785, 'free_capacity_gb': 1775.4309730529785, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86984) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 25 11:36:11 devstack cinder-volume[86984]: DEBUG oslo_db.sqlalchemy.engines [None req-4ef2f0ea-5cc1-4375-b411-a09f94e575a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86984) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 11:36:11 devstack cinder-volume[86984]: DEBUG dbcounter [-] [86984] Writer thread running {{(pid=86984) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 11:36:11 devstack cinder-volume[86984]: DEBUG cinder.db.api [None req-4ef2f0ea-5cc1-4375-b411-a09f94e575a7 None None] Building query based on filter {{(pid=86984) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 25 11:36:11 devstack cinder-volume[86984]: DEBUG cinder.image.image_utils [None req-4ef2f0ea-5cc1-4375-b411-a09f94e575a7 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86984) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 25 11:36:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-4ef2f0ea-5cc1-4375-b411-a09f94e575a7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:36:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-4ef2f0ea-5cc1-4375-b411-a09f94e575a7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:36:11 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-4ef2f0ea-5cc1-4375-b411-a09f94e575a7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:36:11 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-4ef2f0ea-5cc1-4375-b411-a09f94e575a7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:36:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-4ef2f0ea-5cc1-4375-b411-a09f94e575a7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:36:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-4ef2f0ea-5cc1-4375-b411-a09f94e575a7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:36:11 devstack cinder-volume[86984]: INFO cinder.keymgr.migration [None req-cae4c1c5-0808-4ff2-94fa-a8f23a077960 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 25 11:36:11 devstack sudo[87059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:36:11 devstack sudo[87059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:36:11 devstack sudo[87059]: pam_unix(sudo:session): session closed for user root Sep 25 11:36:12 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-4ef2f0ea-5cc1-4375-b411-a09f94e575a7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.422s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:36:12 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-4ef2f0ea-5cc1-4375-b411-a09f94e575a7 None None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:36:12 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-4ef2f0ea-5cc1-4375-b411-a09f94e575a7 None None] Driver initialization completed successfully. Sep 25 11:36:12 devstack cinder-volume[86984]: INFO cinder.manager [None req-4ef2f0ea-5cc1-4375-b411-a09f94e575a7 None None] Initiating service 3 cleanup Sep 25 11:36:12 devstack cinder-volume[86984]: INFO cinder.manager [None req-4ef2f0ea-5cc1-4375-b411-a09f94e575a7 None None] Service 3 cleanup completed. Sep 25 11:36:12 devstack cinder-volume[86984]: DEBUG cinder.service [None req-4ef2f0ea-5cc1-4375-b411-a09f94e575a7 None None] Creating RPC server for service cinder-volume {{(pid=86984) start /opt/stack/cinder/cinder/service.py:231}} Sep 25 11:36:12 devstack cinder-volume[86984]: DEBUG cinder.service [None req-4ef2f0ea-5cc1-4375-b411-a09f94e575a7 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86984) start /opt/stack/cinder/cinder/service.py:237}} Sep 25 11:36:12 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-4ef2f0ea-5cc1-4375-b411-a09f94e575a7 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 25 11:36:12 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-4ef2f0ea-5cc1-4375-b411-a09f94e575a7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:36:12 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-4ef2f0ea-5cc1-4375-b411-a09f94e575a7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:36:12 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-4ef2f0ea-5cc1-4375-b411-a09f94e575a7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:36:12 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-4ef2f0ea-5cc1-4375-b411-a09f94e575a7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:36:12 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-4ef2f0ea-5cc1-4375-b411-a09f94e575a7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:36:12 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-4ef2f0ea-5cc1-4375-b411-a09f94e575a7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:36:12 devstack sudo[87076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:36:12 devstack sudo[87076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:36:12 devstack sudo[87076]: pam_unix(sudo:session): session closed for user root Sep 25 11:36:12 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-4ef2f0ea-5cc1-4375-b411-a09f94e575a7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.367s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:36:12 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-4ef2f0ea-5cc1-4375-b411-a09f94e575a7 None None] Driver post RPC initialization completed successfully. Sep 25 11:36:20 devstack cinder-volume[86784]: DEBUG dbcounter [-] [86784] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86784) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:36:22 devstack cinder-volume[86984]: DEBUG dbcounter [-] [86984] Writing DB stats cinder:SELECT=2 {{(pid=86984) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:36:22 devstack cinder-volume[86984]: DEBUG dbcounter [-] [86984] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86984) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:36:38 devstack cinder-volume[86984]: DEBUG oslo_service.periodic_task [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running periodic task VolumeManager._thread_info {{(pid=86984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:36:38 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] thread count: 6 {{(pid=86984) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 11:36:38 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] thread info: [<_MainThread(MainThread, started 132046492332160)>, , , , , ] {{(pid=86984) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 11:37:38 devstack cinder-volume[86984]: DEBUG oslo_service.periodic_task [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:37:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:37:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:37:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:37:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:37:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:37:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:37:38 devstack sudo[87906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:37:38 devstack sudo[87906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:37:39 devstack sudo[87906]: pam_unix(sudo:session): session closed for user root Sep 25 11:37:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.928s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:37:39 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:37:39 devstack cinder-volume[86984]: DEBUG oslo_service.periodic_task [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running periodic task VolumeManager._thread_info {{(pid=86984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:37:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] thread count: 6 {{(pid=86984) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 11:37:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] thread info: [<_MainThread(MainThread, started 132046492332160)>, , , , , ] {{(pid=86984) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 11:38:06 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf8974ca-2006-45bc-bcb3-c5d92b48e594 tempest-ServerRescueNegativeTestJSON-1291576593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:38:06 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cf8974ca-2006-45bc-bcb3-c5d92b48e594 tempest-ServerRescueNegativeTestJSON-1291576593 None] Flow 'volume_create_manager' (02e6eadf-e47e-4e12-8d01-079de8c704d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:38:06 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cf8974ca-2006-45bc-bcb3-c5d92b48e594 tempest-ServerRescueNegativeTestJSON-1291576593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e5cb3d8-f11e-42ed-b6e4-007163d81f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:38:07 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cf8974ca-2006-45bc-bcb3-c5d92b48e594 tempest-ServerRescueNegativeTestJSON-1291576593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e5cb3d8-f11e-42ed-b6e4-007163d81f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:38:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2034415789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c3cea36-3a37-40f7-9262-f48d49e7c111,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='782d6fbc36864b4081cbcedcb4f96c4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:38:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:38:07Z,use_quota=True,user_id='899a70c2cde44840be87e25306af8252',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:38:07 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cf8974ca-2006-45bc-bcb3-c5d92b48e594 tempest-ServerRescueNegativeTestJSON-1291576593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cef86bcb-1468-491f-b557-f48eb08331b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:38:07 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cf8974ca-2006-45bc-bcb3-c5d92b48e594 tempest-ServerRescueNegativeTestJSON-1291576593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cef86bcb-1468-491f-b557-f48eb08331b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:38:07 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cf8974ca-2006-45bc-bcb3-c5d92b48e594 tempest-ServerRescueNegativeTestJSON-1291576593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1f81224-77b9-4e8b-835b-ae4a968205da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:38:07 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cf8974ca-2006-45bc-bcb3-c5d92b48e594 tempest-ServerRescueNegativeTestJSON-1291576593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1f81224-77b9-4e8b-835b-ae4a968205da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c3cea36-3a37-40f7-9262-f48d49e7c111', 'volume_name': 'volume-9c3cea36-3a37-40f7-9262-f48d49e7c111', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:38:07 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cf8974ca-2006-45bc-bcb3-c5d92b48e594 tempest-ServerRescueNegativeTestJSON-1291576593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ccfdd92-d3ea-4de5-b3ff-c5e4b2f636cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:38:07 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cf8974ca-2006-45bc-bcb3-c5d92b48e594 tempest-ServerRescueNegativeTestJSON-1291576593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ccfdd92-d3ea-4de5-b3ff-c5e4b2f636cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:38:07 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cf8974ca-2006-45bc-bcb3-c5d92b48e594 tempest-ServerRescueNegativeTestJSON-1291576593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3f91c09-0096-4a9a-a790-f5a722505d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:38:07 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-cf8974ca-2006-45bc-bcb3-c5d92b48e594 tempest-ServerRescueNegativeTestJSON-1291576593 None] Volume 9c3cea36-3a37-40f7-9262-f48d49e7c111: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c3cea36-3a37-40f7-9262-f48d49e7c111', 'volume_size': 1} Sep 25 11:38:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-cf8974ca-2006-45bc-bcb3-c5d92b48e594 tempest-ServerRescueNegativeTestJSON-1291576593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:38:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-cf8974ca-2006-45bc-bcb3-c5d92b48e594 tempest-ServerRescueNegativeTestJSON-1291576593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:38:07 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-cf8974ca-2006-45bc-bcb3-c5d92b48e594 tempest-ServerRescueNegativeTestJSON-1291576593 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:38:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2034415789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c3cea36-3a37-40f7-9262-f48d49e7c111,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='782d6fbc36864b4081cbcedcb4f96c4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:38:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:38:07Z,use_quota=True,user_id='899a70c2cde44840be87e25306af8252',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:38:07 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-cf8974ca-2006-45bc-bcb3-c5d92b48e594 tempest-ServerRescueNegativeTestJSON-1291576593 None] Creating volume 9c3cea36-3a37-40f7-9262-f48d49e7c111 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:38:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-cf8974ca-2006-45bc-bcb3-c5d92b48e594 tempest-ServerRescueNegativeTestJSON-1291576593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:38:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-cf8974ca-2006-45bc-bcb3-c5d92b48e594 tempest-ServerRescueNegativeTestJSON-1291576593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:38:07 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-cf8974ca-2006-45bc-bcb3-c5d92b48e594 tempest-ServerRescueNegativeTestJSON-1291576593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:38:07 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-cf8974ca-2006-45bc-bcb3-c5d92b48e594 tempest-ServerRescueNegativeTestJSON-1291576593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:38:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-cf8974ca-2006-45bc-bcb3-c5d92b48e594 tempest-ServerRescueNegativeTestJSON-1291576593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:38:07 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-cf8974ca-2006-45bc-bcb3-c5d92b48e594 tempest-ServerRescueNegativeTestJSON-1291576593 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:38:07 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-cf8974ca-2006-45bc-bcb3-c5d92b48e594 tempest-ServerRescueNegativeTestJSON-1291576593 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:38:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cf8974ca-2006-45bc-bcb3-c5d92b48e594 tempest-ServerRescueNegativeTestJSON-1291576593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9c3cea36-3a37-40f7-9262-f48d49e7c111 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:38:07 devstack sudo[88225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9c3cea36-3a37-40f7-9262-f48d49e7c111 1073741824 Sep 25 11:38:07 devstack sudo[88225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:38:08 devstack sudo[88225]: pam_unix(sudo:session): session closed for user root Sep 25 11:38:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cf8974ca-2006-45bc-bcb3-c5d92b48e594 tempest-ServerRescueNegativeTestJSON-1291576593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9c3cea36-3a37-40f7-9262-f48d49e7c111 1073741824" returned: 0 in 1.514s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:38:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cf8974ca-2006-45bc-bcb3-c5d92b48e594 tempest-ServerRescueNegativeTestJSON-1291576593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9c3cea36-3a37-40f7-9262-f48d49e7c111 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:38:08 devstack sudo[88545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9c3cea36-3a37-40f7-9262-f48d49e7c111 Sep 25 11:38:08 devstack sudo[88545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:38:09 devstack sudo[88545]: pam_unix(sudo:session): session closed for user root Sep 25 11:38:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cf8974ca-2006-45bc-bcb3-c5d92b48e594 tempest-ServerRescueNegativeTestJSON-1291576593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9c3cea36-3a37-40f7-9262-f48d49e7c111" returned: 0 in 0.676s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:38:09 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-cf8974ca-2006-45bc-bcb3-c5d92b48e594 tempest-ServerRescueNegativeTestJSON-1291576593 None] <== create_volume: return (2389ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:38:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-cf8974ca-2006-45bc-bcb3-c5d92b48e594 tempest-ServerRescueNegativeTestJSON-1291576593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.400s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:38:09 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cf8974ca-2006-45bc-bcb3-c5d92b48e594 tempest-ServerRescueNegativeTestJSON-1291576593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3f91c09-0096-4a9a-a790-f5a722505d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c3cea36-3a37-40f7-9262-f48d49e7c111', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:38:09 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cf8974ca-2006-45bc-bcb3-c5d92b48e594 tempest-ServerRescueNegativeTestJSON-1291576593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8c08186-99c4-4425-93f7-b525fabc0d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:38:09 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-cf8974ca-2006-45bc-bcb3-c5d92b48e594 tempest-ServerRescueNegativeTestJSON-1291576593 None] Volume volume-9c3cea36-3a37-40f7-9262-f48d49e7c111 (9c3cea36-3a37-40f7-9262-f48d49e7c111): created successfully Sep 25 11:38:09 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cf8974ca-2006-45bc-bcb3-c5d92b48e594 tempest-ServerRescueNegativeTestJSON-1291576593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8c08186-99c4-4425-93f7-b525fabc0d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:38:09 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cf8974ca-2006-45bc-bcb3-c5d92b48e594 tempest-ServerRescueNegativeTestJSON-1291576593 None] Flow 'volume_create_manager' (02e6eadf-e47e-4e12-8d01-079de8c704d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:38:09 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-cf8974ca-2006-45bc-bcb3-c5d92b48e594 tempest-ServerRescueNegativeTestJSON-1291576593 None] Created volume successfully. Sep 25 11:38:13 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dbb755f-f6d0-431f-af4d-c3daa74227e6 tempest-VolumesAdminNegativeTest-2132198365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:38:13 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6dbb755f-f6d0-431f-af4d-c3daa74227e6 tempest-VolumesAdminNegativeTest-2132198365 None] Flow 'volume_create_manager' (72c329a5-735c-4075-946d-1099515f93a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:38:13 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6dbb755f-f6d0-431f-af4d-c3daa74227e6 tempest-VolumesAdminNegativeTest-2132198365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dee5e305-eefa-48bb-ba1a-8c694d8d9fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:38:13 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6dbb755f-f6d0-431f-af4d-c3daa74227e6 tempest-VolumesAdminNegativeTest-2132198365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dee5e305-eefa-48bb-ba1a-8c694d8d9fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:38:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1098588842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=075561ca-fd29-43ef-b849-c2b3b29b5cdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='072955e37acc460b97e548a8d710b783',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:38:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:38:13Z,use_quota=True,user_id='d0a710e048b841a9ad0c49bab2c626ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:38:13 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6dbb755f-f6d0-431f-af4d-c3daa74227e6 tempest-VolumesAdminNegativeTest-2132198365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a584d01-81cc-41ca-9924-510ec2cdc099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:38:13 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6dbb755f-f6d0-431f-af4d-c3daa74227e6 tempest-VolumesAdminNegativeTest-2132198365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a584d01-81cc-41ca-9924-510ec2cdc099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:38:13 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6dbb755f-f6d0-431f-af4d-c3daa74227e6 tempest-VolumesAdminNegativeTest-2132198365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c69d3edb-9bf4-4d8a-8f0f-48cba28aadb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:38:13 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6dbb755f-f6d0-431f-af4d-c3daa74227e6 tempest-VolumesAdminNegativeTest-2132198365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c69d3edb-9bf4-4d8a-8f0f-48cba28aadb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '075561ca-fd29-43ef-b849-c2b3b29b5cdb', 'volume_name': 'volume-075561ca-fd29-43ef-b849-c2b3b29b5cdb', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:38:13 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6dbb755f-f6d0-431f-af4d-c3daa74227e6 tempest-VolumesAdminNegativeTest-2132198365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (615f8ad3-1c8d-4355-83bc-12008dc883fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:38:13 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6dbb755f-f6d0-431f-af4d-c3daa74227e6 tempest-VolumesAdminNegativeTest-2132198365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (615f8ad3-1c8d-4355-83bc-12008dc883fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:38:13 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6dbb755f-f6d0-431f-af4d-c3daa74227e6 tempest-VolumesAdminNegativeTest-2132198365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e76eafb-ca11-4220-852a-a761e629b294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:38:13 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-6dbb755f-f6d0-431f-af4d-c3daa74227e6 tempest-VolumesAdminNegativeTest-2132198365 None] Volume 075561ca-fd29-43ef-b849-c2b3b29b5cdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-075561ca-fd29-43ef-b849-c2b3b29b5cdb', 'volume_size': 1} Sep 25 11:38:13 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-6dbb755f-f6d0-431f-af4d-c3daa74227e6 tempest-VolumesAdminNegativeTest-2132198365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:38:13 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-6dbb755f-f6d0-431f-af4d-c3daa74227e6 tempest-VolumesAdminNegativeTest-2132198365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:38:13 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-6dbb755f-f6d0-431f-af4d-c3daa74227e6 tempest-VolumesAdminNegativeTest-2132198365 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:38:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1098588842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=075561ca-fd29-43ef-b849-c2b3b29b5cdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='072955e37acc460b97e548a8d710b783',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:38:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:38:13Z,use_quota=True,user_id='d0a710e048b841a9ad0c49bab2c626ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:38:13 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-6dbb755f-f6d0-431f-af4d-c3daa74227e6 tempest-VolumesAdminNegativeTest-2132198365 None] Creating volume 075561ca-fd29-43ef-b849-c2b3b29b5cdb {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:38:13 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-6dbb755f-f6d0-431f-af4d-c3daa74227e6 tempest-VolumesAdminNegativeTest-2132198365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:38:13 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-6dbb755f-f6d0-431f-af4d-c3daa74227e6 tempest-VolumesAdminNegativeTest-2132198365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:38:13 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-6dbb755f-f6d0-431f-af4d-c3daa74227e6 tempest-VolumesAdminNegativeTest-2132198365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:38:13 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-6dbb755f-f6d0-431f-af4d-c3daa74227e6 tempest-VolumesAdminNegativeTest-2132198365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:38:13 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-6dbb755f-f6d0-431f-af4d-c3daa74227e6 tempest-VolumesAdminNegativeTest-2132198365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:38:13 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-6dbb755f-f6d0-431f-af4d-c3daa74227e6 tempest-VolumesAdminNegativeTest-2132198365 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:38:13 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-6dbb755f-f6d0-431f-af4d-c3daa74227e6 tempest-VolumesAdminNegativeTest-2132198365 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:38:13 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6dbb755f-f6d0-431f-af4d-c3daa74227e6 tempest-VolumesAdminNegativeTest-2132198365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-075561ca-fd29-43ef-b849-c2b3b29b5cdb 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:38:13 devstack sudo[88609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-075561ca-fd29-43ef-b849-c2b3b29b5cdb 1073741824 Sep 25 11:38:13 devstack sudo[88609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:38:15 devstack sudo[88609]: pam_unix(sudo:session): session closed for user root Sep 25 11:38:15 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6dbb755f-f6d0-431f-af4d-c3daa74227e6 tempest-VolumesAdminNegativeTest-2132198365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-075561ca-fd29-43ef-b849-c2b3b29b5cdb 1073741824" returned: 0 in 1.524s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:38:15 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6dbb755f-f6d0-431f-af4d-c3daa74227e6 tempest-VolumesAdminNegativeTest-2132198365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-075561ca-fd29-43ef-b849-c2b3b29b5cdb {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:38:15 devstack sudo[88628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-075561ca-fd29-43ef-b849-c2b3b29b5cdb Sep 25 11:38:15 devstack sudo[88628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:38:16 devstack sudo[88628]: pam_unix(sudo:session): session closed for user root Sep 25 11:38:16 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6dbb755f-f6d0-431f-af4d-c3daa74227e6 tempest-VolumesAdminNegativeTest-2132198365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-075561ca-fd29-43ef-b849-c2b3b29b5cdb" returned: 0 in 0.912s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:38:16 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-6dbb755f-f6d0-431f-af4d-c3daa74227e6 tempest-VolumesAdminNegativeTest-2132198365 None] <== create_volume: return (2601ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:38:16 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-6dbb755f-f6d0-431f-af4d-c3daa74227e6 tempest-VolumesAdminNegativeTest-2132198365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.604s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:38:16 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6dbb755f-f6d0-431f-af4d-c3daa74227e6 tempest-VolumesAdminNegativeTest-2132198365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e76eafb-ca11-4220-852a-a761e629b294) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-075561ca-fd29-43ef-b849-c2b3b29b5cdb', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:38:16 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6dbb755f-f6d0-431f-af4d-c3daa74227e6 tempest-VolumesAdminNegativeTest-2132198365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d348c6e-f95b-4cd9-b07d-d53b449059d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:38:16 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-6dbb755f-f6d0-431f-af4d-c3daa74227e6 tempest-VolumesAdminNegativeTest-2132198365 None] Volume volume-075561ca-fd29-43ef-b849-c2b3b29b5cdb (075561ca-fd29-43ef-b849-c2b3b29b5cdb): created successfully Sep 25 11:38:16 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6dbb755f-f6d0-431f-af4d-c3daa74227e6 tempest-VolumesAdminNegativeTest-2132198365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d348c6e-f95b-4cd9-b07d-d53b449059d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:38:16 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6dbb755f-f6d0-431f-af4d-c3daa74227e6 tempest-VolumesAdminNegativeTest-2132198365 None] Flow 'volume_create_manager' (72c329a5-735c-4075-946d-1099515f93a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:38:16 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-6dbb755f-f6d0-431f-af4d-c3daa74227e6 tempest-VolumesAdminNegativeTest-2132198365 None] Created volume successfully. Sep 25 11:38:18 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-5af6a293-7161-41f7-95e3-545ae7f5a399 tempest-VolumesAdminNegativeTest-2132198365 None] Acquiring lock "cinder-075561ca-fd29-43ef-b849-c2b3b29b5cdb-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:38:18 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-5af6a293-7161-41f7-95e3-545ae7f5a399 tempest-VolumesAdminNegativeTest-2132198365 None] Lock "cinder-075561ca-fd29-43ef-b849-c2b3b29b5cdb-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:38:18 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-5af6a293-7161-41f7-95e3-545ae7f5a399 tempest-VolumesAdminNegativeTest-2132198365 None] Acquiring lock "cinder-quobyte-075561ca-fd29-43ef-b849-c2b3b29b5cdb" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:38:18 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-5af6a293-7161-41f7-95e3-545ae7f5a399 tempest-VolumesAdminNegativeTest-2132198365 None] Lock "cinder-quobyte-075561ca-fd29-43ef-b849-c2b3b29b5cdb" acquired by "delete_volume" :: waited 0.055s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:38:18 devstack cinder-volume[86984]: INFO oslo.privsep.daemon [None req-5af6a293-7161-41f7-95e3-545ae7f5a399 tempest-VolumesAdminNegativeTest-2132198365 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpxtmysc2u/privsep.sock'] Sep 25 11:38:18 devstack sudo[88699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpxtmysc2u/privsep.sock Sep 25 11:38:18 devstack sudo[88699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:38:21 devstack cinder-volume[86984]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 25 11:38:21 devstack cinder-volume[86984]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 25 11:38:21 devstack cinder-volume[86984]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 25 11:38:21 devstack cinder-volume[86984]: WARNING oslo.privsep.daemon [-] privsep log: Sep 25 11:38:21 devstack cinder-volume[86984]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 25 11:38:21 devstack cinder-volume[86984]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 25 11:38:21 devstack cinder-volume[86984]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 25 11:38:21 devstack cinder-volume[86984]: WARNING oslo.privsep.daemon [-] privsep log: Sep 25 11:38:21 devstack cinder-volume[86984]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 25 11:38:21 devstack sudo[88699]: pam_unix(sudo:session): session closed for user root Sep 25 11:38:21 devstack cinder-volume[86984]: INFO oslo.privsep.daemon [None req-5af6a293-7161-41f7-95e3-545ae7f5a399 tempest-VolumesAdminNegativeTest-2132198365 None] Spawned new privsep daemon via rootwrap Sep 25 11:38:21 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [None req-5af6a293-7161-41f7-95e3-545ae7f5a399 tempest-VolumesAdminNegativeTest-2132198365 None] Accepted privsep connection to /tmp/tmpxtmysc2u/privsep.sock {{(pid=86984) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 25 11:38:21 devstack cinder-volume[86984]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 25 11:38:21 devstack cinder-volume[86984]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 25 11:38:21 devstack cinder-volume[86984]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 25 11:38:21 devstack cinder-volume[86984]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88733 Sep 25 11:38:21 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[58244bcf-b3ef-42f0-b73a-96235b94a7f9]: (2,) {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:38:21 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[305be56b-1567-4981-8109-aa13a28566db]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:38:21 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-5af6a293-7161-41f7-95e3-545ae7f5a399 tempest-VolumesAdminNegativeTest-2132198365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-075561ca-fd29-43ef-b849-c2b3b29b5cdb {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:38:21 devstack sudo[88735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-075561ca-fd29-43ef-b849-c2b3b29b5cdb Sep 25 11:38:21 devstack sudo[88735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:38:23 devstack sudo[88735]: pam_unix(sudo:session): session closed for user root Sep 25 11:38:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-5af6a293-7161-41f7-95e3-545ae7f5a399 tempest-VolumesAdminNegativeTest-2132198365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-075561ca-fd29-43ef-b849-c2b3b29b5cdb" returned: 0 in 1.573s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:38:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-5af6a293-7161-41f7-95e3-545ae7f5a399 tempest-VolumesAdminNegativeTest-2132198365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-075561ca-fd29-43ef-b849-c2b3b29b5cdb {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:38:23 devstack sudo[88743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-075561ca-fd29-43ef-b849-c2b3b29b5cdb Sep 25 11:38:23 devstack sudo[88743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:38:23 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0dfe4ce-7d00-4108-b137-d51f95c144c6 tempest-ServersNegativeTestJSON-921106034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:38:23 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-c0dfe4ce-7d00-4108-b137-d51f95c144c6 tempest-ServersNegativeTestJSON-921106034 None] Flow 'volume_create_manager' (afb50ac8-5845-4e0a-9f09-6029cb29f316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:38:23 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-c0dfe4ce-7d00-4108-b137-d51f95c144c6 tempest-ServersNegativeTestJSON-921106034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (961dc7a7-4602-4fc9-bad6-894301f1c937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:38:23 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-c0dfe4ce-7d00-4108-b137-d51f95c144c6 tempest-ServersNegativeTestJSON-921106034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (961dc7a7-4602-4fc9-bad6-894301f1c937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:38:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-494850436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5e24a77-08ed-4cc2-b5b8-9119edf0dacd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b489e845a7e3439b87222311f0111c9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:38:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:38:23Z,use_quota=True,user_id='1febdbc466454325b35920f55034fc52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:38:23 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-c0dfe4ce-7d00-4108-b137-d51f95c144c6 tempest-ServersNegativeTestJSON-921106034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77c692bf-3a0a-433f-8264-7f5d157154d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:38:23 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-c0dfe4ce-7d00-4108-b137-d51f95c144c6 tempest-ServersNegativeTestJSON-921106034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77c692bf-3a0a-433f-8264-7f5d157154d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:38:23 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-c0dfe4ce-7d00-4108-b137-d51f95c144c6 tempest-ServersNegativeTestJSON-921106034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9996d2f4-1c01-41a8-98c2-207a6bdbe62e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:38:23 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-c0dfe4ce-7d00-4108-b137-d51f95c144c6 tempest-ServersNegativeTestJSON-921106034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9996d2f4-1c01-41a8-98c2-207a6bdbe62e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5e24a77-08ed-4cc2-b5b8-9119edf0dacd', 'volume_name': 'volume-c5e24a77-08ed-4cc2-b5b8-9119edf0dacd', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:38:23 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-c0dfe4ce-7d00-4108-b137-d51f95c144c6 tempest-ServersNegativeTestJSON-921106034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (144013d3-e4af-47ea-9839-8d13a1887623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:38:23 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-c0dfe4ce-7d00-4108-b137-d51f95c144c6 tempest-ServersNegativeTestJSON-921106034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (144013d3-e4af-47ea-9839-8d13a1887623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:38:23 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-c0dfe4ce-7d00-4108-b137-d51f95c144c6 tempest-ServersNegativeTestJSON-921106034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d177f348-04e8-454d-bf18-160fce1f5349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:38:23 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-c0dfe4ce-7d00-4108-b137-d51f95c144c6 tempest-ServersNegativeTestJSON-921106034 None] Volume c5e24a77-08ed-4cc2-b5b8-9119edf0dacd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5e24a77-08ed-4cc2-b5b8-9119edf0dacd', 'volume_size': 1} Sep 25 11:38:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-c0dfe4ce-7d00-4108-b137-d51f95c144c6 tempest-ServersNegativeTestJSON-921106034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:38:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-c0dfe4ce-7d00-4108-b137-d51f95c144c6 tempest-ServersNegativeTestJSON-921106034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:38:23 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-c0dfe4ce-7d00-4108-b137-d51f95c144c6 tempest-ServersNegativeTestJSON-921106034 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:38:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-494850436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5e24a77-08ed-4cc2-b5b8-9119edf0dacd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b489e845a7e3439b87222311f0111c9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:38:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:38:23Z,use_quota=True,user_id='1febdbc466454325b35920f55034fc52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:38:23 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-c0dfe4ce-7d00-4108-b137-d51f95c144c6 tempest-ServersNegativeTestJSON-921106034 None] Creating volume c5e24a77-08ed-4cc2-b5b8-9119edf0dacd {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:38:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-c0dfe4ce-7d00-4108-b137-d51f95c144c6 tempest-ServersNegativeTestJSON-921106034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:38:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-c0dfe4ce-7d00-4108-b137-d51f95c144c6 tempest-ServersNegativeTestJSON-921106034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:38:23 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-c0dfe4ce-7d00-4108-b137-d51f95c144c6 tempest-ServersNegativeTestJSON-921106034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:38:23 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-c0dfe4ce-7d00-4108-b137-d51f95c144c6 tempest-ServersNegativeTestJSON-921106034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:38:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-c0dfe4ce-7d00-4108-b137-d51f95c144c6 tempest-ServersNegativeTestJSON-921106034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:38:23 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-c0dfe4ce-7d00-4108-b137-d51f95c144c6 tempest-ServersNegativeTestJSON-921106034 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:38:23 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-c0dfe4ce-7d00-4108-b137-d51f95c144c6 tempest-ServersNegativeTestJSON-921106034 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:38:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-c0dfe4ce-7d00-4108-b137-d51f95c144c6 tempest-ServersNegativeTestJSON-921106034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c5e24a77-08ed-4cc2-b5b8-9119edf0dacd 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:38:23 devstack sudo[88745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c5e24a77-08ed-4cc2-b5b8-9119edf0dacd 1073741824 Sep 25 11:38:23 devstack sudo[88745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:38:23 devstack sudo[88743]: pam_unix(sudo:session): session closed for user root Sep 25 11:38:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-5af6a293-7161-41f7-95e3-545ae7f5a399 tempest-VolumesAdminNegativeTest-2132198365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-075561ca-fd29-43ef-b849-c2b3b29b5cdb" returned: 0 in 0.759s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:38:24 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-5af6a293-7161-41f7-95e3-545ae7f5a399 tempest-VolumesAdminNegativeTest-2132198365 None] Lock "cinder-quobyte-075561ca-fd29-43ef-b849-c2b3b29b5cdb" released by "delete_volume" :: held 5.448s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:38:24 devstack cinder-volume[86984]: WARNING cinder.quota [None req-5af6a293-7161-41f7-95e3-545ae7f5a399 tempest-VolumesAdminNegativeTest-2132198365 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 25 11:38:24 devstack cinder-volume[86984]: WARNING cinder.quota [None req-5af6a293-7161-41f7-95e3-545ae7f5a399 tempest-VolumesAdminNegativeTest-2132198365 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 25 11:38:24 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-5af6a293-7161-41f7-95e3-545ae7f5a399 tempest-VolumesAdminNegativeTest-2132198365 None] Created reservations ['6463af2f-8147-4b89-97a4-0bc4671bd8e0', '8c65e651-6b80-473f-b6f3-ee025581cd19', '1bd1b833-d1a8-4691-994b-463db1a7934d', 'df84f5f4-8aad-4de4-81d2-f4047268e086'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:38:24 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-5af6a293-7161-41f7-95e3-545ae7f5a399 tempest-VolumesAdminNegativeTest-2132198365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:38:24 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-5af6a293-7161-41f7-95e3-545ae7f5a399 tempest-VolumesAdminNegativeTest-2132198365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:38:24 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-5af6a293-7161-41f7-95e3-545ae7f5a399 tempest-VolumesAdminNegativeTest-2132198365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:38:24 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-5af6a293-7161-41f7-95e3-545ae7f5a399 tempest-VolumesAdminNegativeTest-2132198365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:38:24 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-5af6a293-7161-41f7-95e3-545ae7f5a399 tempest-VolumesAdminNegativeTest-2132198365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:38:24 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-5af6a293-7161-41f7-95e3-545ae7f5a399 tempest-VolumesAdminNegativeTest-2132198365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:38:24 devstack sudo[88749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:38:24 devstack sudo[88749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:38:25 devstack sudo[88749]: pam_unix(sudo:session): session closed for user root Sep 25 11:38:25 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-5af6a293-7161-41f7-95e3-545ae7f5a399 tempest-VolumesAdminNegativeTest-2132198365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 1.062s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:38:25 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-5af6a293-7161-41f7-95e3-545ae7f5a399 tempest-VolumesAdminNegativeTest-2132198365 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:38:25 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-5af6a293-7161-41f7-95e3-545ae7f5a399 tempest-VolumesAdminNegativeTest-2132198365 None] Deleted volume successfully. Sep 25 11:38:25 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-5af6a293-7161-41f7-95e3-545ae7f5a399 tempest-VolumesAdminNegativeTest-2132198365 None] Lock "cinder-075561ca-fd29-43ef-b849-c2b3b29b5cdb-delete_volume" released by "delete_volume" :: held 7.138s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:38:25 devstack sudo[88745]: pam_unix(sudo:session): session closed for user root Sep 25 11:38:25 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-c0dfe4ce-7d00-4108-b137-d51f95c144c6 tempest-ServersNegativeTestJSON-921106034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c5e24a77-08ed-4cc2-b5b8-9119edf0dacd 1073741824" returned: 0 in 1.739s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:38:25 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-c0dfe4ce-7d00-4108-b137-d51f95c144c6 tempest-ServersNegativeTestJSON-921106034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c5e24a77-08ed-4cc2-b5b8-9119edf0dacd {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:38:25 devstack sudo[88761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c5e24a77-08ed-4cc2-b5b8-9119edf0dacd Sep 25 11:38:25 devstack sudo[88761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:38:26 devstack sudo[88761]: pam_unix(sudo:session): session closed for user root Sep 25 11:38:26 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-c0dfe4ce-7d00-4108-b137-d51f95c144c6 tempest-ServersNegativeTestJSON-921106034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c5e24a77-08ed-4cc2-b5b8-9119edf0dacd" returned: 0 in 0.964s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:38:26 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-c0dfe4ce-7d00-4108-b137-d51f95c144c6 tempest-ServersNegativeTestJSON-921106034 None] <== create_volume: return (2853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:38:26 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-c0dfe4ce-7d00-4108-b137-d51f95c144c6 tempest-ServersNegativeTestJSON-921106034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.861s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:38:26 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-c0dfe4ce-7d00-4108-b137-d51f95c144c6 tempest-ServersNegativeTestJSON-921106034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d177f348-04e8-454d-bf18-160fce1f5349) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5e24a77-08ed-4cc2-b5b8-9119edf0dacd', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:38:26 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-c0dfe4ce-7d00-4108-b137-d51f95c144c6 tempest-ServersNegativeTestJSON-921106034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d256b85a-986a-4780-8bf2-4b34a659d152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:38:26 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-c0dfe4ce-7d00-4108-b137-d51f95c144c6 tempest-ServersNegativeTestJSON-921106034 None] Volume volume-c5e24a77-08ed-4cc2-b5b8-9119edf0dacd (c5e24a77-08ed-4cc2-b5b8-9119edf0dacd): created successfully Sep 25 11:38:26 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-c0dfe4ce-7d00-4108-b137-d51f95c144c6 tempest-ServersNegativeTestJSON-921106034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d256b85a-986a-4780-8bf2-4b34a659d152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:38:26 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-c0dfe4ce-7d00-4108-b137-d51f95c144c6 tempest-ServersNegativeTestJSON-921106034 None] Flow 'volume_create_manager' (afb50ac8-5845-4e0a-9f09-6029cb29f316) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:38:26 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-c0dfe4ce-7d00-4108-b137-d51f95c144c6 tempest-ServersNegativeTestJSON-921106034 None] Created volume successfully. Sep 25 11:38:35 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad690601-0296-4013-aedf-9d2a3baaaf7c tempest-ServersNegativeTestJSON-921106034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:38:35 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ad690601-0296-4013-aedf-9d2a3baaaf7c tempest-ServersNegativeTestJSON-921106034 None] Flow 'volume_create_manager' (a141b5d0-57f8-420b-9b0b-4b8490991b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:38:35 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ad690601-0296-4013-aedf-9d2a3baaaf7c tempest-ServersNegativeTestJSON-921106034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f61c21a0-7bbd-4a99-8f22-dd61a4959569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:38:35 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ad690601-0296-4013-aedf-9d2a3baaaf7c tempest-ServersNegativeTestJSON-921106034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f61c21a0-7bbd-4a99-8f22-dd61a4959569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:38:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1509016184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb34be98-e9a3-4c91-bca3-c0575aecc337,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b489e845a7e3439b87222311f0111c9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:38:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:38:35Z,use_quota=True,user_id='1febdbc466454325b35920f55034fc52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:38:35 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ad690601-0296-4013-aedf-9d2a3baaaf7c tempest-ServersNegativeTestJSON-921106034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d2e4eb3-5f72-426f-a570-8cc4b68af6f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:38:35 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ad690601-0296-4013-aedf-9d2a3baaaf7c tempest-ServersNegativeTestJSON-921106034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d2e4eb3-5f72-426f-a570-8cc4b68af6f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:38:35 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ad690601-0296-4013-aedf-9d2a3baaaf7c tempest-ServersNegativeTestJSON-921106034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6501bbb9-cd5e-4d49-bcf1-8fb0e69f66d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:38:35 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ad690601-0296-4013-aedf-9d2a3baaaf7c tempest-ServersNegativeTestJSON-921106034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6501bbb9-cd5e-4d49-bcf1-8fb0e69f66d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb34be98-e9a3-4c91-bca3-c0575aecc337', 'volume_name': 'volume-cb34be98-e9a3-4c91-bca3-c0575aecc337', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:38:35 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ad690601-0296-4013-aedf-9d2a3baaaf7c tempest-ServersNegativeTestJSON-921106034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dde0ec08-dfe5-479c-8b0e-f3209eb981a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:38:35 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ad690601-0296-4013-aedf-9d2a3baaaf7c tempest-ServersNegativeTestJSON-921106034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dde0ec08-dfe5-479c-8b0e-f3209eb981a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:38:35 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ad690601-0296-4013-aedf-9d2a3baaaf7c tempest-ServersNegativeTestJSON-921106034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc2c85ff-1bc2-47b2-8c17-4db415045172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:38:35 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-ad690601-0296-4013-aedf-9d2a3baaaf7c tempest-ServersNegativeTestJSON-921106034 None] Volume cb34be98-e9a3-4c91-bca3-c0575aecc337: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb34be98-e9a3-4c91-bca3-c0575aecc337', 'volume_size': 1} Sep 25 11:38:35 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-ad690601-0296-4013-aedf-9d2a3baaaf7c tempest-ServersNegativeTestJSON-921106034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:38:35 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-ad690601-0296-4013-aedf-9d2a3baaaf7c tempest-ServersNegativeTestJSON-921106034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:38:35 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-ad690601-0296-4013-aedf-9d2a3baaaf7c tempest-ServersNegativeTestJSON-921106034 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:38:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1509016184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb34be98-e9a3-4c91-bca3-c0575aecc337,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b489e845a7e3439b87222311f0111c9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:38:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:38:35Z,use_quota=True,user_id='1febdbc466454325b35920f55034fc52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:38:35 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-ad690601-0296-4013-aedf-9d2a3baaaf7c tempest-ServersNegativeTestJSON-921106034 None] Creating volume cb34be98-e9a3-4c91-bca3-c0575aecc337 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:38:35 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-ad690601-0296-4013-aedf-9d2a3baaaf7c tempest-ServersNegativeTestJSON-921106034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:38:35 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-ad690601-0296-4013-aedf-9d2a3baaaf7c tempest-ServersNegativeTestJSON-921106034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:38:35 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-ad690601-0296-4013-aedf-9d2a3baaaf7c tempest-ServersNegativeTestJSON-921106034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:38:35 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-ad690601-0296-4013-aedf-9d2a3baaaf7c tempest-ServersNegativeTestJSON-921106034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:38:35 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-ad690601-0296-4013-aedf-9d2a3baaaf7c tempest-ServersNegativeTestJSON-921106034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:38:35 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-ad690601-0296-4013-aedf-9d2a3baaaf7c tempest-ServersNegativeTestJSON-921106034 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:38:35 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-ad690601-0296-4013-aedf-9d2a3baaaf7c tempest-ServersNegativeTestJSON-921106034 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:38:35 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ad690601-0296-4013-aedf-9d2a3baaaf7c tempest-ServersNegativeTestJSON-921106034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-cb34be98-e9a3-4c91-bca3-c0575aecc337 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:38:35 devstack sudo[88878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-cb34be98-e9a3-4c91-bca3-c0575aecc337 1073741824 Sep 25 11:38:35 devstack sudo[88878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:38:36 devstack sudo[88878]: pam_unix(sudo:session): session closed for user root Sep 25 11:38:36 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ad690601-0296-4013-aedf-9d2a3baaaf7c tempest-ServersNegativeTestJSON-921106034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-cb34be98-e9a3-4c91-bca3-c0575aecc337 1073741824" returned: 0 in 0.869s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:38:36 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ad690601-0296-4013-aedf-9d2a3baaaf7c tempest-ServersNegativeTestJSON-921106034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-cb34be98-e9a3-4c91-bca3-c0575aecc337 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:38:36 devstack sudo[88884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-cb34be98-e9a3-4c91-bca3-c0575aecc337 Sep 25 11:38:36 devstack sudo[88884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:38:37 devstack sudo[88884]: pam_unix(sudo:session): session closed for user root Sep 25 11:38:37 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ad690601-0296-4013-aedf-9d2a3baaaf7c tempest-ServersNegativeTestJSON-921106034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-cb34be98-e9a3-4c91-bca3-c0575aecc337" returned: 0 in 0.450s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:38:37 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-ad690601-0296-4013-aedf-9d2a3baaaf7c tempest-ServersNegativeTestJSON-921106034 None] <== create_volume: return (1401ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:38:37 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-ad690601-0296-4013-aedf-9d2a3baaaf7c tempest-ServersNegativeTestJSON-921106034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.405s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:38:37 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ad690601-0296-4013-aedf-9d2a3baaaf7c tempest-ServersNegativeTestJSON-921106034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc2c85ff-1bc2-47b2-8c17-4db415045172) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb34be98-e9a3-4c91-bca3-c0575aecc337', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:38:37 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ad690601-0296-4013-aedf-9d2a3baaaf7c tempest-ServersNegativeTestJSON-921106034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6ce3a90-0138-48ef-970a-0f2f3e358b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:38:37 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-ad690601-0296-4013-aedf-9d2a3baaaf7c tempest-ServersNegativeTestJSON-921106034 None] Volume volume-cb34be98-e9a3-4c91-bca3-c0575aecc337 (cb34be98-e9a3-4c91-bca3-c0575aecc337): created successfully Sep 25 11:38:37 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ad690601-0296-4013-aedf-9d2a3baaaf7c tempest-ServersNegativeTestJSON-921106034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6ce3a90-0138-48ef-970a-0f2f3e358b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:38:37 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ad690601-0296-4013-aedf-9d2a3baaaf7c tempest-ServersNegativeTestJSON-921106034 None] Flow 'volume_create_manager' (a141b5d0-57f8-420b-9b0b-4b8490991b85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:38:37 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-ad690601-0296-4013-aedf-9d2a3baaaf7c tempest-ServersNegativeTestJSON-921106034 None] Created volume successfully. Sep 25 11:38:38 devstack cinder-volume[86984]: DEBUG oslo_service.periodic_task [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:38:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:38:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:38:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:38:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:38:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:38:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:38:38 devstack sudo[88894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:38:38 devstack sudo[88894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:38:38 devstack sudo[88894]: pam_unix(sudo:session): session closed for user root Sep 25 11:38:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.345s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:38:38 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:38:39 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e3673ec5-d72f-4baf-8670-555ff2a492ec tempest-ServersNegativeTestJSON-921106034 None] Acquiring lock "cinder-cb34be98-e9a3-4c91-bca3-c0575aecc337-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:38:39 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e3673ec5-d72f-4baf-8670-555ff2a492ec tempest-ServersNegativeTestJSON-921106034 None] Lock "cinder-cb34be98-e9a3-4c91-bca3-c0575aecc337-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:38:39 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e3673ec5-d72f-4baf-8670-555ff2a492ec tempest-ServersNegativeTestJSON-921106034 None] Acquiring lock "cinder-quobyte-cb34be98-e9a3-4c91-bca3-c0575aecc337" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:38:39 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e3673ec5-d72f-4baf-8670-555ff2a492ec tempest-ServersNegativeTestJSON-921106034 None] Lock "cinder-quobyte-cb34be98-e9a3-4c91-bca3-c0575aecc337" acquired by "delete_volume" :: waited 0.032s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:38:39 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-d2d1762d-b7e1-49b4-b242-b3d62c4138fc tempest-ServerRescueNegativeTestJSON-1291576593 None] Acquiring lock "cinder-9c3cea36-3a37-40f7-9262-f48d49e7c111-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:38:39 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4416417-9fed-4ce5-ac9a-dddefe38b5c1]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:38:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e3673ec5-d72f-4baf-8670-555ff2a492ec tempest-ServersNegativeTestJSON-921106034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-cb34be98-e9a3-4c91-bca3-c0575aecc337 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:38:39 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-d2d1762d-b7e1-49b4-b242-b3d62c4138fc tempest-ServerRescueNegativeTestJSON-1291576593 None] Lock "cinder-9c3cea36-3a37-40f7-9262-f48d49e7c111-delete_volume" acquired by "delete_volume" :: waited 0.101s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:38:40 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-d2d1762d-b7e1-49b4-b242-b3d62c4138fc tempest-ServerRescueNegativeTestJSON-1291576593 None] Acquiring lock "cinder-quobyte-9c3cea36-3a37-40f7-9262-f48d49e7c111" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:38:40 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-d2d1762d-b7e1-49b4-b242-b3d62c4138fc tempest-ServerRescueNegativeTestJSON-1291576593 None] Lock "cinder-quobyte-9c3cea36-3a37-40f7-9262-f48d49e7c111" acquired by "delete_volume" :: waited 0.041s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:38:40 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a0caa0a-320d-49e3-a658-d3a4484ced04]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:38:40 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d2d1762d-b7e1-49b4-b242-b3d62c4138fc tempest-ServerRescueNegativeTestJSON-1291576593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9c3cea36-3a37-40f7-9262-f48d49e7c111 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:38:40 devstack sudo[88898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-cb34be98-e9a3-4c91-bca3-c0575aecc337 Sep 25 11:38:40 devstack sudo[88898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:38:40 devstack sudo[88899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9c3cea36-3a37-40f7-9262-f48d49e7c111 Sep 25 11:38:40 devstack sudo[88899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:38:40 devstack sudo[88898]: pam_unix(sudo:session): session closed for user root Sep 25 11:38:40 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e3673ec5-d72f-4baf-8670-555ff2a492ec tempest-ServersNegativeTestJSON-921106034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-cb34be98-e9a3-4c91-bca3-c0575aecc337" returned: 0 in 0.965s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:38:40 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e3673ec5-d72f-4baf-8670-555ff2a492ec tempest-ServersNegativeTestJSON-921106034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-cb34be98-e9a3-4c91-bca3-c0575aecc337 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:38:40 devstack sudo[88908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-cb34be98-e9a3-4c91-bca3-c0575aecc337 Sep 25 11:38:40 devstack sudo[88908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:38:40 devstack sudo[88899]: pam_unix(sudo:session): session closed for user root Sep 25 11:38:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d2d1762d-b7e1-49b4-b242-b3d62c4138fc tempest-ServerRescueNegativeTestJSON-1291576593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9c3cea36-3a37-40f7-9262-f48d49e7c111" returned: 0 in 0.918s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:38:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d2d1762d-b7e1-49b4-b242-b3d62c4138fc tempest-ServerRescueNegativeTestJSON-1291576593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9c3cea36-3a37-40f7-9262-f48d49e7c111 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:38:41 devstack sudo[88912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9c3cea36-3a37-40f7-9262-f48d49e7c111 Sep 25 11:38:41 devstack sudo[88912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:38:41 devstack sudo[88912]: pam_unix(sudo:session): session closed for user root Sep 25 11:38:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d2d1762d-b7e1-49b4-b242-b3d62c4138fc tempest-ServerRescueNegativeTestJSON-1291576593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9c3cea36-3a37-40f7-9262-f48d49e7c111" returned: 0 in 0.374s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:38:41 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-d2d1762d-b7e1-49b4-b242-b3d62c4138fc tempest-ServerRescueNegativeTestJSON-1291576593 None] Lock "cinder-quobyte-9c3cea36-3a37-40f7-9262-f48d49e7c111" released by "delete_volume" :: held 1.368s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:38:41 devstack sudo[88908]: pam_unix(sudo:session): session closed for user root Sep 25 11:38:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e3673ec5-d72f-4baf-8670-555ff2a492ec tempest-ServersNegativeTestJSON-921106034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-cb34be98-e9a3-4c91-bca3-c0575aecc337" returned: 0 in 0.669s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:38:41 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e3673ec5-d72f-4baf-8670-555ff2a492ec tempest-ServersNegativeTestJSON-921106034 None] Lock "cinder-quobyte-cb34be98-e9a3-4c91-bca3-c0575aecc337" released by "delete_volume" :: held 1.754s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:38:41 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-d2d1762d-b7e1-49b4-b242-b3d62c4138fc tempest-ServerRescueNegativeTestJSON-1291576593 None] Created reservations ['ee3c3cb3-d470-460f-a6d8-b1de199428e5', '1f4fe176-38ca-4e1b-ae48-7f4e7e80d93a', '60733baf-ea6e-4475-97dd-ca503ff27a21', 'ae974967-896c-4767-b75d-84f4c6b8eb21'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:38:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d2d1762d-b7e1-49b4-b242-b3d62c4138fc tempest-ServerRescueNegativeTestJSON-1291576593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:38:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d2d1762d-b7e1-49b4-b242-b3d62c4138fc tempest-ServerRescueNegativeTestJSON-1291576593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:38:41 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-d2d1762d-b7e1-49b4-b242-b3d62c4138fc tempest-ServerRescueNegativeTestJSON-1291576593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:38:41 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-d2d1762d-b7e1-49b4-b242-b3d62c4138fc tempest-ServerRescueNegativeTestJSON-1291576593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:38:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d2d1762d-b7e1-49b4-b242-b3d62c4138fc tempest-ServerRescueNegativeTestJSON-1291576593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:38:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d2d1762d-b7e1-49b4-b242-b3d62c4138fc tempest-ServerRescueNegativeTestJSON-1291576593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:38:41 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-e3673ec5-d72f-4baf-8670-555ff2a492ec tempest-ServersNegativeTestJSON-921106034 None] Created reservations ['0a379c5a-352d-4d78-8e91-6be9e8719707', 'bb67f946-c80e-4cd7-8961-e17f9a217d02', '7cc49a51-2d97-42d2-b888-a3b0ba9c1d5b', 'f05f8ed3-c810-4065-968b-5dbfa834506e'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:38:41 devstack sudo[88917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:38:41 devstack sudo[88917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:38:42 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-e3673ec5-d72f-4baf-8670-555ff2a492ec tempest-ServersNegativeTestJSON-921106034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:38:42 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-e3673ec5-d72f-4baf-8670-555ff2a492ec tempest-ServersNegativeTestJSON-921106034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:38:42 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-e3673ec5-d72f-4baf-8670-555ff2a492ec tempest-ServersNegativeTestJSON-921106034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:38:42 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-e3673ec5-d72f-4baf-8670-555ff2a492ec tempest-ServersNegativeTestJSON-921106034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:38:42 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-e3673ec5-d72f-4baf-8670-555ff2a492ec tempest-ServersNegativeTestJSON-921106034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:38:42 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e3673ec5-d72f-4baf-8670-555ff2a492ec tempest-ServersNegativeTestJSON-921106034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:38:42 devstack sudo[88920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:38:42 devstack sudo[88920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:38:42 devstack sudo[88917]: pam_unix(sudo:session): session closed for user root Sep 25 11:38:42 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d2d1762d-b7e1-49b4-b242-b3d62c4138fc tempest-ServerRescueNegativeTestJSON-1291576593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.678s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:38:42 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-d2d1762d-b7e1-49b4-b242-b3d62c4138fc tempest-ServerRescueNegativeTestJSON-1291576593 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:38:42 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-d2d1762d-b7e1-49b4-b242-b3d62c4138fc tempest-ServerRescueNegativeTestJSON-1291576593 None] Deleted volume successfully. Sep 25 11:38:42 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-d2d1762d-b7e1-49b4-b242-b3d62c4138fc tempest-ServerRescueNegativeTestJSON-1291576593 None] Lock "cinder-9c3cea36-3a37-40f7-9262-f48d49e7c111-delete_volume" released by "delete_volume" :: held 2.720s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:38:42 devstack sudo[88920]: pam_unix(sudo:session): session closed for user root Sep 25 11:38:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e3673ec5-d72f-4baf-8670-555ff2a492ec tempest-ServersNegativeTestJSON-921106034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.796s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:38:43 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-e3673ec5-d72f-4baf-8670-555ff2a492ec tempest-ServersNegativeTestJSON-921106034 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:38:43 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-e3673ec5-d72f-4baf-8670-555ff2a492ec tempest-ServersNegativeTestJSON-921106034 None] Deleted volume successfully. Sep 25 11:38:43 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e3673ec5-d72f-4baf-8670-555ff2a492ec tempest-ServersNegativeTestJSON-921106034 None] Lock "cinder-cb34be98-e9a3-4c91-bca3-c0575aecc337-delete_volume" released by "delete_volume" :: held 3.394s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:38:43 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-8ff1ac7e-4cba-44d9-938b-d43c06f15f70 tempest-ServersNegativeTestJSON-921106034 None] Acquiring lock "cinder-c5e24a77-08ed-4cc2-b5b8-9119edf0dacd-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:38:43 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-8ff1ac7e-4cba-44d9-938b-d43c06f15f70 tempest-ServersNegativeTestJSON-921106034 None] Lock "cinder-c5e24a77-08ed-4cc2-b5b8-9119edf0dacd-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:38:43 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-8ff1ac7e-4cba-44d9-938b-d43c06f15f70 tempest-ServersNegativeTestJSON-921106034 None] Acquiring lock "cinder-quobyte-c5e24a77-08ed-4cc2-b5b8-9119edf0dacd" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:38:43 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-8ff1ac7e-4cba-44d9-938b-d43c06f15f70 tempest-ServersNegativeTestJSON-921106034 None] Lock "cinder-quobyte-c5e24a77-08ed-4cc2-b5b8-9119edf0dacd" acquired by "delete_volume" :: waited 0.102s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:38:43 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c6205a-2ffc-49bd-89c1-2e512442dc80]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:38:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8ff1ac7e-4cba-44d9-938b-d43c06f15f70 tempest-ServersNegativeTestJSON-921106034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c5e24a77-08ed-4cc2-b5b8-9119edf0dacd {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:38:43 devstack sudo[88946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c5e24a77-08ed-4cc2-b5b8-9119edf0dacd Sep 25 11:38:43 devstack sudo[88946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:38:44 devstack sudo[88946]: pam_unix(sudo:session): session closed for user root Sep 25 11:38:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8ff1ac7e-4cba-44d9-938b-d43c06f15f70 tempest-ServersNegativeTestJSON-921106034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c5e24a77-08ed-4cc2-b5b8-9119edf0dacd" returned: 0 in 0.610s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:38:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8ff1ac7e-4cba-44d9-938b-d43c06f15f70 tempest-ServersNegativeTestJSON-921106034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c5e24a77-08ed-4cc2-b5b8-9119edf0dacd {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:38:44 devstack sudo[88960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c5e24a77-08ed-4cc2-b5b8-9119edf0dacd Sep 25 11:38:44 devstack sudo[88960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:38:44 devstack sudo[88960]: pam_unix(sudo:session): session closed for user root Sep 25 11:38:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8ff1ac7e-4cba-44d9-938b-d43c06f15f70 tempest-ServersNegativeTestJSON-921106034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c5e24a77-08ed-4cc2-b5b8-9119edf0dacd" returned: 0 in 0.405s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:38:44 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-8ff1ac7e-4cba-44d9-938b-d43c06f15f70 tempest-ServersNegativeTestJSON-921106034 None] Lock "cinder-quobyte-c5e24a77-08ed-4cc2-b5b8-9119edf0dacd" released by "delete_volume" :: held 1.168s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:38:44 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-8ff1ac7e-4cba-44d9-938b-d43c06f15f70 tempest-ServersNegativeTestJSON-921106034 None] Created reservations ['27965f3a-8790-43ca-a1fa-70655c94b466', 'efc04c53-76b3-4df5-a69e-d9f82d226266', '6d334a3d-c605-40f1-8c93-b00c0556e815', '03a978b5-2ceb-43d3-93c3-77de29b67c55'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:38:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-8ff1ac7e-4cba-44d9-938b-d43c06f15f70 tempest-ServersNegativeTestJSON-921106034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:38:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-8ff1ac7e-4cba-44d9-938b-d43c06f15f70 tempest-ServersNegativeTestJSON-921106034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:38:44 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-8ff1ac7e-4cba-44d9-938b-d43c06f15f70 tempest-ServersNegativeTestJSON-921106034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:38:44 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-8ff1ac7e-4cba-44d9-938b-d43c06f15f70 tempest-ServersNegativeTestJSON-921106034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:38:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-8ff1ac7e-4cba-44d9-938b-d43c06f15f70 tempest-ServersNegativeTestJSON-921106034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:38:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8ff1ac7e-4cba-44d9-938b-d43c06f15f70 tempest-ServersNegativeTestJSON-921106034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:38:44 devstack sudo[88964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:38:44 devstack sudo[88964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:38:45 devstack sudo[88964]: pam_unix(sudo:session): session closed for user root Sep 25 11:38:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8ff1ac7e-4cba-44d9-938b-d43c06f15f70 tempest-ServersNegativeTestJSON-921106034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.480s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:38:45 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-8ff1ac7e-4cba-44d9-938b-d43c06f15f70 tempest-ServersNegativeTestJSON-921106034 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:38:45 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-8ff1ac7e-4cba-44d9-938b-d43c06f15f70 tempest-ServersNegativeTestJSON-921106034 None] Deleted volume successfully. Sep 25 11:38:45 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-8ff1ac7e-4cba-44d9-938b-d43c06f15f70 tempest-ServersNegativeTestJSON-921106034 None] Lock "cinder-c5e24a77-08ed-4cc2-b5b8-9119edf0dacd-delete_volume" released by "delete_volume" :: held 2.153s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:38:54 devstack cinder-volume[86984]: DEBUG dbcounter [-] [86984] Writing DB stats cinder:SELECT=34,cinder:INSERT=12,cinder:UPDATE=43,cinder:DELETE=3 {{(pid=86984) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:38:55 devstack cinder-volume[86984]: DEBUG dbcounter [-] [86984] Writing DB stats cinder:UPDATE=46,cinder:SELECT=23,cinder:DELETE=5,cinder:INSERT=8 {{(pid=86984) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:39:00 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-87237efa-def3-4db1-9b90-756befcc9ebe tempest-TaggedAttachmentsTest-1217675305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:39:00 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-87237efa-def3-4db1-9b90-756befcc9ebe tempest-TaggedAttachmentsTest-1217675305 None] Flow 'volume_create_manager' (67b2513c-c386-4599-957d-f628f001a5e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:39:00 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-87237efa-def3-4db1-9b90-756befcc9ebe tempest-TaggedAttachmentsTest-1217675305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a79bf6bb-6fff-440d-a1fb-a1201d51d7a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:39:00 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-87237efa-def3-4db1-9b90-756befcc9ebe tempest-TaggedAttachmentsTest-1217675305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a79bf6bb-6fff-440d-a1fb-a1201d51d7a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:39:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-258036429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecc57bad-56e3-457b-8151-babfe11d11b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d978dd8d51504affa49d0a86f063b83e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:39:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:39:01Z,use_quota=True,user_id='9fb3901070644d208418a6bbbde5d41a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:39:00 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-87237efa-def3-4db1-9b90-756befcc9ebe tempest-TaggedAttachmentsTest-1217675305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (371d8d29-e1a9-4de1-9321-c1678a44b75c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:39:00 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-87237efa-def3-4db1-9b90-756befcc9ebe tempest-TaggedAttachmentsTest-1217675305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (371d8d29-e1a9-4de1-9321-c1678a44b75c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:39:00 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-87237efa-def3-4db1-9b90-756befcc9ebe tempest-TaggedAttachmentsTest-1217675305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f6943dd-699d-4148-8d7a-624936f32bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:39:00 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-87237efa-def3-4db1-9b90-756befcc9ebe tempest-TaggedAttachmentsTest-1217675305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f6943dd-699d-4148-8d7a-624936f32bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecc57bad-56e3-457b-8151-babfe11d11b6', 'volume_name': 'volume-ecc57bad-56e3-457b-8151-babfe11d11b6', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:39:00 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-87237efa-def3-4db1-9b90-756befcc9ebe tempest-TaggedAttachmentsTest-1217675305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa321c8d-4526-43f7-b159-6639fa21d9ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:39:00 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-87237efa-def3-4db1-9b90-756befcc9ebe tempest-TaggedAttachmentsTest-1217675305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa321c8d-4526-43f7-b159-6639fa21d9ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:39:00 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-87237efa-def3-4db1-9b90-756befcc9ebe tempest-TaggedAttachmentsTest-1217675305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dd0e48c-02d0-4645-8827-d055a2d96940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:39:00 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-87237efa-def3-4db1-9b90-756befcc9ebe tempest-TaggedAttachmentsTest-1217675305 None] Volume ecc57bad-56e3-457b-8151-babfe11d11b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecc57bad-56e3-457b-8151-babfe11d11b6', 'volume_size': 1} Sep 25 11:39:00 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-87237efa-def3-4db1-9b90-756befcc9ebe tempest-TaggedAttachmentsTest-1217675305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:39:00 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-87237efa-def3-4db1-9b90-756befcc9ebe tempest-TaggedAttachmentsTest-1217675305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:39:00 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-87237efa-def3-4db1-9b90-756befcc9ebe tempest-TaggedAttachmentsTest-1217675305 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:39:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-258036429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecc57bad-56e3-457b-8151-babfe11d11b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d978dd8d51504affa49d0a86f063b83e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:39:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:39:01Z,use_quota=True,user_id='9fb3901070644d208418a6bbbde5d41a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:39:00 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-87237efa-def3-4db1-9b90-756befcc9ebe tempest-TaggedAttachmentsTest-1217675305 None] Creating volume ecc57bad-56e3-457b-8151-babfe11d11b6 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:39:00 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-87237efa-def3-4db1-9b90-756befcc9ebe tempest-TaggedAttachmentsTest-1217675305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:39:00 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-87237efa-def3-4db1-9b90-756befcc9ebe tempest-TaggedAttachmentsTest-1217675305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:39:00 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-87237efa-def3-4db1-9b90-756befcc9ebe tempest-TaggedAttachmentsTest-1217675305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:39:00 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-87237efa-def3-4db1-9b90-756befcc9ebe tempest-TaggedAttachmentsTest-1217675305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:39:00 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-87237efa-def3-4db1-9b90-756befcc9ebe tempest-TaggedAttachmentsTest-1217675305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:39:00 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-87237efa-def3-4db1-9b90-756befcc9ebe tempest-TaggedAttachmentsTest-1217675305 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:39:00 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-87237efa-def3-4db1-9b90-756befcc9ebe tempest-TaggedAttachmentsTest-1217675305 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:39:00 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-87237efa-def3-4db1-9b90-756befcc9ebe tempest-TaggedAttachmentsTest-1217675305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-ecc57bad-56e3-457b-8151-babfe11d11b6 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:39:00 devstack sudo[89037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-ecc57bad-56e3-457b-8151-babfe11d11b6 1073741824 Sep 25 11:39:00 devstack sudo[89037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:39:01 devstack sudo[89037]: pam_unix(sudo:session): session closed for user root Sep 25 11:39:01 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-87237efa-def3-4db1-9b90-756befcc9ebe tempest-TaggedAttachmentsTest-1217675305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-ecc57bad-56e3-457b-8151-babfe11d11b6 1073741824" returned: 0 in 0.732s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:39:01 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-87237efa-def3-4db1-9b90-756befcc9ebe tempest-TaggedAttachmentsTest-1217675305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-ecc57bad-56e3-457b-8151-babfe11d11b6 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:39:01 devstack sudo[89044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-ecc57bad-56e3-457b-8151-babfe11d11b6 Sep 25 11:39:01 devstack sudo[89044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:39:02 devstack sudo[89044]: pam_unix(sudo:session): session closed for user root Sep 25 11:39:02 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-87237efa-def3-4db1-9b90-756befcc9ebe tempest-TaggedAttachmentsTest-1217675305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-ecc57bad-56e3-457b-8151-babfe11d11b6" returned: 0 in 0.296s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:39:02 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-87237efa-def3-4db1-9b90-756befcc9ebe tempest-TaggedAttachmentsTest-1217675305 None] <== create_volume: return (1117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:39:02 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-87237efa-def3-4db1-9b90-756befcc9ebe tempest-TaggedAttachmentsTest-1217675305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.122s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:39:02 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-87237efa-def3-4db1-9b90-756befcc9ebe tempest-TaggedAttachmentsTest-1217675305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dd0e48c-02d0-4645-8827-d055a2d96940) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecc57bad-56e3-457b-8151-babfe11d11b6', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:39:02 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-87237efa-def3-4db1-9b90-756befcc9ebe tempest-TaggedAttachmentsTest-1217675305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4df74985-25ef-4c5c-976c-6e743221c609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:39:02 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-87237efa-def3-4db1-9b90-756befcc9ebe tempest-TaggedAttachmentsTest-1217675305 None] Volume volume-ecc57bad-56e3-457b-8151-babfe11d11b6 (ecc57bad-56e3-457b-8151-babfe11d11b6): created successfully Sep 25 11:39:02 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-87237efa-def3-4db1-9b90-756befcc9ebe tempest-TaggedAttachmentsTest-1217675305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4df74985-25ef-4c5c-976c-6e743221c609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:39:02 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-87237efa-def3-4db1-9b90-756befcc9ebe tempest-TaggedAttachmentsTest-1217675305 None] Flow 'volume_create_manager' (67b2513c-c386-4599-957d-f628f001a5e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:39:02 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-87237efa-def3-4db1-9b90-756befcc9ebe tempest-TaggedAttachmentsTest-1217675305 None] Created volume successfully. Sep 25 11:39:12 devstack cinder-volume[86984]: DEBUG dbcounter [-] [86984] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=86984) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:39:12 devstack cinder-volume[86984]: DEBUG dbcounter [-] [86984] Writing DB stats cinder:UPDATE=4,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86984) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:39:38 devstack cinder-volume[86984]: DEBUG oslo_service.periodic_task [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:39:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:39:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:39:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:39:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:39:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:39:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:39:38 devstack sudo[89171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:39:38 devstack sudo[89171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:39:39 devstack sudo[89171]: pam_unix(sudo:session): session closed for user root Sep 25 11:39:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.409s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:39:39 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:39:39 devstack cinder-volume[86984]: DEBUG oslo_service.periodic_task [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running periodic task VolumeManager._thread_info {{(pid=86984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:39:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] thread count: 8 {{(pid=86984) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 11:39:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] thread info: [<_MainThread(MainThread, started 132046492332160)>, , , , , , , ] {{(pid=86984) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 11:40:00 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-519dd605-96d8-4601-82a6-15bfc2f15c9e tempest-DeleteServersTestJSON-629139591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:40:00 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-519dd605-96d8-4601-82a6-15bfc2f15c9e tempest-DeleteServersTestJSON-629139591 None] Flow 'volume_create_manager' (296c1aa7-a55c-400a-90ea-bd03ffe9ab84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:40:00 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-519dd605-96d8-4601-82a6-15bfc2f15c9e tempest-DeleteServersTestJSON-629139591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddd75994-5dee-4133-ad7c-5128e38de9ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:40:00 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-519dd605-96d8-4601-82a6-15bfc2f15c9e tempest-DeleteServersTestJSON-629139591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddd75994-5dee-4133-ad7c-5128e38de9ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:40:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1215150268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c86f9a4c-ec1d-4468-9fb1-24ae398d6c02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3237b4b2459249fcbf3f860f06bec0c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:40:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:40:01Z,use_quota=True,user_id='ac7aa7b480334627859624e9fd563394',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:40:00 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-519dd605-96d8-4601-82a6-15bfc2f15c9e tempest-DeleteServersTestJSON-629139591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b889458-ad81-41ab-b977-7393569efdc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:40:00 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-519dd605-96d8-4601-82a6-15bfc2f15c9e tempest-DeleteServersTestJSON-629139591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b889458-ad81-41ab-b977-7393569efdc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:40:00 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-519dd605-96d8-4601-82a6-15bfc2f15c9e tempest-DeleteServersTestJSON-629139591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36024361-9966-408f-89af-cfe8894223aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:40:00 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-519dd605-96d8-4601-82a6-15bfc2f15c9e tempest-DeleteServersTestJSON-629139591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36024361-9966-408f-89af-cfe8894223aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c86f9a4c-ec1d-4468-9fb1-24ae398d6c02', 'volume_name': 'volume-c86f9a4c-ec1d-4468-9fb1-24ae398d6c02', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:40:00 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-519dd605-96d8-4601-82a6-15bfc2f15c9e tempest-DeleteServersTestJSON-629139591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1084aec1-4b14-453e-9e9c-47737ac5cf92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:40:00 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-519dd605-96d8-4601-82a6-15bfc2f15c9e tempest-DeleteServersTestJSON-629139591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1084aec1-4b14-453e-9e9c-47737ac5cf92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:40:00 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-519dd605-96d8-4601-82a6-15bfc2f15c9e tempest-DeleteServersTestJSON-629139591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6629b9ff-3abe-4f56-8d36-c6cb3f0d731d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:40:00 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-519dd605-96d8-4601-82a6-15bfc2f15c9e tempest-DeleteServersTestJSON-629139591 None] Volume c86f9a4c-ec1d-4468-9fb1-24ae398d6c02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c86f9a4c-ec1d-4468-9fb1-24ae398d6c02', 'volume_size': 1} Sep 25 11:40:00 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-519dd605-96d8-4601-82a6-15bfc2f15c9e tempest-DeleteServersTestJSON-629139591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:40:00 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-519dd605-96d8-4601-82a6-15bfc2f15c9e tempest-DeleteServersTestJSON-629139591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:40:00 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-519dd605-96d8-4601-82a6-15bfc2f15c9e tempest-DeleteServersTestJSON-629139591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:40:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1215150268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c86f9a4c-ec1d-4468-9fb1-24ae398d6c02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3237b4b2459249fcbf3f860f06bec0c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:40:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:40:01Z,use_quota=True,user_id='ac7aa7b480334627859624e9fd563394',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:40:00 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-519dd605-96d8-4601-82a6-15bfc2f15c9e tempest-DeleteServersTestJSON-629139591 None] Creating volume c86f9a4c-ec1d-4468-9fb1-24ae398d6c02 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:40:00 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-519dd605-96d8-4601-82a6-15bfc2f15c9e tempest-DeleteServersTestJSON-629139591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:40:00 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-519dd605-96d8-4601-82a6-15bfc2f15c9e tempest-DeleteServersTestJSON-629139591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:40:00 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-519dd605-96d8-4601-82a6-15bfc2f15c9e tempest-DeleteServersTestJSON-629139591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:40:00 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-519dd605-96d8-4601-82a6-15bfc2f15c9e tempest-DeleteServersTestJSON-629139591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:40:00 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-519dd605-96d8-4601-82a6-15bfc2f15c9e tempest-DeleteServersTestJSON-629139591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:40:00 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-519dd605-96d8-4601-82a6-15bfc2f15c9e tempest-DeleteServersTestJSON-629139591 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:40:00 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-519dd605-96d8-4601-82a6-15bfc2f15c9e tempest-DeleteServersTestJSON-629139591 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:40:00 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-519dd605-96d8-4601-82a6-15bfc2f15c9e tempest-DeleteServersTestJSON-629139591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c86f9a4c-ec1d-4468-9fb1-24ae398d6c02 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:40:00 devstack sudo[89524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c86f9a4c-ec1d-4468-9fb1-24ae398d6c02 1073741824 Sep 25 11:40:00 devstack sudo[89524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:40:02 devstack sudo[89524]: pam_unix(sudo:session): session closed for user root Sep 25 11:40:02 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-519dd605-96d8-4601-82a6-15bfc2f15c9e tempest-DeleteServersTestJSON-629139591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c86f9a4c-ec1d-4468-9fb1-24ae398d6c02 1073741824" returned: 0 in 1.409s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:40:02 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-519dd605-96d8-4601-82a6-15bfc2f15c9e tempest-DeleteServersTestJSON-629139591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c86f9a4c-ec1d-4468-9fb1-24ae398d6c02 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:40:02 devstack sudo[89572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c86f9a4c-ec1d-4468-9fb1-24ae398d6c02 Sep 25 11:40:02 devstack sudo[89572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:40:03 devstack sudo[89572]: pam_unix(sudo:session): session closed for user root Sep 25 11:40:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-519dd605-96d8-4601-82a6-15bfc2f15c9e tempest-DeleteServersTestJSON-629139591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c86f9a4c-ec1d-4468-9fb1-24ae398d6c02" returned: 0 in 0.739s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:40:03 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-519dd605-96d8-4601-82a6-15bfc2f15c9e tempest-DeleteServersTestJSON-629139591 None] <== create_volume: return (2248ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:40:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-519dd605-96d8-4601-82a6-15bfc2f15c9e tempest-DeleteServersTestJSON-629139591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.259s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:40:03 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-519dd605-96d8-4601-82a6-15bfc2f15c9e tempest-DeleteServersTestJSON-629139591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6629b9ff-3abe-4f56-8d36-c6cb3f0d731d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c86f9a4c-ec1d-4468-9fb1-24ae398d6c02', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:40:03 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-519dd605-96d8-4601-82a6-15bfc2f15c9e tempest-DeleteServersTestJSON-629139591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (318ca0ed-0331-4c4c-8481-6a893fa87f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:40:03 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-519dd605-96d8-4601-82a6-15bfc2f15c9e tempest-DeleteServersTestJSON-629139591 None] Volume volume-c86f9a4c-ec1d-4468-9fb1-24ae398d6c02 (c86f9a4c-ec1d-4468-9fb1-24ae398d6c02): created successfully Sep 25 11:40:03 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-519dd605-96d8-4601-82a6-15bfc2f15c9e tempest-DeleteServersTestJSON-629139591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (318ca0ed-0331-4c4c-8481-6a893fa87f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:40:03 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-519dd605-96d8-4601-82a6-15bfc2f15c9e tempest-DeleteServersTestJSON-629139591 None] Flow 'volume_create_manager' (296c1aa7-a55c-400a-90ea-bd03ffe9ab84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:40:03 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-519dd605-96d8-4601-82a6-15bfc2f15c9e tempest-DeleteServersTestJSON-629139591 None] Created volume successfully. Sep 25 11:40:09 devstack cinder-volume[86984]: WARNING py.warnings [req-a64b082f-c69a-4f83-8c48-099fcab5852b req-9ef76de0-638e-4b6a-8b59-e00efaee9c98 tempest-DeleteServersTestJSON-629139591 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Sep 25 11:40:09 devstack cinder-volume[86984]: .first() Sep 25 11:40:09 devstack cinder-volume[86984]: Sep 25 11:40:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-a64b082f-c69a-4f83-8c48-099fcab5852b req-9ef76de0-638e-4b6a-8b59-e00efaee9c98 tempest-DeleteServersTestJSON-629139591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:40:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-a64b082f-c69a-4f83-8c48-099fcab5852b req-9ef76de0-638e-4b6a-8b59-e00efaee9c98 tempest-DeleteServersTestJSON-629139591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:40:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-a64b082f-c69a-4f83-8c48-099fcab5852b req-9ef76de0-638e-4b6a-8b59-e00efaee9c98 tempest-DeleteServersTestJSON-629139591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:40:09 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [req-a64b082f-c69a-4f83-8c48-099fcab5852b req-9ef76de0-638e-4b6a-8b59-e00efaee9c98 tempest-DeleteServersTestJSON-629139591 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba', 'name': 'volume-c86f9a4c-ec1d-4468-9fb1-24ae398d6c02', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8030c6f8-0d22-4f67-8628-b7260df4f2d2', 'enforce_multipath': True} {{(pid=86984) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 11:40:10 devstack cinder-volume[86984]: INFO cinder.volume.manager [req-a64b082f-c69a-4f83-8c48-099fcab5852b req-9ef76de0-638e-4b6a-8b59-e00efaee9c98 tempest-DeleteServersTestJSON-629139591 None] attachment_update completed successfully. Sep 25 11:40:18 devstack cinder-volume[86984]: INFO cinder.volume.manager [req-0234a8d5-4c4b-4e66-a2fa-369bb9aae0d1 req-f32edbd0-92e9-442d-b891-f077f9b9b97f tempest-DeleteServersTestJSON-629139591 None] Terminate volume connection completed successfully. Sep 25 11:40:18 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [req-0234a8d5-4c4b-4e66-a2fa-369bb9aae0d1 req-f32edbd0-92e9-442d-b891-f077f9b9b97f tempest-DeleteServersTestJSON-629139591 None] Deleting attachment 8030c6f8-0d22-4f67-8628-b7260df4f2d2. {{(pid=86984) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 11:40:19 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-c3629e7b-c587-43a1-b342-c5e162434e02 tempest-DeleteServersTestJSON-629139591 None] Acquiring lock "cinder-c86f9a4c-ec1d-4468-9fb1-24ae398d6c02-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:40:19 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-c3629e7b-c587-43a1-b342-c5e162434e02 tempest-DeleteServersTestJSON-629139591 None] Lock "cinder-c86f9a4c-ec1d-4468-9fb1-24ae398d6c02-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:40:19 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-c3629e7b-c587-43a1-b342-c5e162434e02 tempest-DeleteServersTestJSON-629139591 None] Acquiring lock "cinder-quobyte-c86f9a4c-ec1d-4468-9fb1-24ae398d6c02" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:40:19 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-c3629e7b-c587-43a1-b342-c5e162434e02 tempest-DeleteServersTestJSON-629139591 None] Lock "cinder-quobyte-c86f9a4c-ec1d-4468-9fb1-24ae398d6c02" acquired by "delete_volume" :: waited 0.038s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:40:19 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9847bfd-0a98-4428-9ac3-1a19d4dbe4b5]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:40:19 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-c3629e7b-c587-43a1-b342-c5e162434e02 tempest-DeleteServersTestJSON-629139591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c86f9a4c-ec1d-4468-9fb1-24ae398d6c02 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:40:20 devstack sudo[90199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c86f9a4c-ec1d-4468-9fb1-24ae398d6c02 Sep 25 11:40:20 devstack sudo[90199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:40:20 devstack sudo[90199]: pam_unix(sudo:session): session closed for user root Sep 25 11:40:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-c3629e7b-c587-43a1-b342-c5e162434e02 tempest-DeleteServersTestJSON-629139591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c86f9a4c-ec1d-4468-9fb1-24ae398d6c02" returned: 0 in 0.899s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:40:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-c3629e7b-c587-43a1-b342-c5e162434e02 tempest-DeleteServersTestJSON-629139591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c86f9a4c-ec1d-4468-9fb1-24ae398d6c02 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:40:20 devstack sudo[90236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c86f9a4c-ec1d-4468-9fb1-24ae398d6c02 Sep 25 11:40:20 devstack sudo[90236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:40:21 devstack sudo[90236]: pam_unix(sudo:session): session closed for user root Sep 25 11:40:21 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-c3629e7b-c587-43a1-b342-c5e162434e02 tempest-DeleteServersTestJSON-629139591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c86f9a4c-ec1d-4468-9fb1-24ae398d6c02" returned: 0 in 0.595s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:40:21 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-c3629e7b-c587-43a1-b342-c5e162434e02 tempest-DeleteServersTestJSON-629139591 None] Lock "cinder-quobyte-c86f9a4c-ec1d-4468-9fb1-24ae398d6c02" released by "delete_volume" :: held 1.642s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:40:21 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-c3629e7b-c587-43a1-b342-c5e162434e02 tempest-DeleteServersTestJSON-629139591 None] Created reservations ['0d4c4d7d-eeae-478c-942f-badb64f5881e', '78c51c82-8910-4fd7-89c7-eef050609416', '880ad03d-0c1e-4692-be80-b67a9e8e2155', 'f3928d47-459c-480a-8486-6bb6ca56c393'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:40:21 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-c3629e7b-c587-43a1-b342-c5e162434e02 tempest-DeleteServersTestJSON-629139591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:40:21 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-c3629e7b-c587-43a1-b342-c5e162434e02 tempest-DeleteServersTestJSON-629139591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:40:21 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-c3629e7b-c587-43a1-b342-c5e162434e02 tempest-DeleteServersTestJSON-629139591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:40:21 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-c3629e7b-c587-43a1-b342-c5e162434e02 tempest-DeleteServersTestJSON-629139591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:40:21 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-c3629e7b-c587-43a1-b342-c5e162434e02 tempest-DeleteServersTestJSON-629139591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:40:21 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-c3629e7b-c587-43a1-b342-c5e162434e02 tempest-DeleteServersTestJSON-629139591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:40:21 devstack sudo[90251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:40:21 devstack sudo[90251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:40:22 devstack sudo[90251]: pam_unix(sudo:session): session closed for user root Sep 25 11:40:22 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-c3629e7b-c587-43a1-b342-c5e162434e02 tempest-DeleteServersTestJSON-629139591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.415s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:40:22 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-c3629e7b-c587-43a1-b342-c5e162434e02 tempest-DeleteServersTestJSON-629139591 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:40:22 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-c3629e7b-c587-43a1-b342-c5e162434e02 tempest-DeleteServersTestJSON-629139591 None] Deleted volume successfully. Sep 25 11:40:22 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-c3629e7b-c587-43a1-b342-c5e162434e02 tempest-DeleteServersTestJSON-629139591 None] Lock "cinder-c86f9a4c-ec1d-4468-9fb1-24ae398d6c02-delete_volume" released by "delete_volume" :: held 2.553s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:40:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-7fe3647a-9abe-4e77-bb81-8f3072f635e1 req-67022ada-a259-4083-b480-78639c1bdd26 tempest-TaggedAttachmentsTest-1217675305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:40:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-7fe3647a-9abe-4e77-bb81-8f3072f635e1 req-67022ada-a259-4083-b480-78639c1bdd26 tempest-TaggedAttachmentsTest-1217675305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:40:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-7fe3647a-9abe-4e77-bb81-8f3072f635e1 req-67022ada-a259-4083-b480-78639c1bdd26 tempest-TaggedAttachmentsTest-1217675305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:40:23 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [req-7fe3647a-9abe-4e77-bb81-8f3072f635e1 req-67022ada-a259-4083-b480-78639c1bdd26 tempest-TaggedAttachmentsTest-1217675305 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba', 'name': 'volume-ecc57bad-56e3-457b-8151-babfe11d11b6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '951b12ff-e10f-4bc8-87c4-f9d2892bd90d', 'enforce_multipath': True} {{(pid=86984) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 11:40:23 devstack cinder-volume[86984]: INFO cinder.volume.manager [req-7fe3647a-9abe-4e77-bb81-8f3072f635e1 req-67022ada-a259-4083-b480-78639c1bdd26 tempest-TaggedAttachmentsTest-1217675305 None] attachment_update completed successfully. Sep 25 11:40:27 devstack cinder-volume[86984]: INFO cinder.volume.manager [req-4c8dfd5a-5899-4863-8071-482aee21a842 req-b32100f5-ac42-4042-9906-f50d89f956f5 tempest-TaggedAttachmentsTest-1217675305 None] Terminate volume connection completed successfully. Sep 25 11:40:27 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [req-4c8dfd5a-5899-4863-8071-482aee21a842 req-b32100f5-ac42-4042-9906-f50d89f956f5 tempest-TaggedAttachmentsTest-1217675305 None] Deleting attachment 951b12ff-e10f-4bc8-87c4-f9d2892bd90d. {{(pid=86984) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 11:40:27 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-69052f3b-eab2-4cfd-973c-0097832bbeca tempest-AttachVolumeNegativeTest-2039869332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:40:27 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-69052f3b-eab2-4cfd-973c-0097832bbeca tempest-AttachVolumeNegativeTest-2039869332 None] Flow 'volume_create_manager' (b111a10a-741e-45f2-8672-806d52184038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:40:27 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-69052f3b-eab2-4cfd-973c-0097832bbeca tempest-AttachVolumeNegativeTest-2039869332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b021c1e2-5da4-45f8-a39f-2bf4e5fcda0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:40:27 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-69052f3b-eab2-4cfd-973c-0097832bbeca tempest-AttachVolumeNegativeTest-2039869332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b021c1e2-5da4-45f8-a39f-2bf4e5fcda0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:40:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-928746785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23d96563-0d42-4ff5-bb2a-40dee012e3a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa55515db8ae443fad5a3c89c67cb652',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:40:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:40:28Z,use_quota=True,user_id='36548203342a4f23961550f0f9060f1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:40:27 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-69052f3b-eab2-4cfd-973c-0097832bbeca tempest-AttachVolumeNegativeTest-2039869332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01d3395f-58b8-41f7-8656-30b3bc874078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:40:27 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-69052f3b-eab2-4cfd-973c-0097832bbeca tempest-AttachVolumeNegativeTest-2039869332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01d3395f-58b8-41f7-8656-30b3bc874078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:40:27 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-69052f3b-eab2-4cfd-973c-0097832bbeca tempest-AttachVolumeNegativeTest-2039869332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfeb638e-df35-4134-b87d-db2626c532fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:40:27 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-69052f3b-eab2-4cfd-973c-0097832bbeca tempest-AttachVolumeNegativeTest-2039869332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfeb638e-df35-4134-b87d-db2626c532fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23d96563-0d42-4ff5-bb2a-40dee012e3a4', 'volume_name': 'volume-23d96563-0d42-4ff5-bb2a-40dee012e3a4', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:40:27 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-69052f3b-eab2-4cfd-973c-0097832bbeca tempest-AttachVolumeNegativeTest-2039869332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bb09307-4cf3-4297-acb0-a4ffc132318a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:40:28 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-69052f3b-eab2-4cfd-973c-0097832bbeca tempest-AttachVolumeNegativeTest-2039869332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bb09307-4cf3-4297-acb0-a4ffc132318a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:40:28 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-69052f3b-eab2-4cfd-973c-0097832bbeca tempest-AttachVolumeNegativeTest-2039869332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b441499e-53c1-4ac5-a247-c9736157ae3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:40:28 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-69052f3b-eab2-4cfd-973c-0097832bbeca tempest-AttachVolumeNegativeTest-2039869332 None] Volume 23d96563-0d42-4ff5-bb2a-40dee012e3a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23d96563-0d42-4ff5-bb2a-40dee012e3a4', 'volume_size': 1} Sep 25 11:40:28 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-69052f3b-eab2-4cfd-973c-0097832bbeca tempest-AttachVolumeNegativeTest-2039869332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:40:28 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-69052f3b-eab2-4cfd-973c-0097832bbeca tempest-AttachVolumeNegativeTest-2039869332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:40:28 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-69052f3b-eab2-4cfd-973c-0097832bbeca tempest-AttachVolumeNegativeTest-2039869332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:40:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-928746785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23d96563-0d42-4ff5-bb2a-40dee012e3a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa55515db8ae443fad5a3c89c67cb652',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:40:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:40:28Z,use_quota=True,user_id='36548203342a4f23961550f0f9060f1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:40:28 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-69052f3b-eab2-4cfd-973c-0097832bbeca tempest-AttachVolumeNegativeTest-2039869332 None] Creating volume 23d96563-0d42-4ff5-bb2a-40dee012e3a4 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:40:28 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-69052f3b-eab2-4cfd-973c-0097832bbeca tempest-AttachVolumeNegativeTest-2039869332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:40:28 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-69052f3b-eab2-4cfd-973c-0097832bbeca tempest-AttachVolumeNegativeTest-2039869332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:40:28 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-69052f3b-eab2-4cfd-973c-0097832bbeca tempest-AttachVolumeNegativeTest-2039869332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:40:28 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-69052f3b-eab2-4cfd-973c-0097832bbeca tempest-AttachVolumeNegativeTest-2039869332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:40:28 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-69052f3b-eab2-4cfd-973c-0097832bbeca tempest-AttachVolumeNegativeTest-2039869332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:40:28 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-69052f3b-eab2-4cfd-973c-0097832bbeca tempest-AttachVolumeNegativeTest-2039869332 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:40:28 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-69052f3b-eab2-4cfd-973c-0097832bbeca tempest-AttachVolumeNegativeTest-2039869332 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:40:28 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-69052f3b-eab2-4cfd-973c-0097832bbeca tempest-AttachVolumeNegativeTest-2039869332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23d96563-0d42-4ff5-bb2a-40dee012e3a4 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:40:28 devstack sudo[90751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23d96563-0d42-4ff5-bb2a-40dee012e3a4 1073741824 Sep 25 11:40:28 devstack sudo[90751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:40:29 devstack sudo[90751]: pam_unix(sudo:session): session closed for user root Sep 25 11:40:29 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-69052f3b-eab2-4cfd-973c-0097832bbeca tempest-AttachVolumeNegativeTest-2039869332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23d96563-0d42-4ff5-bb2a-40dee012e3a4 1073741824" returned: 0 in 1.032s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:40:29 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-69052f3b-eab2-4cfd-973c-0097832bbeca tempest-AttachVolumeNegativeTest-2039869332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23d96563-0d42-4ff5-bb2a-40dee012e3a4 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:40:29 devstack sudo[90773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23d96563-0d42-4ff5-bb2a-40dee012e3a4 Sep 25 11:40:29 devstack sudo[90773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:40:29 devstack sudo[90773]: pam_unix(sudo:session): session closed for user root Sep 25 11:40:29 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-69052f3b-eab2-4cfd-973c-0097832bbeca tempest-AttachVolumeNegativeTest-2039869332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23d96563-0d42-4ff5-bb2a-40dee012e3a4" returned: 0 in 0.556s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:40:29 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-69052f3b-eab2-4cfd-973c-0097832bbeca tempest-AttachVolumeNegativeTest-2039869332 None] <== create_volume: return (1677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:40:29 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-69052f3b-eab2-4cfd-973c-0097832bbeca tempest-AttachVolumeNegativeTest-2039869332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.684s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:40:29 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-69052f3b-eab2-4cfd-973c-0097832bbeca tempest-AttachVolumeNegativeTest-2039869332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b441499e-53c1-4ac5-a247-c9736157ae3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23d96563-0d42-4ff5-bb2a-40dee012e3a4', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:40:29 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-69052f3b-eab2-4cfd-973c-0097832bbeca tempest-AttachVolumeNegativeTest-2039869332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f80aed80-55a6-4d49-8d1e-e527d73c9510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:40:29 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-69052f3b-eab2-4cfd-973c-0097832bbeca tempest-AttachVolumeNegativeTest-2039869332 None] Volume volume-23d96563-0d42-4ff5-bb2a-40dee012e3a4 (23d96563-0d42-4ff5-bb2a-40dee012e3a4): created successfully Sep 25 11:40:29 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-69052f3b-eab2-4cfd-973c-0097832bbeca tempest-AttachVolumeNegativeTest-2039869332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f80aed80-55a6-4d49-8d1e-e527d73c9510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:40:29 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-69052f3b-eab2-4cfd-973c-0097832bbeca tempest-AttachVolumeNegativeTest-2039869332 None] Flow 'volume_create_manager' (b111a10a-741e-45f2-8672-806d52184038) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:40:29 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-69052f3b-eab2-4cfd-973c-0097832bbeca tempest-AttachVolumeNegativeTest-2039869332 None] Created volume successfully. Sep 25 11:40:32 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-2b6f52c9-4a09-4fc7-b228-70a39a2b1a65 req-240c62f6-c0d2-4297-9f14-a523bdafb885 tempest-AttachVolumeNegativeTest-2039869332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:40:32 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-2b6f52c9-4a09-4fc7-b228-70a39a2b1a65 req-240c62f6-c0d2-4297-9f14-a523bdafb885 tempest-AttachVolumeNegativeTest-2039869332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:40:32 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-2b6f52c9-4a09-4fc7-b228-70a39a2b1a65 req-240c62f6-c0d2-4297-9f14-a523bdafb885 tempest-AttachVolumeNegativeTest-2039869332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.038s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:40:32 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [req-2b6f52c9-4a09-4fc7-b228-70a39a2b1a65 req-240c62f6-c0d2-4297-9f14-a523bdafb885 tempest-AttachVolumeNegativeTest-2039869332 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba', 'name': 'volume-23d96563-0d42-4ff5-bb2a-40dee012e3a4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '79e434f9-4ec8-4aa1-9e62-20be10e4200e', 'enforce_multipath': True} {{(pid=86984) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 11:40:32 devstack cinder-volume[86984]: INFO cinder.volume.manager [req-2b6f52c9-4a09-4fc7-b228-70a39a2b1a65 req-240c62f6-c0d2-4297-9f14-a523bdafb885 tempest-AttachVolumeNegativeTest-2039869332 None] attachment_update completed successfully. Sep 25 11:40:35 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-8757664e-5cd5-410c-913d-893c65e30f3e tempest-AttachVolumeShelveTestJSON-2098033507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:40:35 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8757664e-5cd5-410c-913d-893c65e30f3e tempest-AttachVolumeShelveTestJSON-2098033507 None] Flow 'volume_create_manager' (100cbb26-f6d3-49d8-b6a2-fd60ebfbf118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:40:35 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8757664e-5cd5-410c-913d-893c65e30f3e tempest-AttachVolumeShelveTestJSON-2098033507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93128d52-b6b6-40ef-8cec-304f9901db36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:40:35 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8757664e-5cd5-410c-913d-893c65e30f3e tempest-AttachVolumeShelveTestJSON-2098033507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93128d52-b6b6-40ef-8cec-304f9901db36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:40:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1992642391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=546a3aa1-f7ad-47f2-b741-6264492d9093,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aebfa1acb8f34aafb819697681cdbee8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:40:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:40:35Z,use_quota=True,user_id='fb3a9149abb54c1f8cf6074d6150faae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:40:35 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8757664e-5cd5-410c-913d-893c65e30f3e tempest-AttachVolumeShelveTestJSON-2098033507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fbca08d-d212-4282-97db-53c18e321d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:40:35 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8757664e-5cd5-410c-913d-893c65e30f3e tempest-AttachVolumeShelveTestJSON-2098033507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fbca08d-d212-4282-97db-53c18e321d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:40:35 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8757664e-5cd5-410c-913d-893c65e30f3e tempest-AttachVolumeShelveTestJSON-2098033507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (771452b7-c9ed-407c-9f9a-5de4f9aab408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:40:35 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8757664e-5cd5-410c-913d-893c65e30f3e tempest-AttachVolumeShelveTestJSON-2098033507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (771452b7-c9ed-407c-9f9a-5de4f9aab408) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '546a3aa1-f7ad-47f2-b741-6264492d9093', 'volume_name': 'volume-546a3aa1-f7ad-47f2-b741-6264492d9093', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:40:35 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8757664e-5cd5-410c-913d-893c65e30f3e tempest-AttachVolumeShelveTestJSON-2098033507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56fbd130-87b5-4d63-b23e-c31a75ec11c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:40:35 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8757664e-5cd5-410c-913d-893c65e30f3e tempest-AttachVolumeShelveTestJSON-2098033507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56fbd130-87b5-4d63-b23e-c31a75ec11c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:40:35 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8757664e-5cd5-410c-913d-893c65e30f3e tempest-AttachVolumeShelveTestJSON-2098033507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53e7b0a6-6394-4868-ae77-88217861079f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:40:35 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-8757664e-5cd5-410c-913d-893c65e30f3e tempest-AttachVolumeShelveTestJSON-2098033507 None] Volume 546a3aa1-f7ad-47f2-b741-6264492d9093: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-546a3aa1-f7ad-47f2-b741-6264492d9093', 'volume_size': 1} Sep 25 11:40:35 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-8757664e-5cd5-410c-913d-893c65e30f3e tempest-AttachVolumeShelveTestJSON-2098033507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:40:35 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-8757664e-5cd5-410c-913d-893c65e30f3e tempest-AttachVolumeShelveTestJSON-2098033507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:40:35 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-8757664e-5cd5-410c-913d-893c65e30f3e tempest-AttachVolumeShelveTestJSON-2098033507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:40:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1992642391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=546a3aa1-f7ad-47f2-b741-6264492d9093,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aebfa1acb8f34aafb819697681cdbee8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:40:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:40:35Z,use_quota=True,user_id='fb3a9149abb54c1f8cf6074d6150faae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:40:35 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-8757664e-5cd5-410c-913d-893c65e30f3e tempest-AttachVolumeShelveTestJSON-2098033507 None] Creating volume 546a3aa1-f7ad-47f2-b741-6264492d9093 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:40:35 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-8757664e-5cd5-410c-913d-893c65e30f3e tempest-AttachVolumeShelveTestJSON-2098033507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:40:35 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-8757664e-5cd5-410c-913d-893c65e30f3e tempest-AttachVolumeShelveTestJSON-2098033507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:40:35 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-8757664e-5cd5-410c-913d-893c65e30f3e tempest-AttachVolumeShelveTestJSON-2098033507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:40:35 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-8757664e-5cd5-410c-913d-893c65e30f3e tempest-AttachVolumeShelveTestJSON-2098033507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:40:35 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-8757664e-5cd5-410c-913d-893c65e30f3e tempest-AttachVolumeShelveTestJSON-2098033507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:40:35 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-8757664e-5cd5-410c-913d-893c65e30f3e tempest-AttachVolumeShelveTestJSON-2098033507 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:40:35 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-8757664e-5cd5-410c-913d-893c65e30f3e tempest-AttachVolumeShelveTestJSON-2098033507 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:40:35 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8757664e-5cd5-410c-913d-893c65e30f3e tempest-AttachVolumeShelveTestJSON-2098033507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-546a3aa1-f7ad-47f2-b741-6264492d9093 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:40:35 devstack sudo[91236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-546a3aa1-f7ad-47f2-b741-6264492d9093 1073741824 Sep 25 11:40:35 devstack sudo[91236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:40:36 devstack sudo[91236]: pam_unix(sudo:session): session closed for user root Sep 25 11:40:36 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8757664e-5cd5-410c-913d-893c65e30f3e tempest-AttachVolumeShelveTestJSON-2098033507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-546a3aa1-f7ad-47f2-b741-6264492d9093 1073741824" returned: 0 in 0.955s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:40:36 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8757664e-5cd5-410c-913d-893c65e30f3e tempest-AttachVolumeShelveTestJSON-2098033507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-546a3aa1-f7ad-47f2-b741-6264492d9093 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:40:36 devstack sudo[91282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-546a3aa1-f7ad-47f2-b741-6264492d9093 Sep 25 11:40:36 devstack sudo[91282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:40:37 devstack sudo[91282]: pam_unix(sudo:session): session closed for user root Sep 25 11:40:37 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8757664e-5cd5-410c-913d-893c65e30f3e tempest-AttachVolumeShelveTestJSON-2098033507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-546a3aa1-f7ad-47f2-b741-6264492d9093" returned: 0 in 0.530s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:40:37 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-8757664e-5cd5-410c-913d-893c65e30f3e tempest-AttachVolumeShelveTestJSON-2098033507 None] <== create_volume: return (1624ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:40:37 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-8757664e-5cd5-410c-913d-893c65e30f3e tempest-AttachVolumeShelveTestJSON-2098033507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.639s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:40:37 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8757664e-5cd5-410c-913d-893c65e30f3e tempest-AttachVolumeShelveTestJSON-2098033507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53e7b0a6-6394-4868-ae77-88217861079f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-546a3aa1-f7ad-47f2-b741-6264492d9093', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:40:37 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8757664e-5cd5-410c-913d-893c65e30f3e tempest-AttachVolumeShelveTestJSON-2098033507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a28c55ec-811e-40b4-9a00-ff81dc6ffa4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:40:37 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-8757664e-5cd5-410c-913d-893c65e30f3e tempest-AttachVolumeShelveTestJSON-2098033507 None] Volume volume-546a3aa1-f7ad-47f2-b741-6264492d9093 (546a3aa1-f7ad-47f2-b741-6264492d9093): created successfully Sep 25 11:40:37 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8757664e-5cd5-410c-913d-893c65e30f3e tempest-AttachVolumeShelveTestJSON-2098033507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a28c55ec-811e-40b4-9a00-ff81dc6ffa4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:40:37 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8757664e-5cd5-410c-913d-893c65e30f3e tempest-AttachVolumeShelveTestJSON-2098033507 None] Flow 'volume_create_manager' (100cbb26-f6d3-49d8-b6a2-fd60ebfbf118) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:40:37 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-8757664e-5cd5-410c-913d-893c65e30f3e tempest-AttachVolumeShelveTestJSON-2098033507 None] Created volume successfully. Sep 25 11:40:38 devstack cinder-volume[86984]: DEBUG oslo_service.periodic_task [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:40:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:40:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:40:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:40:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:40:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:40:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:40:38 devstack sudo[91300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:40:38 devstack sudo[91300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:40:39 devstack sudo[91300]: pam_unix(sudo:session): session closed for user root Sep 25 11:40:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.492s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:40:39 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:40:39 devstack cinder-volume[86984]: DEBUG oslo_service.periodic_task [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running periodic task VolumeManager._thread_info {{(pid=86984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:40:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] thread count: 8 {{(pid=86984) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 11:40:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] thread info: [<_MainThread(MainThread, started 132046492332160)>, , , , , , , ] {{(pid=86984) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 11:40:47 devstack cinder-volume[86984]: DEBUG dbcounter [-] [86984] Writing DB stats cinder:SELECT=31,cinder:UPDATE=21,cinder:INSERT=2,cinder:DELETE=2 {{(pid=86984) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:40:47 devstack cinder-volume[86984]: DEBUG dbcounter [-] [86984] Writing DB stats cinder:SELECT=35,cinder:UPDATE=23,cinder:INSERT=5,cinder:DELETE=2 {{(pid=86984) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:40:51 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-411ffdc7-38c8-4a93-b144-2cec76002853 tempest-TaggedAttachmentsTest-1217675305 None] Acquiring lock "cinder-ecc57bad-56e3-457b-8151-babfe11d11b6-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:40:51 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-411ffdc7-38c8-4a93-b144-2cec76002853 tempest-TaggedAttachmentsTest-1217675305 None] Lock "cinder-ecc57bad-56e3-457b-8151-babfe11d11b6-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:40:51 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-411ffdc7-38c8-4a93-b144-2cec76002853 tempest-TaggedAttachmentsTest-1217675305 None] Acquiring lock "cinder-quobyte-ecc57bad-56e3-457b-8151-babfe11d11b6" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:40:51 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-411ffdc7-38c8-4a93-b144-2cec76002853 tempest-TaggedAttachmentsTest-1217675305 None] Lock "cinder-quobyte-ecc57bad-56e3-457b-8151-babfe11d11b6" acquired by "delete_volume" :: waited 0.050s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:40:52 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[7849840d-b700-47b7-91c7-3b2dfc9c6334]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:40:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-411ffdc7-38c8-4a93-b144-2cec76002853 tempest-TaggedAttachmentsTest-1217675305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-ecc57bad-56e3-457b-8151-babfe11d11b6 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:40:52 devstack sudo[91334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-ecc57bad-56e3-457b-8151-babfe11d11b6 Sep 25 11:40:52 devstack sudo[91334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:40:53 devstack sudo[91334]: pam_unix(sudo:session): session closed for user root Sep 25 11:40:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-411ffdc7-38c8-4a93-b144-2cec76002853 tempest-TaggedAttachmentsTest-1217675305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-ecc57bad-56e3-457b-8151-babfe11d11b6" returned: 0 in 1.062s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:40:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-411ffdc7-38c8-4a93-b144-2cec76002853 tempest-TaggedAttachmentsTest-1217675305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-ecc57bad-56e3-457b-8151-babfe11d11b6 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:40:53 devstack sudo[91364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-ecc57bad-56e3-457b-8151-babfe11d11b6 Sep 25 11:40:53 devstack sudo[91364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:40:53 devstack sudo[91364]: pam_unix(sudo:session): session closed for user root Sep 25 11:40:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-411ffdc7-38c8-4a93-b144-2cec76002853 tempest-TaggedAttachmentsTest-1217675305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-ecc57bad-56e3-457b-8151-babfe11d11b6" returned: 0 in 0.484s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:40:53 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-411ffdc7-38c8-4a93-b144-2cec76002853 tempest-TaggedAttachmentsTest-1217675305 None] Lock "cinder-quobyte-ecc57bad-56e3-457b-8151-babfe11d11b6" released by "delete_volume" :: held 1.664s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:40:53 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-411ffdc7-38c8-4a93-b144-2cec76002853 tempest-TaggedAttachmentsTest-1217675305 None] Created reservations ['0332dabc-9779-473e-8104-87cbb63432d8', '195260b2-7466-4a61-ba7e-49aa0940f13c', 'f345b344-cb04-4117-84ae-881573c37a4b', '590e6c3d-0126-4cad-8da3-8351ce925702'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:40:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-411ffdc7-38c8-4a93-b144-2cec76002853 tempest-TaggedAttachmentsTest-1217675305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:40:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-411ffdc7-38c8-4a93-b144-2cec76002853 tempest-TaggedAttachmentsTest-1217675305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:40:53 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-411ffdc7-38c8-4a93-b144-2cec76002853 tempest-TaggedAttachmentsTest-1217675305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:40:53 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-411ffdc7-38c8-4a93-b144-2cec76002853 tempest-TaggedAttachmentsTest-1217675305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:40:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-411ffdc7-38c8-4a93-b144-2cec76002853 tempest-TaggedAttachmentsTest-1217675305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:40:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-411ffdc7-38c8-4a93-b144-2cec76002853 tempest-TaggedAttachmentsTest-1217675305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:40:53 devstack sudo[91367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:40:53 devstack sudo[91367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:40:54 devstack sudo[91367]: pam_unix(sudo:session): session closed for user root Sep 25 11:40:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-411ffdc7-38c8-4a93-b144-2cec76002853 tempest-TaggedAttachmentsTest-1217675305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.414s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:40:54 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-411ffdc7-38c8-4a93-b144-2cec76002853 tempest-TaggedAttachmentsTest-1217675305 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:40:54 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-411ffdc7-38c8-4a93-b144-2cec76002853 tempest-TaggedAttachmentsTest-1217675305 None] Deleted volume successfully. Sep 25 11:40:54 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-411ffdc7-38c8-4a93-b144-2cec76002853 tempest-TaggedAttachmentsTest-1217675305 None] Lock "cinder-ecc57bad-56e3-457b-8151-babfe11d11b6-delete_volume" released by "delete_volume" :: held 2.656s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:41:01 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [req-e1a6fb91-446c-4fd2-8327-3a8a912b0585 req-72c85ffb-e5c6-44bb-b6e5-5cffe4e0ab1c tempest-AttachVolumeShelveTestJSON-2098033507 None] No connector for attachment b443d108-6fda-4bec-91e2-5dac190cc651; skipping storage backend terminate_connection call. {{(pid=86984) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 25 11:41:01 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [req-e1a6fb91-446c-4fd2-8327-3a8a912b0585 req-72c85ffb-e5c6-44bb-b6e5-5cffe4e0ab1c tempest-AttachVolumeShelveTestJSON-2098033507 None] Deleting attachment b443d108-6fda-4bec-91e2-5dac190cc651. {{(pid=86984) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 11:41:11 devstack cinder-volume[86984]: DEBUG dbcounter [-] [86984] Writing DB stats cinder:SELECT=7,cinder:INSERT=2,cinder:UPDATE=9 {{(pid=86984) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:41:11 devstack cinder-volume[86984]: DEBUG dbcounter [-] [86984] Writing DB stats cinder:UPDATE=7,cinder:SELECT=5,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86984) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:41:38 devstack cinder-volume[86984]: DEBUG oslo_service.periodic_task [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:41:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:41:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:41:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:41:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:41:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:41:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:38 devstack sudo[91883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:41:38 devstack sudo[91883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:39 devstack sudo[91883]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.599s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:39 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:41:39 devstack cinder-volume[86984]: DEBUG oslo_service.periodic_task [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running periodic task VolumeManager._thread_info {{(pid=86984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:41:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] thread count: 8 {{(pid=86984) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 11:41:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] thread info: [<_MainThread(MainThread, started 132046492332160)>, , , , , , , ] {{(pid=86984) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 11:41:45 devstack cinder-volume[86984]: INFO cinder.volume.manager [req-108638d9-2bd2-4df2-a831-e6aa7d8d6167 req-14fd3cb3-bca6-4c6a-af05-212b7ae84d71 tempest-AttachVolumeNegativeTest-2039869332 None] Terminate volume connection completed successfully. Sep 25 11:41:45 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [req-108638d9-2bd2-4df2-a831-e6aa7d8d6167 req-14fd3cb3-bca6-4c6a-af05-212b7ae84d71 tempest-AttachVolumeNegativeTest-2039869332 None] Deleting attachment 79e434f9-4ec8-4aa1-9e62-20be10e4200e. {{(pid=86984) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 11:41:48 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-23f777a8-c43f-4fed-af00-3f4adf1ebb2e tempest-ServerActionsTestOtherA-778028304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:41:48 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-23f777a8-c43f-4fed-af00-3f4adf1ebb2e tempest-ServerActionsTestOtherA-778028304 None] Flow 'volume_create_manager' (e15b30cd-a2dd-439a-b1ca-87030b116915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:41:48 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-23f777a8-c43f-4fed-af00-3f4adf1ebb2e tempest-ServerActionsTestOtherA-778028304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24e636bd-29ae-43cd-bc1d-853f15f24c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:41:48 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-23f777a8-c43f-4fed-af00-3f4adf1ebb2e tempest-ServerActionsTestOtherA-778028304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24e636bd-29ae-43cd-bc1d-853f15f24c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:41:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-108715874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c7fe0de-db71-4bca-bbb7-1a149b8f4ffa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95a964563db24370a5ffb4e5f9a2fe01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:41:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:41:48Z,use_quota=True,user_id='cadf571d6acb4288ba60c4daf2ad9360',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:41:48 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-23f777a8-c43f-4fed-af00-3f4adf1ebb2e tempest-ServerActionsTestOtherA-778028304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8967f38b-a09e-4db0-9901-2eb0cde169ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:41:48 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-23f777a8-c43f-4fed-af00-3f4adf1ebb2e tempest-ServerActionsTestOtherA-778028304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8967f38b-a09e-4db0-9901-2eb0cde169ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:41:48 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-23f777a8-c43f-4fed-af00-3f4adf1ebb2e tempest-ServerActionsTestOtherA-778028304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e02ba4e-02dd-4136-a2d9-d02c17e738a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:41:48 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-23f777a8-c43f-4fed-af00-3f4adf1ebb2e tempest-ServerActionsTestOtherA-778028304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e02ba4e-02dd-4136-a2d9-d02c17e738a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c7fe0de-db71-4bca-bbb7-1a149b8f4ffa', 'volume_name': 'volume-2c7fe0de-db71-4bca-bbb7-1a149b8f4ffa', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:41:48 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-23f777a8-c43f-4fed-af00-3f4adf1ebb2e tempest-ServerActionsTestOtherA-778028304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f19f86bc-0771-4fd8-a040-8d4d15c5a743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:41:48 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-23f777a8-c43f-4fed-af00-3f4adf1ebb2e tempest-ServerActionsTestOtherA-778028304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f19f86bc-0771-4fd8-a040-8d4d15c5a743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:41:48 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-23f777a8-c43f-4fed-af00-3f4adf1ebb2e tempest-ServerActionsTestOtherA-778028304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (242c1f18-85e4-48d5-9d63-a8f4210f41be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:41:48 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-23f777a8-c43f-4fed-af00-3f4adf1ebb2e tempest-ServerActionsTestOtherA-778028304 None] Volume 2c7fe0de-db71-4bca-bbb7-1a149b8f4ffa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c7fe0de-db71-4bca-bbb7-1a149b8f4ffa', 'volume_size': 1} Sep 25 11:41:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-23f777a8-c43f-4fed-af00-3f4adf1ebb2e tempest-ServerActionsTestOtherA-778028304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:41:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-23f777a8-c43f-4fed-af00-3f4adf1ebb2e tempest-ServerActionsTestOtherA-778028304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:41:48 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-23f777a8-c43f-4fed-af00-3f4adf1ebb2e tempest-ServerActionsTestOtherA-778028304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:41:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-108715874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c7fe0de-db71-4bca-bbb7-1a149b8f4ffa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95a964563db24370a5ffb4e5f9a2fe01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:41:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:41:48Z,use_quota=True,user_id='cadf571d6acb4288ba60c4daf2ad9360',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:41:48 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-23f777a8-c43f-4fed-af00-3f4adf1ebb2e tempest-ServerActionsTestOtherA-778028304 None] Creating volume 2c7fe0de-db71-4bca-bbb7-1a149b8f4ffa {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:41:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-23f777a8-c43f-4fed-af00-3f4adf1ebb2e tempest-ServerActionsTestOtherA-778028304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:41:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-23f777a8-c43f-4fed-af00-3f4adf1ebb2e tempest-ServerActionsTestOtherA-778028304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:41:48 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-23f777a8-c43f-4fed-af00-3f4adf1ebb2e tempest-ServerActionsTestOtherA-778028304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:41:48 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-23f777a8-c43f-4fed-af00-3f4adf1ebb2e tempest-ServerActionsTestOtherA-778028304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:41:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-23f777a8-c43f-4fed-af00-3f4adf1ebb2e tempest-ServerActionsTestOtherA-778028304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:41:48 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-23f777a8-c43f-4fed-af00-3f4adf1ebb2e tempest-ServerActionsTestOtherA-778028304 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:41:48 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-23f777a8-c43f-4fed-af00-3f4adf1ebb2e tempest-ServerActionsTestOtherA-778028304 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:41:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-23f777a8-c43f-4fed-af00-3f4adf1ebb2e tempest-ServerActionsTestOtherA-778028304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2c7fe0de-db71-4bca-bbb7-1a149b8f4ffa 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:48 devstack sudo[91927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2c7fe0de-db71-4bca-bbb7-1a149b8f4ffa 1073741824 Sep 25 11:41:48 devstack sudo[91927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:49 devstack sudo[91927]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-23f777a8-c43f-4fed-af00-3f4adf1ebb2e tempest-ServerActionsTestOtherA-778028304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2c7fe0de-db71-4bca-bbb7-1a149b8f4ffa 1073741824" returned: 0 in 0.610s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-23f777a8-c43f-4fed-af00-3f4adf1ebb2e tempest-ServerActionsTestOtherA-778028304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2c7fe0de-db71-4bca-bbb7-1a149b8f4ffa {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:41:49 devstack sudo[91933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2c7fe0de-db71-4bca-bbb7-1a149b8f4ffa Sep 25 11:41:49 devstack sudo[91933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:41:49 devstack sudo[91933]: pam_unix(sudo:session): session closed for user root Sep 25 11:41:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-23f777a8-c43f-4fed-af00-3f4adf1ebb2e tempest-ServerActionsTestOtherA-778028304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2c7fe0de-db71-4bca-bbb7-1a149b8f4ffa" returned: 0 in 0.355s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:41:49 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-23f777a8-c43f-4fed-af00-3f4adf1ebb2e tempest-ServerActionsTestOtherA-778028304 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:41:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-23f777a8-c43f-4fed-af00-3f4adf1ebb2e tempest-ServerActionsTestOtherA-778028304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:41:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-23f777a8-c43f-4fed-af00-3f4adf1ebb2e tempest-ServerActionsTestOtherA-778028304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (242c1f18-85e4-48d5-9d63-a8f4210f41be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c7fe0de-db71-4bca-bbb7-1a149b8f4ffa', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:41:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-23f777a8-c43f-4fed-af00-3f4adf1ebb2e tempest-ServerActionsTestOtherA-778028304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2733546-abc3-4991-9b89-5d42b3ab5b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:41:49 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-23f777a8-c43f-4fed-af00-3f4adf1ebb2e tempest-ServerActionsTestOtherA-778028304 None] Volume volume-2c7fe0de-db71-4bca-bbb7-1a149b8f4ffa (2c7fe0de-db71-4bca-bbb7-1a149b8f4ffa): created successfully Sep 25 11:41:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-23f777a8-c43f-4fed-af00-3f4adf1ebb2e tempest-ServerActionsTestOtherA-778028304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2733546-abc3-4991-9b89-5d42b3ab5b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:41:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-23f777a8-c43f-4fed-af00-3f4adf1ebb2e tempest-ServerActionsTestOtherA-778028304 None] Flow 'volume_create_manager' (e15b30cd-a2dd-439a-b1ca-87030b116915) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:41:49 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-23f777a8-c43f-4fed-af00-3f4adf1ebb2e tempest-ServerActionsTestOtherA-778028304 None] Created volume successfully. Sep 25 11:41:59 devstack cinder-volume[86984]: DEBUG dbcounter [-] [86984] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=86984) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:41:59 devstack cinder-volume[86984]: DEBUG dbcounter [-] [86984] Writing DB stats cinder:SELECT=3,cinder:UPDATE=4,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86984) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:42:21 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e51f074f-4220-4568-9b19-e9e941299c14 tempest-AttachVolumeShelveTestJSON-2098033507 None] Acquiring lock "cinder-546a3aa1-f7ad-47f2-b741-6264492d9093-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:42:21 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e51f074f-4220-4568-9b19-e9e941299c14 tempest-AttachVolumeShelveTestJSON-2098033507 None] Lock "cinder-546a3aa1-f7ad-47f2-b741-6264492d9093-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:42:21 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e51f074f-4220-4568-9b19-e9e941299c14 tempest-AttachVolumeShelveTestJSON-2098033507 None] Acquiring lock "cinder-quobyte-546a3aa1-f7ad-47f2-b741-6264492d9093" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:42:21 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e51f074f-4220-4568-9b19-e9e941299c14 tempest-AttachVolumeShelveTestJSON-2098033507 None] Lock "cinder-quobyte-546a3aa1-f7ad-47f2-b741-6264492d9093" acquired by "delete_volume" :: waited 0.046s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:42:22 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a8a839-298e-4806-8132-17f995e865fb]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:42:22 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e51f074f-4220-4568-9b19-e9e941299c14 tempest-AttachVolumeShelveTestJSON-2098033507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-546a3aa1-f7ad-47f2-b741-6264492d9093 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:42:22 devstack sudo[92322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-546a3aa1-f7ad-47f2-b741-6264492d9093 Sep 25 11:42:22 devstack sudo[92322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:42:22 devstack sudo[92322]: pam_unix(sudo:session): session closed for user root Sep 25 11:42:22 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e51f074f-4220-4568-9b19-e9e941299c14 tempest-AttachVolumeShelveTestJSON-2098033507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-546a3aa1-f7ad-47f2-b741-6264492d9093" returned: 0 in 0.700s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:42:22 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e51f074f-4220-4568-9b19-e9e941299c14 tempest-AttachVolumeShelveTestJSON-2098033507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-546a3aa1-f7ad-47f2-b741-6264492d9093 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:42:22 devstack sudo[92328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-546a3aa1-f7ad-47f2-b741-6264492d9093 Sep 25 11:42:22 devstack sudo[92328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:42:23 devstack sudo[92328]: pam_unix(sudo:session): session closed for user root Sep 25 11:42:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e51f074f-4220-4568-9b19-e9e941299c14 tempest-AttachVolumeShelveTestJSON-2098033507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-546a3aa1-f7ad-47f2-b741-6264492d9093" returned: 0 in 0.608s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:42:23 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e51f074f-4220-4568-9b19-e9e941299c14 tempest-AttachVolumeShelveTestJSON-2098033507 None] Lock "cinder-quobyte-546a3aa1-f7ad-47f2-b741-6264492d9093" released by "delete_volume" :: held 1.413s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:42:23 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-e51f074f-4220-4568-9b19-e9e941299c14 tempest-AttachVolumeShelveTestJSON-2098033507 None] Created reservations ['38b56d16-0b0f-4617-8da1-efc1a59550a9', '5621df59-3688-4f5a-b85f-c9ddfb1f656a', '5f3b469f-9a35-448f-8447-f245a87b42e2', '1bc17c9d-1a39-4b49-be14-db84ad1351b4'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:42:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-e51f074f-4220-4568-9b19-e9e941299c14 tempest-AttachVolumeShelveTestJSON-2098033507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:42:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-e51f074f-4220-4568-9b19-e9e941299c14 tempest-AttachVolumeShelveTestJSON-2098033507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:42:23 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-e51f074f-4220-4568-9b19-e9e941299c14 tempest-AttachVolumeShelveTestJSON-2098033507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:42:23 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-e51f074f-4220-4568-9b19-e9e941299c14 tempest-AttachVolumeShelveTestJSON-2098033507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:42:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-e51f074f-4220-4568-9b19-e9e941299c14 tempest-AttachVolumeShelveTestJSON-2098033507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:42:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e51f074f-4220-4568-9b19-e9e941299c14 tempest-AttachVolumeShelveTestJSON-2098033507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:42:23 devstack sudo[92332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:42:23 devstack sudo[92332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:42:23 devstack sudo[92332]: pam_unix(sudo:session): session closed for user root Sep 25 11:42:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e51f074f-4220-4568-9b19-e9e941299c14 tempest-AttachVolumeShelveTestJSON-2098033507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.359s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:42:23 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-e51f074f-4220-4568-9b19-e9e941299c14 tempest-AttachVolumeShelveTestJSON-2098033507 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:42:23 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-e51f074f-4220-4568-9b19-e9e941299c14 tempest-AttachVolumeShelveTestJSON-2098033507 None] Deleted volume successfully. Sep 25 11:42:24 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e51f074f-4220-4568-9b19-e9e941299c14 tempest-AttachVolumeShelveTestJSON-2098033507 None] Lock "cinder-546a3aa1-f7ad-47f2-b741-6264492d9093-delete_volume" released by "delete_volume" :: held 2.140s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:42:29 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-cabe6b59-486f-4a1c-bd43-15302ffb4b9d tempest-AttachVolumeTestJSON-1176057342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:42:29 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cabe6b59-486f-4a1c-bd43-15302ffb4b9d tempest-AttachVolumeTestJSON-1176057342 None] Flow 'volume_create_manager' (04d0bb14-feff-4774-9568-278aac042b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:42:29 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cabe6b59-486f-4a1c-bd43-15302ffb4b9d tempest-AttachVolumeTestJSON-1176057342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (499f071e-7463-4bfe-925c-cad0f71f0973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:42:29 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cabe6b59-486f-4a1c-bd43-15302ffb4b9d tempest-AttachVolumeTestJSON-1176057342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (499f071e-7463-4bfe-925c-cad0f71f0973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:42:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1298527318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7481f990-6a6c-479a-9e3a-dba39ea46687,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecac587be34044a8859419c305c8dcd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:42:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:42:29Z,use_quota=True,user_id='890369c91616454eb42aaa7ecb37c74e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:42:29 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cabe6b59-486f-4a1c-bd43-15302ffb4b9d tempest-AttachVolumeTestJSON-1176057342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4804a008-932a-4d9c-96e5-dbb3cf2aa18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:42:29 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cabe6b59-486f-4a1c-bd43-15302ffb4b9d tempest-AttachVolumeTestJSON-1176057342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4804a008-932a-4d9c-96e5-dbb3cf2aa18e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:42:29 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cabe6b59-486f-4a1c-bd43-15302ffb4b9d tempest-AttachVolumeTestJSON-1176057342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (480c9a58-e33c-4cbc-a992-0e419067a9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:42:29 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cabe6b59-486f-4a1c-bd43-15302ffb4b9d tempest-AttachVolumeTestJSON-1176057342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (480c9a58-e33c-4cbc-a992-0e419067a9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7481f990-6a6c-479a-9e3a-dba39ea46687', 'volume_name': 'volume-7481f990-6a6c-479a-9e3a-dba39ea46687', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:42:29 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cabe6b59-486f-4a1c-bd43-15302ffb4b9d tempest-AttachVolumeTestJSON-1176057342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33e95a27-9b7b-427d-99eb-3e5db359e758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:42:29 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cabe6b59-486f-4a1c-bd43-15302ffb4b9d tempest-AttachVolumeTestJSON-1176057342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33e95a27-9b7b-427d-99eb-3e5db359e758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:42:29 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cabe6b59-486f-4a1c-bd43-15302ffb4b9d tempest-AttachVolumeTestJSON-1176057342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18e3732e-a713-4504-9533-8096544e4706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:42:29 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-cabe6b59-486f-4a1c-bd43-15302ffb4b9d tempest-AttachVolumeTestJSON-1176057342 None] Volume 7481f990-6a6c-479a-9e3a-dba39ea46687: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7481f990-6a6c-479a-9e3a-dba39ea46687', 'volume_size': 1} Sep 25 11:42:29 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-cabe6b59-486f-4a1c-bd43-15302ffb4b9d tempest-AttachVolumeTestJSON-1176057342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:42:29 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-cabe6b59-486f-4a1c-bd43-15302ffb4b9d tempest-AttachVolumeTestJSON-1176057342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:42:29 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-cabe6b59-486f-4a1c-bd43-15302ffb4b9d tempest-AttachVolumeTestJSON-1176057342 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:42:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1298527318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7481f990-6a6c-479a-9e3a-dba39ea46687,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecac587be34044a8859419c305c8dcd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:42:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:42:29Z,use_quota=True,user_id='890369c91616454eb42aaa7ecb37c74e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:42:29 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-cabe6b59-486f-4a1c-bd43-15302ffb4b9d tempest-AttachVolumeTestJSON-1176057342 None] Creating volume 7481f990-6a6c-479a-9e3a-dba39ea46687 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:42:29 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-cabe6b59-486f-4a1c-bd43-15302ffb4b9d tempest-AttachVolumeTestJSON-1176057342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:42:29 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-cabe6b59-486f-4a1c-bd43-15302ffb4b9d tempest-AttachVolumeTestJSON-1176057342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:42:29 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-cabe6b59-486f-4a1c-bd43-15302ffb4b9d tempest-AttachVolumeTestJSON-1176057342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:42:29 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-cabe6b59-486f-4a1c-bd43-15302ffb4b9d tempest-AttachVolumeTestJSON-1176057342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:42:29 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-cabe6b59-486f-4a1c-bd43-15302ffb4b9d tempest-AttachVolumeTestJSON-1176057342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:42:29 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-cabe6b59-486f-4a1c-bd43-15302ffb4b9d tempest-AttachVolumeTestJSON-1176057342 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:42:29 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-cabe6b59-486f-4a1c-bd43-15302ffb4b9d tempest-AttachVolumeTestJSON-1176057342 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:42:29 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cabe6b59-486f-4a1c-bd43-15302ffb4b9d tempest-AttachVolumeTestJSON-1176057342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7481f990-6a6c-479a-9e3a-dba39ea46687 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:42:29 devstack sudo[92380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7481f990-6a6c-479a-9e3a-dba39ea46687 1073741824 Sep 25 11:42:29 devstack sudo[92380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:42:30 devstack sudo[92380]: pam_unix(sudo:session): session closed for user root Sep 25 11:42:30 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cabe6b59-486f-4a1c-bd43-15302ffb4b9d tempest-AttachVolumeTestJSON-1176057342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7481f990-6a6c-479a-9e3a-dba39ea46687 1073741824" returned: 0 in 0.729s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:42:30 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cabe6b59-486f-4a1c-bd43-15302ffb4b9d tempest-AttachVolumeTestJSON-1176057342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7481f990-6a6c-479a-9e3a-dba39ea46687 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:42:30 devstack sudo[92388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7481f990-6a6c-479a-9e3a-dba39ea46687 Sep 25 11:42:30 devstack sudo[92388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:42:30 devstack sudo[92388]: pam_unix(sudo:session): session closed for user root Sep 25 11:42:30 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cabe6b59-486f-4a1c-bd43-15302ffb4b9d tempest-AttachVolumeTestJSON-1176057342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7481f990-6a6c-479a-9e3a-dba39ea46687" returned: 0 in 0.410s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:42:30 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-cabe6b59-486f-4a1c-bd43-15302ffb4b9d tempest-AttachVolumeTestJSON-1176057342 None] <== create_volume: return (1234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:42:30 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-cabe6b59-486f-4a1c-bd43-15302ffb4b9d tempest-AttachVolumeTestJSON-1176057342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.237s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:42:30 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cabe6b59-486f-4a1c-bd43-15302ffb4b9d tempest-AttachVolumeTestJSON-1176057342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18e3732e-a713-4504-9533-8096544e4706) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7481f990-6a6c-479a-9e3a-dba39ea46687', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:42:30 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cabe6b59-486f-4a1c-bd43-15302ffb4b9d tempest-AttachVolumeTestJSON-1176057342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a56003d-9969-4c70-8acd-262e0ea744ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:42:30 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-cabe6b59-486f-4a1c-bd43-15302ffb4b9d tempest-AttachVolumeTestJSON-1176057342 None] Volume volume-7481f990-6a6c-479a-9e3a-dba39ea46687 (7481f990-6a6c-479a-9e3a-dba39ea46687): created successfully Sep 25 11:42:30 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cabe6b59-486f-4a1c-bd43-15302ffb4b9d tempest-AttachVolumeTestJSON-1176057342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a56003d-9969-4c70-8acd-262e0ea744ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:42:30 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cabe6b59-486f-4a1c-bd43-15302ffb4b9d tempest-AttachVolumeTestJSON-1176057342 None] Flow 'volume_create_manager' (04d0bb14-feff-4774-9568-278aac042b55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:42:30 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-cabe6b59-486f-4a1c-bd43-15302ffb4b9d tempest-AttachVolumeTestJSON-1176057342 None] Created volume successfully. Sep 25 11:42:32 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-7347d689-7afc-408b-a132-76470f220571 req-f5b981af-e185-4570-90b6-c9184e539e86 tempest-AttachVolumeTestJSON-1176057342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:42:32 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-7347d689-7afc-408b-a132-76470f220571 req-f5b981af-e185-4570-90b6-c9184e539e86 tempest-AttachVolumeTestJSON-1176057342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:42:32 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-7347d689-7afc-408b-a132-76470f220571 req-f5b981af-e185-4570-90b6-c9184e539e86 tempest-AttachVolumeTestJSON-1176057342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:42:32 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [req-7347d689-7afc-408b-a132-76470f220571 req-f5b981af-e185-4570-90b6-c9184e539e86 tempest-AttachVolumeTestJSON-1176057342 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba', 'name': 'volume-7481f990-6a6c-479a-9e3a-dba39ea46687', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '78058f59-3b0c-4e81-b618-9ee2cc479364', 'enforce_multipath': True} {{(pid=86984) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 11:42:32 devstack cinder-volume[86984]: INFO cinder.volume.manager [req-7347d689-7afc-408b-a132-76470f220571 req-f5b981af-e185-4570-90b6-c9184e539e86 tempest-AttachVolumeTestJSON-1176057342 None] attachment_update completed successfully. Sep 25 11:42:36 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8440bb2-789d-4a38-ab62-389947a72bb2 tempest-VolumesTestJSON-44031677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:42:36 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f8440bb2-789d-4a38-ab62-389947a72bb2 tempest-VolumesTestJSON-44031677 None] Flow 'volume_create_manager' (464ac0fe-5017-43ef-a66e-677f58a6c656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:42:36 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f8440bb2-789d-4a38-ab62-389947a72bb2 tempest-VolumesTestJSON-44031677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e61849c5-4fb0-4cd2-b69e-69920114aae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:42:37 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f8440bb2-789d-4a38-ab62-389947a72bb2 tempest-VolumesTestJSON-44031677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e61849c5-4fb0-4cd2-b69e-69920114aae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:42:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-737241090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cf05360-126c-479b-b0ff-913b0a8ba089,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e0f531a27b5e4093a105b11a3f4b5b14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:42:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:42:37Z,use_quota=True,user_id='62a846c15076421ca33a95f655424a44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:42:37 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f8440bb2-789d-4a38-ab62-389947a72bb2 tempest-VolumesTestJSON-44031677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97f87390-673a-4ed3-aa88-c1cd61e64e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:42:37 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f8440bb2-789d-4a38-ab62-389947a72bb2 tempest-VolumesTestJSON-44031677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97f87390-673a-4ed3-aa88-c1cd61e64e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:42:37 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f8440bb2-789d-4a38-ab62-389947a72bb2 tempest-VolumesTestJSON-44031677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cefa11c-dc15-4be7-bdea-e0381d6ec323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:42:37 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f8440bb2-789d-4a38-ab62-389947a72bb2 tempest-VolumesTestJSON-44031677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cefa11c-dc15-4be7-bdea-e0381d6ec323) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cf05360-126c-479b-b0ff-913b0a8ba089', 'volume_name': 'volume-0cf05360-126c-479b-b0ff-913b0a8ba089', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:42:37 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f8440bb2-789d-4a38-ab62-389947a72bb2 tempest-VolumesTestJSON-44031677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00ab89c0-13d7-489e-ac8b-7528389d045d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:42:37 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f8440bb2-789d-4a38-ab62-389947a72bb2 tempest-VolumesTestJSON-44031677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00ab89c0-13d7-489e-ac8b-7528389d045d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:42:37 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f8440bb2-789d-4a38-ab62-389947a72bb2 tempest-VolumesTestJSON-44031677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2365ccf5-94bd-4656-bf89-934a2209b0fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:42:37 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-f8440bb2-789d-4a38-ab62-389947a72bb2 tempest-VolumesTestJSON-44031677 None] Volume 0cf05360-126c-479b-b0ff-913b0a8ba089: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cf05360-126c-479b-b0ff-913b0a8ba089', 'volume_size': 1} Sep 25 11:42:37 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f8440bb2-789d-4a38-ab62-389947a72bb2 tempest-VolumesTestJSON-44031677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:42:37 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f8440bb2-789d-4a38-ab62-389947a72bb2 tempest-VolumesTestJSON-44031677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:42:37 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-f8440bb2-789d-4a38-ab62-389947a72bb2 tempest-VolumesTestJSON-44031677 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:42:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-737241090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cf05360-126c-479b-b0ff-913b0a8ba089,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e0f531a27b5e4093a105b11a3f4b5b14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:42:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:42:37Z,use_quota=True,user_id='62a846c15076421ca33a95f655424a44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:42:37 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-f8440bb2-789d-4a38-ab62-389947a72bb2 tempest-VolumesTestJSON-44031677 None] Creating volume 0cf05360-126c-479b-b0ff-913b0a8ba089 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:42:37 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f8440bb2-789d-4a38-ab62-389947a72bb2 tempest-VolumesTestJSON-44031677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:42:37 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f8440bb2-789d-4a38-ab62-389947a72bb2 tempest-VolumesTestJSON-44031677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:42:37 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-f8440bb2-789d-4a38-ab62-389947a72bb2 tempest-VolumesTestJSON-44031677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:42:37 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-f8440bb2-789d-4a38-ab62-389947a72bb2 tempest-VolumesTestJSON-44031677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:42:37 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f8440bb2-789d-4a38-ab62-389947a72bb2 tempest-VolumesTestJSON-44031677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:42:37 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-f8440bb2-789d-4a38-ab62-389947a72bb2 tempest-VolumesTestJSON-44031677 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:42:37 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-f8440bb2-789d-4a38-ab62-389947a72bb2 tempest-VolumesTestJSON-44031677 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:42:37 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f8440bb2-789d-4a38-ab62-389947a72bb2 tempest-VolumesTestJSON-44031677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0cf05360-126c-479b-b0ff-913b0a8ba089 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:42:37 devstack sudo[92861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0cf05360-126c-479b-b0ff-913b0a8ba089 1073741824 Sep 25 11:42:37 devstack sudo[92861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:42:37 devstack sudo[92861]: pam_unix(sudo:session): session closed for user root Sep 25 11:42:37 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f8440bb2-789d-4a38-ab62-389947a72bb2 tempest-VolumesTestJSON-44031677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0cf05360-126c-479b-b0ff-913b0a8ba089 1073741824" returned: 0 in 0.575s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:42:37 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f8440bb2-789d-4a38-ab62-389947a72bb2 tempest-VolumesTestJSON-44031677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0cf05360-126c-479b-b0ff-913b0a8ba089 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:42:37 devstack sudo[92869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0cf05360-126c-479b-b0ff-913b0a8ba089 Sep 25 11:42:37 devstack sudo[92869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:42:38 devstack sudo[92869]: pam_unix(sudo:session): session closed for user root Sep 25 11:42:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f8440bb2-789d-4a38-ab62-389947a72bb2 tempest-VolumesTestJSON-44031677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0cf05360-126c-479b-b0ff-913b0a8ba089" returned: 0 in 0.373s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:42:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-f8440bb2-789d-4a38-ab62-389947a72bb2 tempest-VolumesTestJSON-44031677 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:42:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f8440bb2-789d-4a38-ab62-389947a72bb2 tempest-VolumesTestJSON-44031677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:42:38 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f8440bb2-789d-4a38-ab62-389947a72bb2 tempest-VolumesTestJSON-44031677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2365ccf5-94bd-4656-bf89-934a2209b0fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cf05360-126c-479b-b0ff-913b0a8ba089', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:42:38 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f8440bb2-789d-4a38-ab62-389947a72bb2 tempest-VolumesTestJSON-44031677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e513370-01c4-49a8-8e21-687c12e61ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:42:38 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-f8440bb2-789d-4a38-ab62-389947a72bb2 tempest-VolumesTestJSON-44031677 None] Volume volume-0cf05360-126c-479b-b0ff-913b0a8ba089 (0cf05360-126c-479b-b0ff-913b0a8ba089): created successfully Sep 25 11:42:38 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f8440bb2-789d-4a38-ab62-389947a72bb2 tempest-VolumesTestJSON-44031677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e513370-01c4-49a8-8e21-687c12e61ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:42:38 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f8440bb2-789d-4a38-ab62-389947a72bb2 tempest-VolumesTestJSON-44031677 None] Flow 'volume_create_manager' (464ac0fe-5017-43ef-a66e-677f58a6c656) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:42:38 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-f8440bb2-789d-4a38-ab62-389947a72bb2 tempest-VolumesTestJSON-44031677 None] Created volume successfully. Sep 25 11:42:38 devstack cinder-volume[86984]: DEBUG oslo_service.periodic_task [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:42:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:42:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:42:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:42:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:42:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:42:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:42:38 devstack sudo[92914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:42:38 devstack sudo[92914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:42:39 devstack sudo[92914]: pam_unix(sudo:session): session closed for user root Sep 25 11:42:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.476s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:42:39 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:42:39 devstack cinder-volume[86984]: DEBUG oslo_service.periodic_task [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running periodic task VolumeManager._thread_info {{(pid=86984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:42:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] thread count: 8 {{(pid=86984) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 11:42:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] thread info: [<_MainThread(MainThread, started 132046492332160)>, , , , , , , ] {{(pid=86984) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 11:42:40 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cfc7e62-f95e-421d-865c-35b94ca32eff tempest-VolumesTestJSON-44031677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:42:40 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4cfc7e62-f95e-421d-865c-35b94ca32eff tempest-VolumesTestJSON-44031677 None] Flow 'volume_create_manager' (2c9d6b89-5ec7-454c-9a76-4e808baea9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:42:40 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4cfc7e62-f95e-421d-865c-35b94ca32eff tempest-VolumesTestJSON-44031677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cddf640-d022-4135-8978-d53bfb3e3192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:42:40 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4cfc7e62-f95e-421d-865c-35b94ca32eff tempest-VolumesTestJSON-44031677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cddf640-d022-4135-8978-d53bfb3e3192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:42:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1907358239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f99ad8fc-335d-46d5-a3d9-0c09f0e0a033,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e0f531a27b5e4093a105b11a3f4b5b14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:42:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:42:41Z,use_quota=True,user_id='62a846c15076421ca33a95f655424a44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:42:40 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4cfc7e62-f95e-421d-865c-35b94ca32eff tempest-VolumesTestJSON-44031677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bafad78-883c-42a8-a305-6d6d7c0de364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:42:40 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4cfc7e62-f95e-421d-865c-35b94ca32eff tempest-VolumesTestJSON-44031677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bafad78-883c-42a8-a305-6d6d7c0de364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:42:40 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4cfc7e62-f95e-421d-865c-35b94ca32eff tempest-VolumesTestJSON-44031677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29edd16c-6b9e-4555-985f-66272945606b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:42:40 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4cfc7e62-f95e-421d-865c-35b94ca32eff tempest-VolumesTestJSON-44031677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29edd16c-6b9e-4555-985f-66272945606b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f99ad8fc-335d-46d5-a3d9-0c09f0e0a033', 'volume_name': 'volume-f99ad8fc-335d-46d5-a3d9-0c09f0e0a033', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:42:40 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4cfc7e62-f95e-421d-865c-35b94ca32eff tempest-VolumesTestJSON-44031677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8737a5f3-c2af-42a6-bc8f-1d2e430afc08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:42:40 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4cfc7e62-f95e-421d-865c-35b94ca32eff tempest-VolumesTestJSON-44031677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8737a5f3-c2af-42a6-bc8f-1d2e430afc08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:42:40 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4cfc7e62-f95e-421d-865c-35b94ca32eff tempest-VolumesTestJSON-44031677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4756f75-187c-4785-bea9-0b481fc9ea8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:42:40 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-4cfc7e62-f95e-421d-865c-35b94ca32eff tempest-VolumesTestJSON-44031677 None] Volume f99ad8fc-335d-46d5-a3d9-0c09f0e0a033: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f99ad8fc-335d-46d5-a3d9-0c09f0e0a033', 'volume_size': 1} Sep 25 11:42:40 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-4cfc7e62-f95e-421d-865c-35b94ca32eff tempest-VolumesTestJSON-44031677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:42:40 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-4cfc7e62-f95e-421d-865c-35b94ca32eff tempest-VolumesTestJSON-44031677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:42:40 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-4cfc7e62-f95e-421d-865c-35b94ca32eff tempest-VolumesTestJSON-44031677 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:42:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1907358239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f99ad8fc-335d-46d5-a3d9-0c09f0e0a033,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e0f531a27b5e4093a105b11a3f4b5b14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:42:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:42:41Z,use_quota=True,user_id='62a846c15076421ca33a95f655424a44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:42:40 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-4cfc7e62-f95e-421d-865c-35b94ca32eff tempest-VolumesTestJSON-44031677 None] Creating volume f99ad8fc-335d-46d5-a3d9-0c09f0e0a033 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:42:40 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-4cfc7e62-f95e-421d-865c-35b94ca32eff tempest-VolumesTestJSON-44031677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:42:40 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-4cfc7e62-f95e-421d-865c-35b94ca32eff tempest-VolumesTestJSON-44031677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:42:40 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-4cfc7e62-f95e-421d-865c-35b94ca32eff tempest-VolumesTestJSON-44031677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:42:40 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-4cfc7e62-f95e-421d-865c-35b94ca32eff tempest-VolumesTestJSON-44031677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:42:40 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-4cfc7e62-f95e-421d-865c-35b94ca32eff tempest-VolumesTestJSON-44031677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:42:40 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-4cfc7e62-f95e-421d-865c-35b94ca32eff tempest-VolumesTestJSON-44031677 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:42:40 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-4cfc7e62-f95e-421d-865c-35b94ca32eff tempest-VolumesTestJSON-44031677 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:42:40 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-4cfc7e62-f95e-421d-865c-35b94ca32eff tempest-VolumesTestJSON-44031677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f99ad8fc-335d-46d5-a3d9-0c09f0e0a033 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:42:40 devstack sudo[93081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f99ad8fc-335d-46d5-a3d9-0c09f0e0a033 1073741824 Sep 25 11:42:40 devstack sudo[93081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:42:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-92f21c9a-372f-49d6-8a35-948cb765dd21 req-fdd04bb8-fe16-436b-8e06-db0c4c514254 tempest-ServerActionsTestOtherA-778028304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:42:41 devstack sudo[93081]: pam_unix(sudo:session): session closed for user root Sep 25 11:42:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-4cfc7e62-f95e-421d-865c-35b94ca32eff tempest-VolumesTestJSON-44031677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f99ad8fc-335d-46d5-a3d9-0c09f0e0a033 1073741824" returned: 0 in 1.060s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:42:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-4cfc7e62-f95e-421d-865c-35b94ca32eff tempest-VolumesTestJSON-44031677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f99ad8fc-335d-46d5-a3d9-0c09f0e0a033 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:42:41 devstack sudo[93440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f99ad8fc-335d-46d5-a3d9-0c09f0e0a033 Sep 25 11:42:41 devstack sudo[93440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:42:42 devstack sudo[93440]: pam_unix(sudo:session): session closed for user root Sep 25 11:42:42 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-4cfc7e62-f95e-421d-865c-35b94ca32eff tempest-VolumesTestJSON-44031677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f99ad8fc-335d-46d5-a3d9-0c09f0e0a033" returned: 0 in 0.665s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:42:42 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-4cfc7e62-f95e-421d-865c-35b94ca32eff tempest-VolumesTestJSON-44031677 None] <== create_volume: return (1847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:42:42 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-4cfc7e62-f95e-421d-865c-35b94ca32eff tempest-VolumesTestJSON-44031677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.853s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:42:42 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-92f21c9a-372f-49d6-8a35-948cb765dd21 req-fdd04bb8-fe16-436b-8e06-db0c4c514254 tempest-ServerActionsTestOtherA-778028304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.507s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:42:42 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-92f21c9a-372f-49d6-8a35-948cb765dd21 req-fdd04bb8-fe16-436b-8e06-db0c4c514254 tempest-ServerActionsTestOtherA-778028304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.038s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:42:42 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4cfc7e62-f95e-421d-865c-35b94ca32eff tempest-VolumesTestJSON-44031677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4756f75-187c-4785-bea9-0b481fc9ea8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f99ad8fc-335d-46d5-a3d9-0c09f0e0a033', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:42:42 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4cfc7e62-f95e-421d-865c-35b94ca32eff tempest-VolumesTestJSON-44031677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1902dd8d-2d73-4a73-a75b-960a06a846a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:42:42 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-4cfc7e62-f95e-421d-865c-35b94ca32eff tempest-VolumesTestJSON-44031677 None] Volume volume-f99ad8fc-335d-46d5-a3d9-0c09f0e0a033 (f99ad8fc-335d-46d5-a3d9-0c09f0e0a033): created successfully Sep 25 11:42:42 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4cfc7e62-f95e-421d-865c-35b94ca32eff tempest-VolumesTestJSON-44031677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1902dd8d-2d73-4a73-a75b-960a06a846a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:42:42 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4cfc7e62-f95e-421d-865c-35b94ca32eff tempest-VolumesTestJSON-44031677 None] Flow 'volume_create_manager' (2c9d6b89-5ec7-454c-9a76-4e808baea9d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:42:42 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-4cfc7e62-f95e-421d-865c-35b94ca32eff tempest-VolumesTestJSON-44031677 None] Created volume successfully. Sep 25 11:42:42 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [req-92f21c9a-372f-49d6-8a35-948cb765dd21 req-fdd04bb8-fe16-436b-8e06-db0c4c514254 tempest-ServerActionsTestOtherA-778028304 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba', 'name': 'volume-2c7fe0de-db71-4bca-bbb7-1a149b8f4ffa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2cf090f2-48c8-46f7-9db1-67281b1d962d', 'enforce_multipath': True} {{(pid=86984) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 11:42:42 devstack cinder-volume[86984]: INFO cinder.volume.manager [req-92f21c9a-372f-49d6-8a35-948cb765dd21 req-fdd04bb8-fe16-436b-8e06-db0c4c514254 tempest-ServerActionsTestOtherA-778028304 None] attachment_update completed successfully. Sep 25 11:42:44 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d6c6b60-7f87-4ead-b2ab-606ac0a36e80 tempest-AttachVolumeNegativeTest-2039869332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:42:44 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4d6c6b60-7f87-4ead-b2ab-606ac0a36e80 tempest-AttachVolumeNegativeTest-2039869332 None] Flow 'volume_create_manager' (d8d8d2a0-24c8-49cf-9778-50b8f6062ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:42:44 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4d6c6b60-7f87-4ead-b2ab-606ac0a36e80 tempest-AttachVolumeNegativeTest-2039869332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6816fe42-400e-40b4-91da-63f2d6300ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:42:44 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4d6c6b60-7f87-4ead-b2ab-606ac0a36e80 tempest-AttachVolumeNegativeTest-2039869332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6816fe42-400e-40b4-91da-63f2d6300ade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:42:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-762223998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6992cfbc-0b7f-450e-915e-7567dfea7f8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa55515db8ae443fad5a3c89c67cb652',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:42:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:42:45Z,use_quota=True,user_id='36548203342a4f23961550f0f9060f1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:42:44 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4d6c6b60-7f87-4ead-b2ab-606ac0a36e80 tempest-AttachVolumeNegativeTest-2039869332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (673eed48-8632-442d-9658-d9707191c728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:42:44 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4d6c6b60-7f87-4ead-b2ab-606ac0a36e80 tempest-AttachVolumeNegativeTest-2039869332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (673eed48-8632-442d-9658-d9707191c728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:42:44 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4d6c6b60-7f87-4ead-b2ab-606ac0a36e80 tempest-AttachVolumeNegativeTest-2039869332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0934ae37-2f1b-48e7-8734-232a6b5fb3e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:42:44 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4d6c6b60-7f87-4ead-b2ab-606ac0a36e80 tempest-AttachVolumeNegativeTest-2039869332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0934ae37-2f1b-48e7-8734-232a6b5fb3e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6992cfbc-0b7f-450e-915e-7567dfea7f8c', 'volume_name': 'volume-6992cfbc-0b7f-450e-915e-7567dfea7f8c', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:42:45 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4d6c6b60-7f87-4ead-b2ab-606ac0a36e80 tempest-AttachVolumeNegativeTest-2039869332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53f1b4f5-7105-4738-937e-951ceaa54a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:42:45 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4d6c6b60-7f87-4ead-b2ab-606ac0a36e80 tempest-AttachVolumeNegativeTest-2039869332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53f1b4f5-7105-4738-937e-951ceaa54a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:42:45 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4d6c6b60-7f87-4ead-b2ab-606ac0a36e80 tempest-AttachVolumeNegativeTest-2039869332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ebc6e9f-59b4-4cc2-9e11-db73a7737a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:42:45 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-4d6c6b60-7f87-4ead-b2ab-606ac0a36e80 tempest-AttachVolumeNegativeTest-2039869332 None] Volume 6992cfbc-0b7f-450e-915e-7567dfea7f8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6992cfbc-0b7f-450e-915e-7567dfea7f8c', 'volume_size': 1} Sep 25 11:42:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-4d6c6b60-7f87-4ead-b2ab-606ac0a36e80 tempest-AttachVolumeNegativeTest-2039869332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:42:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-4d6c6b60-7f87-4ead-b2ab-606ac0a36e80 tempest-AttachVolumeNegativeTest-2039869332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:42:45 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-4d6c6b60-7f87-4ead-b2ab-606ac0a36e80 tempest-AttachVolumeNegativeTest-2039869332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:42:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-762223998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6992cfbc-0b7f-450e-915e-7567dfea7f8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa55515db8ae443fad5a3c89c67cb652',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:42:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:42:45Z,use_quota=True,user_id='36548203342a4f23961550f0f9060f1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:42:45 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-4d6c6b60-7f87-4ead-b2ab-606ac0a36e80 tempest-AttachVolumeNegativeTest-2039869332 None] Creating volume 6992cfbc-0b7f-450e-915e-7567dfea7f8c {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:42:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-4d6c6b60-7f87-4ead-b2ab-606ac0a36e80 tempest-AttachVolumeNegativeTest-2039869332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:42:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-4d6c6b60-7f87-4ead-b2ab-606ac0a36e80 tempest-AttachVolumeNegativeTest-2039869332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:42:45 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-4d6c6b60-7f87-4ead-b2ab-606ac0a36e80 tempest-AttachVolumeNegativeTest-2039869332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:42:45 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-4d6c6b60-7f87-4ead-b2ab-606ac0a36e80 tempest-AttachVolumeNegativeTest-2039869332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:42:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-4d6c6b60-7f87-4ead-b2ab-606ac0a36e80 tempest-AttachVolumeNegativeTest-2039869332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:42:45 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-4d6c6b60-7f87-4ead-b2ab-606ac0a36e80 tempest-AttachVolumeNegativeTest-2039869332 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:42:45 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-4d6c6b60-7f87-4ead-b2ab-606ac0a36e80 tempest-AttachVolumeNegativeTest-2039869332 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:42:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-4d6c6b60-7f87-4ead-b2ab-606ac0a36e80 tempest-AttachVolumeNegativeTest-2039869332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6992cfbc-0b7f-450e-915e-7567dfea7f8c 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:42:45 devstack sudo[93498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6992cfbc-0b7f-450e-915e-7567dfea7f8c 1073741824 Sep 25 11:42:45 devstack sudo[93498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:42:45 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-73434f3e-3f72-4eed-8a05-fe1fa7277c2b tempest-VolumesTestJSON-44031677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:42:45 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-73434f3e-3f72-4eed-8a05-fe1fa7277c2b tempest-VolumesTestJSON-44031677 None] Flow 'volume_create_manager' (3f1f2071-4112-418b-a4bc-fdf9cda0ba8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:42:45 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-73434f3e-3f72-4eed-8a05-fe1fa7277c2b tempest-VolumesTestJSON-44031677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d183cd57-7080-4238-853e-4c279ecaeb51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:42:45 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-73434f3e-3f72-4eed-8a05-fe1fa7277c2b tempest-VolumesTestJSON-44031677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d183cd57-7080-4238-853e-4c279ecaeb51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:42:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1621053352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13847ac1-cd57-46b4-98fe-c297d96da538,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e0f531a27b5e4093a105b11a3f4b5b14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:42:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:42:45Z,use_quota=True,user_id='62a846c15076421ca33a95f655424a44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:42:45 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-73434f3e-3f72-4eed-8a05-fe1fa7277c2b tempest-VolumesTestJSON-44031677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce926560-4c66-4ccb-95f0-2484291da404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:42:45 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-73434f3e-3f72-4eed-8a05-fe1fa7277c2b tempest-VolumesTestJSON-44031677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce926560-4c66-4ccb-95f0-2484291da404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:42:45 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-73434f3e-3f72-4eed-8a05-fe1fa7277c2b tempest-VolumesTestJSON-44031677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6f6ac11-96f3-4a5e-bdec-d76576b5ae92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:42:45 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-73434f3e-3f72-4eed-8a05-fe1fa7277c2b tempest-VolumesTestJSON-44031677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6f6ac11-96f3-4a5e-bdec-d76576b5ae92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13847ac1-cd57-46b4-98fe-c297d96da538', 'volume_name': 'volume-13847ac1-cd57-46b4-98fe-c297d96da538', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:42:45 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-73434f3e-3f72-4eed-8a05-fe1fa7277c2b tempest-VolumesTestJSON-44031677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77470dae-dade-41c1-a0de-f4255e7eebaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:42:45 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-73434f3e-3f72-4eed-8a05-fe1fa7277c2b tempest-VolumesTestJSON-44031677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77470dae-dade-41c1-a0de-f4255e7eebaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:42:45 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-73434f3e-3f72-4eed-8a05-fe1fa7277c2b tempest-VolumesTestJSON-44031677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a369e7d5-5567-41be-951c-12f678b73e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:42:45 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-73434f3e-3f72-4eed-8a05-fe1fa7277c2b tempest-VolumesTestJSON-44031677 None] Volume 13847ac1-cd57-46b4-98fe-c297d96da538: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13847ac1-cd57-46b4-98fe-c297d96da538', 'volume_size': 1} Sep 25 11:42:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-73434f3e-3f72-4eed-8a05-fe1fa7277c2b tempest-VolumesTestJSON-44031677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:42:45 devstack sudo[93498]: pam_unix(sudo:session): session closed for user root Sep 25 11:42:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-4d6c6b60-7f87-4ead-b2ab-606ac0a36e80 tempest-AttachVolumeNegativeTest-2039869332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6992cfbc-0b7f-450e-915e-7567dfea7f8c 1073741824" returned: 0 in 0.703s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:42:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-4d6c6b60-7f87-4ead-b2ab-606ac0a36e80 tempest-AttachVolumeNegativeTest-2039869332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6992cfbc-0b7f-450e-915e-7567dfea7f8c {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:42:45 devstack sudo[93506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6992cfbc-0b7f-450e-915e-7567dfea7f8c Sep 25 11:42:45 devstack sudo[93506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:42:46 devstack sudo[93506]: pam_unix(sudo:session): session closed for user root Sep 25 11:42:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-4d6c6b60-7f87-4ead-b2ab-606ac0a36e80 tempest-AttachVolumeNegativeTest-2039869332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6992cfbc-0b7f-450e-915e-7567dfea7f8c" returned: 0 in 0.505s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:42:46 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-4d6c6b60-7f87-4ead-b2ab-606ac0a36e80 tempest-AttachVolumeNegativeTest-2039869332 None] <== create_volume: return (1274ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:42:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-4d6c6b60-7f87-4ead-b2ab-606ac0a36e80 tempest-AttachVolumeNegativeTest-2039869332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.277s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:42:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-73434f3e-3f72-4eed-8a05-fe1fa7277c2b tempest-VolumesTestJSON-44031677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.940s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:42:46 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-73434f3e-3f72-4eed-8a05-fe1fa7277c2b tempest-VolumesTestJSON-44031677 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:42:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1621053352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13847ac1-cd57-46b4-98fe-c297d96da538,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e0f531a27b5e4093a105b11a3f4b5b14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:42:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:42:45Z,use_quota=True,user_id='62a846c15076421ca33a95f655424a44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:42:46 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-73434f3e-3f72-4eed-8a05-fe1fa7277c2b tempest-VolumesTestJSON-44031677 None] Creating volume 13847ac1-cd57-46b4-98fe-c297d96da538 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:42:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-73434f3e-3f72-4eed-8a05-fe1fa7277c2b tempest-VolumesTestJSON-44031677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:42:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-73434f3e-3f72-4eed-8a05-fe1fa7277c2b tempest-VolumesTestJSON-44031677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:42:46 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-73434f3e-3f72-4eed-8a05-fe1fa7277c2b tempest-VolumesTestJSON-44031677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:42:46 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-73434f3e-3f72-4eed-8a05-fe1fa7277c2b tempest-VolumesTestJSON-44031677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:42:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-73434f3e-3f72-4eed-8a05-fe1fa7277c2b tempest-VolumesTestJSON-44031677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:42:46 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-73434f3e-3f72-4eed-8a05-fe1fa7277c2b tempest-VolumesTestJSON-44031677 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:42:46 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-73434f3e-3f72-4eed-8a05-fe1fa7277c2b tempest-VolumesTestJSON-44031677 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:42:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-73434f3e-3f72-4eed-8a05-fe1fa7277c2b tempest-VolumesTestJSON-44031677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-13847ac1-cd57-46b4-98fe-c297d96da538 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:42:46 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4d6c6b60-7f87-4ead-b2ab-606ac0a36e80 tempest-AttachVolumeNegativeTest-2039869332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ebc6e9f-59b4-4cc2-9e11-db73a7737a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6992cfbc-0b7f-450e-915e-7567dfea7f8c', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:42:46 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4d6c6b60-7f87-4ead-b2ab-606ac0a36e80 tempest-AttachVolumeNegativeTest-2039869332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32707b9d-74e2-40d2-a8b7-2fa05006561e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:42:46 devstack sudo[93509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-13847ac1-cd57-46b4-98fe-c297d96da538 1073741824 Sep 25 11:42:46 devstack sudo[93509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:42:46 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-4d6c6b60-7f87-4ead-b2ab-606ac0a36e80 tempest-AttachVolumeNegativeTest-2039869332 None] Volume volume-6992cfbc-0b7f-450e-915e-7567dfea7f8c (6992cfbc-0b7f-450e-915e-7567dfea7f8c): created successfully Sep 25 11:42:46 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4d6c6b60-7f87-4ead-b2ab-606ac0a36e80 tempest-AttachVolumeNegativeTest-2039869332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32707b9d-74e2-40d2-a8b7-2fa05006561e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:42:46 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4d6c6b60-7f87-4ead-b2ab-606ac0a36e80 tempest-AttachVolumeNegativeTest-2039869332 None] Flow 'volume_create_manager' (d8d8d2a0-24c8-49cf-9778-50b8f6062ad1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:42:46 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-4d6c6b60-7f87-4ead-b2ab-606ac0a36e80 tempest-AttachVolumeNegativeTest-2039869332 None] Created volume successfully. Sep 25 11:42:47 devstack sudo[93509]: pam_unix(sudo:session): session closed for user root Sep 25 11:42:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-73434f3e-3f72-4eed-8a05-fe1fa7277c2b tempest-VolumesTestJSON-44031677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-13847ac1-cd57-46b4-98fe-c297d96da538 1073741824" returned: 0 in 0.886s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:42:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-73434f3e-3f72-4eed-8a05-fe1fa7277c2b tempest-VolumesTestJSON-44031677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-13847ac1-cd57-46b4-98fe-c297d96da538 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:42:47 devstack sudo[93523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-13847ac1-cd57-46b4-98fe-c297d96da538 Sep 25 11:42:47 devstack sudo[93523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:42:47 devstack sudo[93523]: pam_unix(sudo:session): session closed for user root Sep 25 11:42:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-73434f3e-3f72-4eed-8a05-fe1fa7277c2b tempest-VolumesTestJSON-44031677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-13847ac1-cd57-46b4-98fe-c297d96da538" returned: 0 in 0.634s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:42:47 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-73434f3e-3f72-4eed-8a05-fe1fa7277c2b tempest-VolumesTestJSON-44031677 None] <== create_volume: return (1641ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:42:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-73434f3e-3f72-4eed-8a05-fe1fa7277c2b tempest-VolumesTestJSON-44031677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.647s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:42:47 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-73434f3e-3f72-4eed-8a05-fe1fa7277c2b tempest-VolumesTestJSON-44031677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a369e7d5-5567-41be-951c-12f678b73e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13847ac1-cd57-46b4-98fe-c297d96da538', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:42:48 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-73434f3e-3f72-4eed-8a05-fe1fa7277c2b tempest-VolumesTestJSON-44031677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3a198df-ea80-4df7-b657-c6e8bdf7a8e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:42:48 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-73434f3e-3f72-4eed-8a05-fe1fa7277c2b tempest-VolumesTestJSON-44031677 None] Volume volume-13847ac1-cd57-46b4-98fe-c297d96da538 (13847ac1-cd57-46b4-98fe-c297d96da538): created successfully Sep 25 11:42:48 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-73434f3e-3f72-4eed-8a05-fe1fa7277c2b tempest-VolumesTestJSON-44031677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3a198df-ea80-4df7-b657-c6e8bdf7a8e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:42:48 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-73434f3e-3f72-4eed-8a05-fe1fa7277c2b tempest-VolumesTestJSON-44031677 None] Flow 'volume_create_manager' (3f1f2071-4112-418b-a4bc-fdf9cda0ba8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:42:48 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-73434f3e-3f72-4eed-8a05-fe1fa7277c2b tempest-VolumesTestJSON-44031677 None] Created volume successfully. Sep 25 11:42:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-461f707e-d856-4a02-a4d0-2ef7fcb4e038 req-8c0d7c10-7e43-4d2e-9886-4ba063f45e32 tempest-AttachVolumeNegativeTest-2039869332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:42:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-461f707e-d856-4a02-a4d0-2ef7fcb4e038 req-8c0d7c10-7e43-4d2e-9886-4ba063f45e32 tempest-AttachVolumeNegativeTest-2039869332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:42:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-461f707e-d856-4a02-a4d0-2ef7fcb4e038 req-8c0d7c10-7e43-4d2e-9886-4ba063f45e32 tempest-AttachVolumeNegativeTest-2039869332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:42:48 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [req-461f707e-d856-4a02-a4d0-2ef7fcb4e038 req-8c0d7c10-7e43-4d2e-9886-4ba063f45e32 tempest-AttachVolumeNegativeTest-2039869332 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba', 'name': 'volume-6992cfbc-0b7f-450e-915e-7567dfea7f8c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c3b15da7-7caf-4c4b-b6b5-3e01aaac449b', 'enforce_multipath': True} {{(pid=86984) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 11:42:48 devstack cinder-volume[86984]: INFO cinder.volume.manager [req-461f707e-d856-4a02-a4d0-2ef7fcb4e038 req-8c0d7c10-7e43-4d2e-9886-4ba063f45e32 tempest-AttachVolumeNegativeTest-2039869332 None] attachment_update completed successfully. Sep 25 11:42:48 devstack cinder-volume[86984]: INFO cinder.volume.manager [req-de75ac5b-d820-456c-8123-8d53390c9b4a req-08e67530-4255-460f-951e-64211c330acb tempest-ServerActionsTestOtherA-778028304 None] Terminate volume connection completed successfully. Sep 25 11:42:48 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [req-de75ac5b-d820-456c-8123-8d53390c9b4a req-08e67530-4255-460f-951e-64211c330acb tempest-ServerActionsTestOtherA-778028304 None] Deleting attachment 2cf090f2-48c8-46f7-9db1-67281b1d962d. {{(pid=86984) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 11:42:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-de75ac5b-d820-456c-8123-8d53390c9b4a req-2691ca2a-d085-49c7-acc2-5cf9dc581902 tempest-ServerActionsTestOtherA-778028304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:42:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-de75ac5b-d820-456c-8123-8d53390c9b4a req-2691ca2a-d085-49c7-acc2-5cf9dc581902 tempest-ServerActionsTestOtherA-778028304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:42:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-de75ac5b-d820-456c-8123-8d53390c9b4a req-2691ca2a-d085-49c7-acc2-5cf9dc581902 tempest-ServerActionsTestOtherA-778028304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:42:50 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [req-de75ac5b-d820-456c-8123-8d53390c9b4a req-2691ca2a-d085-49c7-acc2-5cf9dc581902 tempest-ServerActionsTestOtherA-778028304 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba', 'name': 'volume-2c7fe0de-db71-4bca-bbb7-1a149b8f4ffa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '776eac97-ffd2-4c4a-a82d-e6935dd7549b', 'enforce_multipath': True} {{(pid=86984) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 11:42:51 devstack cinder-volume[86984]: INFO cinder.volume.manager [req-de75ac5b-d820-456c-8123-8d53390c9b4a req-2691ca2a-d085-49c7-acc2-5cf9dc581902 tempest-ServerActionsTestOtherA-778028304 None] attachment_update completed successfully. Sep 25 11:42:51 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-4a3d1395-3f9f-4066-beda-bfd41fca3da9 tempest-VolumesTestJSON-44031677 None] Acquiring lock "cinder-13847ac1-cd57-46b4-98fe-c297d96da538-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:42:51 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-4a3d1395-3f9f-4066-beda-bfd41fca3da9 tempest-VolumesTestJSON-44031677 None] Lock "cinder-13847ac1-cd57-46b4-98fe-c297d96da538-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:42:51 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-4a3d1395-3f9f-4066-beda-bfd41fca3da9 tempest-VolumesTestJSON-44031677 None] Acquiring lock "cinder-quobyte-13847ac1-cd57-46b4-98fe-c297d96da538" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:42:51 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-4a3d1395-3f9f-4066-beda-bfd41fca3da9 tempest-VolumesTestJSON-44031677 None] Lock "cinder-quobyte-13847ac1-cd57-46b4-98fe-c297d96da538" acquired by "delete_volume" :: waited 0.039s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:42:51 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[021c8e8c-aefc-46fd-a0ad-4b6036d60a62]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:42:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-4a3d1395-3f9f-4066-beda-bfd41fca3da9 tempest-VolumesTestJSON-44031677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-13847ac1-cd57-46b4-98fe-c297d96da538 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:42:51 devstack sudo[93579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-13847ac1-cd57-46b4-98fe-c297d96da538 Sep 25 11:42:51 devstack sudo[93579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:42:51 devstack sudo[93579]: pam_unix(sudo:session): session closed for user root Sep 25 11:42:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-4a3d1395-3f9f-4066-beda-bfd41fca3da9 tempest-VolumesTestJSON-44031677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-13847ac1-cd57-46b4-98fe-c297d96da538" returned: 0 in 0.632s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:42:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-4a3d1395-3f9f-4066-beda-bfd41fca3da9 tempest-VolumesTestJSON-44031677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-13847ac1-cd57-46b4-98fe-c297d96da538 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:42:52 devstack sudo[93589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-13847ac1-cd57-46b4-98fe-c297d96da538 Sep 25 11:42:52 devstack sudo[93589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:42:52 devstack sudo[93589]: pam_unix(sudo:session): session closed for user root Sep 25 11:42:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-4a3d1395-3f9f-4066-beda-bfd41fca3da9 tempest-VolumesTestJSON-44031677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-13847ac1-cd57-46b4-98fe-c297d96da538" returned: 0 in 0.558s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:42:52 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-4a3d1395-3f9f-4066-beda-bfd41fca3da9 tempest-VolumesTestJSON-44031677 None] Lock "cinder-quobyte-13847ac1-cd57-46b4-98fe-c297d96da538" released by "delete_volume" :: held 1.283s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:42:52 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-4a3d1395-3f9f-4066-beda-bfd41fca3da9 tempest-VolumesTestJSON-44031677 None] Created reservations ['949eec3e-13d3-41eb-a328-367724c5c3e5', 'aa16a3bf-c807-4c28-b9a3-d5d006d487d5', 'e515f44a-3bd3-4dd7-b915-b211464bb258', '245173da-c5ac-4102-9914-4b0524747f6c'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:42:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-4a3d1395-3f9f-4066-beda-bfd41fca3da9 tempest-VolumesTestJSON-44031677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:42:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-4a3d1395-3f9f-4066-beda-bfd41fca3da9 tempest-VolumesTestJSON-44031677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:42:52 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-4a3d1395-3f9f-4066-beda-bfd41fca3da9 tempest-VolumesTestJSON-44031677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:42:52 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-4a3d1395-3f9f-4066-beda-bfd41fca3da9 tempest-VolumesTestJSON-44031677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:42:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-4a3d1395-3f9f-4066-beda-bfd41fca3da9 tempest-VolumesTestJSON-44031677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:42:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-4a3d1395-3f9f-4066-beda-bfd41fca3da9 tempest-VolumesTestJSON-44031677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:42:52 devstack sudo[93611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:42:52 devstack sudo[93611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:42:52 devstack cinder-volume[86984]: INFO cinder.volume.manager [req-46ec04c7-3f2f-4b85-b7ef-4f35531a405f req-b3bf12d2-da85-4c47-955d-11f79a6378f7 tempest-AttachVolumeNegativeTest-2039869332 None] Terminate volume connection completed successfully. Sep 25 11:42:52 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [req-46ec04c7-3f2f-4b85-b7ef-4f35531a405f req-b3bf12d2-da85-4c47-955d-11f79a6378f7 tempest-AttachVolumeNegativeTest-2039869332 None] Deleting attachment c3b15da7-7caf-4c4b-b6b5-3e01aaac449b. {{(pid=86984) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 11:42:53 devstack sudo[93611]: pam_unix(sudo:session): session closed for user root Sep 25 11:42:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-4a3d1395-3f9f-4066-beda-bfd41fca3da9 tempest-VolumesTestJSON-44031677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.600s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:42:53 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-4a3d1395-3f9f-4066-beda-bfd41fca3da9 tempest-VolumesTestJSON-44031677 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:42:53 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-4a3d1395-3f9f-4066-beda-bfd41fca3da9 tempest-VolumesTestJSON-44031677 None] Deleted volume successfully. Sep 25 11:42:53 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-4a3d1395-3f9f-4066-beda-bfd41fca3da9 tempest-VolumesTestJSON-44031677 None] Lock "cinder-13847ac1-cd57-46b4-98fe-c297d96da538-delete_volume" released by "delete_volume" :: held 2.339s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:42:53 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-7112dbb9-568a-4f2e-b194-e79a2885c006 tempest-VolumesTestJSON-44031677 None] Acquiring lock "cinder-f99ad8fc-335d-46d5-a3d9-0c09f0e0a033-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:42:53 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-7112dbb9-568a-4f2e-b194-e79a2885c006 tempest-VolumesTestJSON-44031677 None] Lock "cinder-f99ad8fc-335d-46d5-a3d9-0c09f0e0a033-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:42:53 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-7112dbb9-568a-4f2e-b194-e79a2885c006 tempest-VolumesTestJSON-44031677 None] Acquiring lock "cinder-quobyte-f99ad8fc-335d-46d5-a3d9-0c09f0e0a033" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:42:53 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-7112dbb9-568a-4f2e-b194-e79a2885c006 tempest-VolumesTestJSON-44031677 None] Lock "cinder-quobyte-f99ad8fc-335d-46d5-a3d9-0c09f0e0a033" acquired by "delete_volume" :: waited 0.028s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:42:53 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b210d2-701c-44e9-b19b-9dabe9d89f92]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:42:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7112dbb9-568a-4f2e-b194-e79a2885c006 tempest-VolumesTestJSON-44031677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f99ad8fc-335d-46d5-a3d9-0c09f0e0a033 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:42:54 devstack sudo[93638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f99ad8fc-335d-46d5-a3d9-0c09f0e0a033 Sep 25 11:42:54 devstack sudo[93638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:42:54 devstack sudo[93638]: pam_unix(sudo:session): session closed for user root Sep 25 11:42:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7112dbb9-568a-4f2e-b194-e79a2885c006 tempest-VolumesTestJSON-44031677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f99ad8fc-335d-46d5-a3d9-0c09f0e0a033" returned: 0 in 0.679s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:42:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7112dbb9-568a-4f2e-b194-e79a2885c006 tempest-VolumesTestJSON-44031677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f99ad8fc-335d-46d5-a3d9-0c09f0e0a033 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:42:54 devstack sudo[93651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f99ad8fc-335d-46d5-a3d9-0c09f0e0a033 Sep 25 11:42:54 devstack sudo[93651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:42:55 devstack sudo[93651]: pam_unix(sudo:session): session closed for user root Sep 25 11:42:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7112dbb9-568a-4f2e-b194-e79a2885c006 tempest-VolumesTestJSON-44031677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f99ad8fc-335d-46d5-a3d9-0c09f0e0a033" returned: 0 in 0.676s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:42:55 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-7112dbb9-568a-4f2e-b194-e79a2885c006 tempest-VolumesTestJSON-44031677 None] Lock "cinder-quobyte-f99ad8fc-335d-46d5-a3d9-0c09f0e0a033" released by "delete_volume" :: held 1.446s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:42:55 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-7112dbb9-568a-4f2e-b194-e79a2885c006 tempest-VolumesTestJSON-44031677 None] Created reservations ['ce252ee5-fb98-4b75-bc09-1120b29c9902', '11d1aa5b-4608-4d43-a536-5b9f2b497b21', '0cac1b72-d778-402c-9076-732b17a9b0b0', 'fd95ea5f-dc2f-4898-a179-d86ab93b5a2c'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:42:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-7112dbb9-568a-4f2e-b194-e79a2885c006 tempest-VolumesTestJSON-44031677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:42:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-7112dbb9-568a-4f2e-b194-e79a2885c006 tempest-VolumesTestJSON-44031677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:42:55 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-7112dbb9-568a-4f2e-b194-e79a2885c006 tempest-VolumesTestJSON-44031677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:42:55 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-7112dbb9-568a-4f2e-b194-e79a2885c006 tempest-VolumesTestJSON-44031677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:42:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-7112dbb9-568a-4f2e-b194-e79a2885c006 tempest-VolumesTestJSON-44031677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:42:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7112dbb9-568a-4f2e-b194-e79a2885c006 tempest-VolumesTestJSON-44031677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:42:55 devstack sudo[93676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:42:55 devstack sudo[93676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:42:56 devstack sudo[93676]: pam_unix(sudo:session): session closed for user root Sep 25 11:42:56 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f7c43f3b-7c07-4a7b-a1c8-5f8338677e86 tempest-VolumesTestJSON-44031677 None] Acquiring lock "cinder-0cf05360-126c-479b-b0ff-913b0a8ba089-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:42:56 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7112dbb9-568a-4f2e-b194-e79a2885c006 tempest-VolumesTestJSON-44031677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.764s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:42:56 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-7112dbb9-568a-4f2e-b194-e79a2885c006 tempest-VolumesTestJSON-44031677 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:42:56 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-7112dbb9-568a-4f2e-b194-e79a2885c006 tempest-VolumesTestJSON-44031677 None] Deleted volume successfully. Sep 25 11:42:56 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f7c43f3b-7c07-4a7b-a1c8-5f8338677e86 tempest-VolumesTestJSON-44031677 None] Lock "cinder-0cf05360-126c-479b-b0ff-913b0a8ba089-delete_volume" acquired by "delete_volume" :: waited 0.092s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:42:56 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-7112dbb9-568a-4f2e-b194-e79a2885c006 tempest-VolumesTestJSON-44031677 None] Lock "cinder-f99ad8fc-335d-46d5-a3d9-0c09f0e0a033-delete_volume" released by "delete_volume" :: held 2.727s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:42:56 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f7c43f3b-7c07-4a7b-a1c8-5f8338677e86 tempest-VolumesTestJSON-44031677 None] Acquiring lock "cinder-quobyte-0cf05360-126c-479b-b0ff-913b0a8ba089" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:42:56 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f7c43f3b-7c07-4a7b-a1c8-5f8338677e86 tempest-VolumesTestJSON-44031677 None] Lock "cinder-quobyte-0cf05360-126c-479b-b0ff-913b0a8ba089" acquired by "delete_volume" :: waited 0.035s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:42:56 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f4b37f6-4414-4dce-9a7a-1eda43af873e]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:42:56 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f7c43f3b-7c07-4a7b-a1c8-5f8338677e86 tempest-VolumesTestJSON-44031677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0cf05360-126c-479b-b0ff-913b0a8ba089 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:42:56 devstack sudo[93704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0cf05360-126c-479b-b0ff-913b0a8ba089 Sep 25 11:42:56 devstack sudo[93704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:42:57 devstack sudo[93704]: pam_unix(sudo:session): session closed for user root Sep 25 11:42:57 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f7c43f3b-7c07-4a7b-a1c8-5f8338677e86 tempest-VolumesTestJSON-44031677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0cf05360-126c-479b-b0ff-913b0a8ba089" returned: 0 in 1.213s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:42:57 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f7c43f3b-7c07-4a7b-a1c8-5f8338677e86 tempest-VolumesTestJSON-44031677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0cf05360-126c-479b-b0ff-913b0a8ba089 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:42:57 devstack sudo[93711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0cf05360-126c-479b-b0ff-913b0a8ba089 Sep 25 11:42:57 devstack sudo[93711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:42:58 devstack sudo[93711]: pam_unix(sudo:session): session closed for user root Sep 25 11:42:58 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f7c43f3b-7c07-4a7b-a1c8-5f8338677e86 tempest-VolumesTestJSON-44031677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0cf05360-126c-479b-b0ff-913b0a8ba089" returned: 0 in 0.620s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:42:58 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f7c43f3b-7c07-4a7b-a1c8-5f8338677e86 tempest-VolumesTestJSON-44031677 None] Lock "cinder-quobyte-0cf05360-126c-479b-b0ff-913b0a8ba089" released by "delete_volume" :: held 1.978s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:42:58 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-f7c43f3b-7c07-4a7b-a1c8-5f8338677e86 tempest-VolumesTestJSON-44031677 None] Created reservations ['8f9a4e42-2090-4020-befe-ce12b3b96732', '704be6de-d6a7-4bdc-914f-f2d8aa7aeedf', 'fe37b20b-a44a-43e5-9583-0c059f962b5d', '29cc4d9b-bea3-4c8e-979e-2aecf6d80963'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:42:59 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f7c43f3b-7c07-4a7b-a1c8-5f8338677e86 tempest-VolumesTestJSON-44031677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:42:59 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f7c43f3b-7c07-4a7b-a1c8-5f8338677e86 tempest-VolumesTestJSON-44031677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:42:59 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-f7c43f3b-7c07-4a7b-a1c8-5f8338677e86 tempest-VolumesTestJSON-44031677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:42:59 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-f7c43f3b-7c07-4a7b-a1c8-5f8338677e86 tempest-VolumesTestJSON-44031677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:42:59 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f7c43f3b-7c07-4a7b-a1c8-5f8338677e86 tempest-VolumesTestJSON-44031677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:42:59 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f7c43f3b-7c07-4a7b-a1c8-5f8338677e86 tempest-VolumesTestJSON-44031677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:42:59 devstack sudo[93716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:42:59 devstack sudo[93716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:42:59 devstack sudo[93716]: pam_unix(sudo:session): session closed for user root Sep 25 11:42:59 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f7c43f3b-7c07-4a7b-a1c8-5f8338677e86 tempest-VolumesTestJSON-44031677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.817s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:42:59 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-f7c43f3b-7c07-4a7b-a1c8-5f8338677e86 tempest-VolumesTestJSON-44031677 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:42:59 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-f7c43f3b-7c07-4a7b-a1c8-5f8338677e86 tempest-VolumesTestJSON-44031677 None] Deleted volume successfully. Sep 25 11:43:00 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f7c43f3b-7c07-4a7b-a1c8-5f8338677e86 tempest-VolumesTestJSON-44031677 None] Lock "cinder-0cf05360-126c-479b-b0ff-913b0a8ba089-delete_volume" released by "delete_volume" :: held 3.554s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:43:06 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-4ffdcbce-c627-4ec0-871a-5ca780fb6bd9 tempest-GroupSnapshotsTest-122027651 None] Group tempest-GroupSnapshotsTest-Group-511108880: creating Sep 25 11:43:06 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-4ffdcbce-c627-4ec0-871a-5ca780fb6bd9 tempest-GroupSnapshotsTest-122027651 None] Group tempest-GroupSnapshotsTest-Group-511108880: created successfully Sep 25 11:43:06 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-4ffdcbce-c627-4ec0-871a-5ca780fb6bd9 tempest-GroupSnapshotsTest-122027651 None] Create group completed successfully. Sep 25 11:43:08 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-72bf2d55-6f3e-4e6f-9794-10fb20f83f34 tempest-GroupSnapshotsTest-122027651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:43:08 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-72bf2d55-6f3e-4e6f-9794-10fb20f83f34 tempest-GroupSnapshotsTest-122027651 None] Flow 'volume_create_manager' (7f10bde1-4ed9-4302-a304-68b7fb6a4cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:43:08 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-72bf2d55-6f3e-4e6f-9794-10fb20f83f34 tempest-GroupSnapshotsTest-122027651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (837e2222-ec8e-41e9-8f8e-567b7da9488d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:43:08 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-72bf2d55-6f3e-4e6f-9794-10fb20f83f34 tempest-GroupSnapshotsTest-122027651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (837e2222-ec8e-41e9-8f8e-567b7da9488d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:43:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2095878432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=aec79a34-09b6-4f79-a238-30d501eb0533,host='devstack@QuobyteHD#QuobyteHD',id=14f93866-c5c4-4e7e-bf26-b492c59abd8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9d9f0643087407bbcbcdcc879f8e8b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:43:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:43:09Z,use_quota=True,user_id='17a666ec9d3d49519f3f9c6284176a33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0aa315b-2e09-4c81-9cd6-07d5fcce2f1f),volume_type_id=e0aa315b-2e09-4c81-9cd6-07d5fcce2f1f)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:43:08 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-72bf2d55-6f3e-4e6f-9794-10fb20f83f34 tempest-GroupSnapshotsTest-122027651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6aee8991-40c9-4533-9bfd-e103d545eb79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:43:08 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-72bf2d55-6f3e-4e6f-9794-10fb20f83f34 tempest-GroupSnapshotsTest-122027651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6aee8991-40c9-4533-9bfd-e103d545eb79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:43:08 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-72bf2d55-6f3e-4e6f-9794-10fb20f83f34 tempest-GroupSnapshotsTest-122027651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93b8c2e0-8488-4ffd-92f2-0bb538db7ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:43:08 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-72bf2d55-6f3e-4e6f-9794-10fb20f83f34 tempest-GroupSnapshotsTest-122027651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93b8c2e0-8488-4ffd-92f2-0bb538db7ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14f93866-c5c4-4e7e-bf26-b492c59abd8b', 'volume_name': 'volume-14f93866-c5c4-4e7e-bf26-b492c59abd8b', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:43:08 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-72bf2d55-6f3e-4e6f-9794-10fb20f83f34 tempest-GroupSnapshotsTest-122027651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c4414eb-6f53-42f7-85e1-a81bee4ecc52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:43:08 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-72bf2d55-6f3e-4e6f-9794-10fb20f83f34 tempest-GroupSnapshotsTest-122027651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c4414eb-6f53-42f7-85e1-a81bee4ecc52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:43:08 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-72bf2d55-6f3e-4e6f-9794-10fb20f83f34 tempest-GroupSnapshotsTest-122027651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6811ec88-47b8-48a8-900d-5339b36c73b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:43:08 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-72bf2d55-6f3e-4e6f-9794-10fb20f83f34 tempest-GroupSnapshotsTest-122027651 None] Volume 14f93866-c5c4-4e7e-bf26-b492c59abd8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14f93866-c5c4-4e7e-bf26-b492c59abd8b', 'volume_size': 1} Sep 25 11:43:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-72bf2d55-6f3e-4e6f-9794-10fb20f83f34 tempest-GroupSnapshotsTest-122027651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:43:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-72bf2d55-6f3e-4e6f-9794-10fb20f83f34 tempest-GroupSnapshotsTest-122027651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:43:09 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-72bf2d55-6f3e-4e6f-9794-10fb20f83f34 tempest-GroupSnapshotsTest-122027651 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=aec79a34-09b6-4f79-a238-30d501eb0533,created_at=2026-09-25T09:43:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2095878432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=aec79a34-09b6-4f79-a238-30d501eb0533,host='devstack@QuobyteHD#QuobyteHD',id=14f93866-c5c4-4e7e-bf26-b492c59abd8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9d9f0643087407bbcbcdcc879f8e8b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:43:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:43:09Z,use_quota=True,user_id='17a666ec9d3d49519f3f9c6284176a33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0aa315b-2e09-4c81-9cd6-07d5fcce2f1f),volume_type_id=e0aa315b-2e09-4c81-9cd6-07d5fcce2f1f)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:43:09 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-72bf2d55-6f3e-4e6f-9794-10fb20f83f34 tempest-GroupSnapshotsTest-122027651 None] Creating volume 14f93866-c5c4-4e7e-bf26-b492c59abd8b {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:43:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-72bf2d55-6f3e-4e6f-9794-10fb20f83f34 tempest-GroupSnapshotsTest-122027651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:43:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-72bf2d55-6f3e-4e6f-9794-10fb20f83f34 tempest-GroupSnapshotsTest-122027651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:43:09 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-72bf2d55-6f3e-4e6f-9794-10fb20f83f34 tempest-GroupSnapshotsTest-122027651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:43:09 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-72bf2d55-6f3e-4e6f-9794-10fb20f83f34 tempest-GroupSnapshotsTest-122027651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:43:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-72bf2d55-6f3e-4e6f-9794-10fb20f83f34 tempest-GroupSnapshotsTest-122027651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:43:09 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-72bf2d55-6f3e-4e6f-9794-10fb20f83f34 tempest-GroupSnapshotsTest-122027651 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:43:09 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-72bf2d55-6f3e-4e6f-9794-10fb20f83f34 tempest-GroupSnapshotsTest-122027651 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:43:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-72bf2d55-6f3e-4e6f-9794-10fb20f83f34 tempest-GroupSnapshotsTest-122027651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-14f93866-c5c4-4e7e-bf26-b492c59abd8b 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:43:09 devstack sudo[93757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-14f93866-c5c4-4e7e-bf26-b492c59abd8b 1073741824 Sep 25 11:43:09 devstack sudo[93757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:43:10 devstack sudo[93757]: pam_unix(sudo:session): session closed for user root Sep 25 11:43:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-72bf2d55-6f3e-4e6f-9794-10fb20f83f34 tempest-GroupSnapshotsTest-122027651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-14f93866-c5c4-4e7e-bf26-b492c59abd8b 1073741824" returned: 0 in 1.187s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:43:10 devstack cinder-volume[86984]: DEBUG dbcounter [-] [86984] Writing DB stats cinder:SELECT=58,cinder:UPDATE=57,cinder:INSERT=10,cinder:DELETE=4 {{(pid=86984) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:43:10 devstack cinder-volume[86984]: DEBUG dbcounter [-] [86984] Writing DB stats cinder:UPDATE=54,cinder:SELECT=65,cinder:INSERT=11,cinder:DELETE=5 {{(pid=86984) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:43:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-72bf2d55-6f3e-4e6f-9794-10fb20f83f34 tempest-GroupSnapshotsTest-122027651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-14f93866-c5c4-4e7e-bf26-b492c59abd8b {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:43:10 devstack sudo[93779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-14f93866-c5c4-4e7e-bf26-b492c59abd8b Sep 25 11:43:10 devstack sudo[93779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:43:11 devstack sudo[93779]: pam_unix(sudo:session): session closed for user root Sep 25 11:43:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-72bf2d55-6f3e-4e6f-9794-10fb20f83f34 tempest-GroupSnapshotsTest-122027651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-14f93866-c5c4-4e7e-bf26-b492c59abd8b" returned: 0 in 0.718s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:43:11 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-72bf2d55-6f3e-4e6f-9794-10fb20f83f34 tempest-GroupSnapshotsTest-122027651 None] <== create_volume: return (2183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:43:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-72bf2d55-6f3e-4e6f-9794-10fb20f83f34 tempest-GroupSnapshotsTest-122027651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.196s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:43:11 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-72bf2d55-6f3e-4e6f-9794-10fb20f83f34 tempest-GroupSnapshotsTest-122027651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6811ec88-47b8-48a8-900d-5339b36c73b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14f93866-c5c4-4e7e-bf26-b492c59abd8b', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:43:11 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-72bf2d55-6f3e-4e6f-9794-10fb20f83f34 tempest-GroupSnapshotsTest-122027651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6e9a651-4187-4509-b8b0-bcba7d04e63a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:43:11 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-72bf2d55-6f3e-4e6f-9794-10fb20f83f34 tempest-GroupSnapshotsTest-122027651 None] Volume volume-14f93866-c5c4-4e7e-bf26-b492c59abd8b (14f93866-c5c4-4e7e-bf26-b492c59abd8b): created successfully Sep 25 11:43:11 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-72bf2d55-6f3e-4e6f-9794-10fb20f83f34 tempest-GroupSnapshotsTest-122027651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6e9a651-4187-4509-b8b0-bcba7d04e63a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:43:11 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-72bf2d55-6f3e-4e6f-9794-10fb20f83f34 tempest-GroupSnapshotsTest-122027651 None] Flow 'volume_create_manager' (7f10bde1-4ed9-4302-a304-68b7fb6a4cb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:43:11 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-72bf2d55-6f3e-4e6f-9794-10fb20f83f34 tempest-GroupSnapshotsTest-122027651 None] Created volume successfully. Sep 25 11:43:12 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-0bcfee65-3a0c-498e-927e-47d1cf3a7f62 tempest-GroupSnapshotsTest-122027651 None] GroupSnapshot 2f97364b-89a3-4eb3-8525-6ba49abc079e: creating. Sep 25 11:43:12 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-0bcfee65-3a0c-498e-927e-47d1cf3a7f62 tempest-GroupSnapshotsTest-122027651 None] Group snapshot 2f97364b-89a3-4eb3-8525-6ba49abc079e: creating. {{(pid=86984) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 25 11:43:12 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-0bcfee65-3a0c-498e-927e-47d1cf3a7f62 tempest-GroupSnapshotsTest-122027651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:43:12 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-0bcfee65-3a0c-498e-927e-47d1cf3a7f62 tempest-GroupSnapshotsTest-122027651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:43:12 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-0bcfee65-3a0c-498e-927e-47d1cf3a7f62 tempest-GroupSnapshotsTest-122027651 None] Creating offline snapshot 2d6cdd41-afbd-4d22-8f99-7814d6585690 of volume 14f93866-c5c4-4e7e-bf26-b492c59abd8b {{(pid=86984) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:43:12 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd79aa2-44de-4d27-a0f4-36ff00136016]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:43:12 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-0bcfee65-3a0c-498e-927e-47d1cf3a7f62 tempest-GroupSnapshotsTest-122027651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-14f93866-c5c4-4e7e-bf26-b492c59abd8b {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:43:12 devstack sudo[93814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-14f93866-c5c4-4e7e-bf26-b492c59abd8b Sep 25 11:43:12 devstack sudo[93814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:43:13 devstack sudo[93814]: pam_unix(sudo:session): session closed for user root Sep 25 11:43:13 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-0bcfee65-3a0c-498e-927e-47d1cf3a7f62 tempest-GroupSnapshotsTest-122027651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-14f93866-c5c4-4e7e-bf26-b492c59abd8b" returned: 0 in 0.847s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:43:13 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-0bcfee65-3a0c-498e-927e-47d1cf3a7f62 tempest-GroupSnapshotsTest-122027651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-14f93866-c5c4-4e7e-bf26-b492c59abd8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-14f93866-c5c4-4e7e-bf26-b492c59abd8b.2d6cdd41-afbd-4d22-8f99-7814d6585690 1G {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:43:13 devstack sudo[93824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-14f93866-c5c4-4e7e-bf26-b492c59abd8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-14f93866-c5c4-4e7e-bf26-b492c59abd8b.2d6cdd41-afbd-4d22-8f99-7814d6585690 1G Sep 25 11:43:13 devstack sudo[93824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:43:14 devstack sudo[93824]: pam_unix(sudo:session): session closed for user root Sep 25 11:43:14 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-0bcfee65-3a0c-498e-927e-47d1cf3a7f62 tempest-GroupSnapshotsTest-122027651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-14f93866-c5c4-4e7e-bf26-b492c59abd8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-14f93866-c5c4-4e7e-bf26-b492c59abd8b.2d6cdd41-afbd-4d22-8f99-7814d6585690 1G" returned: 0 in 0.692s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:43:14 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-0bcfee65-3a0c-498e-927e-47d1cf3a7f62 tempest-GroupSnapshotsTest-122027651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14f93866-c5c4-4e7e-bf26-b492c59abd8b -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-14f93866-c5c4-4e7e-bf26-b492c59abd8b.2d6cdd41-afbd-4d22-8f99-7814d6585690 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:43:14 devstack sudo[93842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14f93866-c5c4-4e7e-bf26-b492c59abd8b -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-14f93866-c5c4-4e7e-bf26-b492c59abd8b.2d6cdd41-afbd-4d22-8f99-7814d6585690 Sep 25 11:43:14 devstack sudo[93842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:43:14 devstack sudo[93842]: pam_unix(sudo:session): session closed for user root Sep 25 11:43:14 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-0bcfee65-3a0c-498e-927e-47d1cf3a7f62 tempest-GroupSnapshotsTest-122027651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14f93866-c5c4-4e7e-bf26-b492c59abd8b -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-14f93866-c5c4-4e7e-bf26-b492c59abd8b.2d6cdd41-afbd-4d22-8f99-7814d6585690" returned: 0 in 0.505s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:43:14 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-0bcfee65-3a0c-498e-927e-47d1cf3a7f62 tempest-GroupSnapshotsTest-122027651 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-14f93866-c5c4-4e7e-bf26-b492c59abd8b.2d6cdd41-afbd-4d22-8f99-7814d6585690 is being set with open permissions: ugo+rw: NotImplementedError Sep 25 11:43:14 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-0bcfee65-3a0c-498e-927e-47d1cf3a7f62 tempest-GroupSnapshotsTest-122027651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-14f93866-c5c4-4e7e-bf26-b492c59abd8b.2d6cdd41-afbd-4d22-8f99-7814d6585690 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:43:14 devstack sudo[93855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-14f93866-c5c4-4e7e-bf26-b492c59abd8b.2d6cdd41-afbd-4d22-8f99-7814d6585690 Sep 25 11:43:14 devstack sudo[93855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:43:14 devstack sudo[93855]: pam_unix(sudo:session): session closed for user root Sep 25 11:43:14 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-0bcfee65-3a0c-498e-927e-47d1cf3a7f62 tempest-GroupSnapshotsTest-122027651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-14f93866-c5c4-4e7e-bf26-b492c59abd8b.2d6cdd41-afbd-4d22-8f99-7814d6585690" returned: 0 in 0.383s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:43:15 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-0bcfee65-3a0c-498e-927e-47d1cf3a7f62 tempest-GroupSnapshotsTest-122027651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-14f93866-c5c4-4e7e-bf26-b492c59abd8b.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:43:15 devstack sudo[93858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-14f93866-c5c4-4e7e-bf26-b492c59abd8b.info Sep 25 11:43:15 devstack sudo[93858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:43:15 devstack sudo[93858]: pam_unix(sudo:session): session closed for user root Sep 25 11:43:15 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-0bcfee65-3a0c-498e-927e-47d1cf3a7f62 tempest-GroupSnapshotsTest-122027651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-14f93866-c5c4-4e7e-bf26-b492c59abd8b.info" returned: 0 in 0.516s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:43:15 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-0bcfee65-3a0c-498e-927e-47d1cf3a7f62 tempest-GroupSnapshotsTest-122027651 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-14f93866-c5c4-4e7e-bf26-b492c59abd8b.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 11:43:15 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-0bcfee65-3a0c-498e-927e-47d1cf3a7f62 tempest-GroupSnapshotsTest-122027651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-14f93866-c5c4-4e7e-bf26-b492c59abd8b.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:43:15 devstack sudo[93893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-14f93866-c5c4-4e7e-bf26-b492c59abd8b.info Sep 25 11:43:15 devstack sudo[93893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:43:15 devstack sudo[93893]: pam_unix(sudo:session): session closed for user root Sep 25 11:43:16 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-0bcfee65-3a0c-498e-927e-47d1cf3a7f62 tempest-GroupSnapshotsTest-122027651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-14f93866-c5c4-4e7e-bf26-b492c59abd8b.info" returned: 0 in 0.461s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:43:16 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-0bcfee65-3a0c-498e-927e-47d1cf3a7f62 tempest-GroupSnapshotsTest-122027651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.606s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:43:16 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-0bcfee65-3a0c-498e-927e-47d1cf3a7f62 tempest-GroupSnapshotsTest-122027651 None] group_snapshot 2f97364b-89a3-4eb3-8525-6ba49abc079e: created successfully Sep 25 11:43:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-a6375f22-ce31-4044-81f3-01213424d980 tempest-GroupSnapshotsTest-122027651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:43:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-a6375f22-ce31-4044-81f3-01213424d980 tempest-GroupSnapshotsTest-122027651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:43:18 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-a6375f22-ce31-4044-81f3-01213424d980 tempest-GroupSnapshotsTest-122027651 None] Acquiring lock "cinder-quobyte-2d6cdd41-afbd-4d22-8f99-7814d6585690-768a80c9-b284-401c-9498-5dae2ec2db0a" by "_create_volume_from_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:43:18 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-a6375f22-ce31-4044-81f3-01213424d980 tempest-GroupSnapshotsTest-122027651 None] Lock "cinder-quobyte-2d6cdd41-afbd-4d22-8f99-7814d6585690-768a80c9-b284-401c-9498-5dae2ec2db0a" acquired by "_create_volume_from_snapshot" :: waited 0.038s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:43:18 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-a6375f22-ce31-4044-81f3-01213424d980 tempest-GroupSnapshotsTest-122027651 None] Creating volume 768a80c9-b284-401c-9498-5dae2ec2db0a from snapshot 2d6cdd41-afbd-4d22-8f99-7814d6585690 {{(pid=86984) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 11:43:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-a6375f22-ce31-4044-81f3-01213424d980 tempest-GroupSnapshotsTest-122027651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:43:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-a6375f22-ce31-4044-81f3-01213424d980 tempest-GroupSnapshotsTest-122027651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:43:18 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-a6375f22-ce31-4044-81f3-01213424d980 tempest-GroupSnapshotsTest-122027651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:43:18 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-a6375f22-ce31-4044-81f3-01213424d980 tempest-GroupSnapshotsTest-122027651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:43:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-a6375f22-ce31-4044-81f3-01213424d980 tempest-GroupSnapshotsTest-122027651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:43:18 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-a6375f22-ce31-4044-81f3-01213424d980 tempest-GroupSnapshotsTest-122027651 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:43:18 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-a6375f22-ce31-4044-81f3-01213424d980 tempest-GroupSnapshotsTest-122027651 None] Acquiring lock "cinder-quobyte-768a80c9-b284-401c-9498-5dae2ec2db0a" by "_copy_volume_from_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:43:18 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-a6375f22-ce31-4044-81f3-01213424d980 tempest-GroupSnapshotsTest-122027651 None] Lock "cinder-quobyte-768a80c9-b284-401c-9498-5dae2ec2db0a" acquired by "_copy_volume_from_snapshot" :: waited 0.042s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:43:18 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-a6375f22-ce31-4044-81f3-01213424d980 tempest-GroupSnapshotsTest-122027651 None] snapshot: 2d6cdd41-afbd-4d22-8f99-7814d6585690, volume: 768a80c9-b284-401c-9498-5dae2ec2db0a, {{(pid=86984) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 11:43:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-a6375f22-ce31-4044-81f3-01213424d980 tempest-GroupSnapshotsTest-122027651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:43:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-a6375f22-ce31-4044-81f3-01213424d980 tempest-GroupSnapshotsTest-122027651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:43:18 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-a6375f22-ce31-4044-81f3-01213424d980 tempest-GroupSnapshotsTest-122027651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:43:18 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-a6375f22-ce31-4044-81f3-01213424d980 tempest-GroupSnapshotsTest-122027651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:43:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-a6375f22-ce31-4044-81f3-01213424d980 tempest-GroupSnapshotsTest-122027651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:43:18 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[5654dffb-6c48-440f-b1d5-508fca214d83]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:43:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a6375f22-ce31-4044-81f3-01213424d980 tempest-GroupSnapshotsTest-122027651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-14f93866-c5c4-4e7e-bf26-b492c59abd8b.2d6cdd41-afbd-4d22-8f99-7814d6585690 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:43:18 devstack sudo[93947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-14f93866-c5c4-4e7e-bf26-b492c59abd8b.2d6cdd41-afbd-4d22-8f99-7814d6585690 Sep 25 11:43:18 devstack sudo[93947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:43:18 devstack sudo[93947]: pam_unix(sudo:session): session closed for user root Sep 25 11:43:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a6375f22-ce31-4044-81f3-01213424d980 tempest-GroupSnapshotsTest-122027651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-14f93866-c5c4-4e7e-bf26-b492c59abd8b.2d6cdd41-afbd-4d22-8f99-7814d6585690" returned: 0 in 0.483s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:43:18 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-a6375f22-ce31-4044-81f3-01213424d980 tempest-GroupSnapshotsTest-122027651 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-14f93866-c5c4-4e7e-bf26-b492c59abd8b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86984) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:43:18 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb70d279-627f-4a6b-a0b1-df0239eff998]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:43:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a6375f22-ce31-4044-81f3-01213424d980 tempest-GroupSnapshotsTest-122027651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-14f93866-c5c4-4e7e-bf26-b492c59abd8b {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:43:18 devstack sudo[93953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-14f93866-c5c4-4e7e-bf26-b492c59abd8b Sep 25 11:43:18 devstack sudo[93953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:43:19 devstack sudo[93953]: pam_unix(sudo:session): session closed for user root Sep 25 11:43:19 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a6375f22-ce31-4044-81f3-01213424d980 tempest-GroupSnapshotsTest-122027651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-14f93866-c5c4-4e7e-bf26-b492c59abd8b" returned: 0 in 0.538s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:43:19 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-a6375f22-ce31-4044-81f3-01213424d980 tempest-GroupSnapshotsTest-122027651 None] will copy from snapshot at /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-14f93866-c5c4-4e7e-bf26-b492c59abd8b {{(pid=86984) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 11:43:19 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-a6375f22-ce31-4044-81f3-01213424d980 tempest-GroupSnapshotsTest-122027651 None] Creating direct copy from snapshot {{(pid=86984) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 11:43:19 devstack cinder-volume[86984]: DEBUG cinder.utils [None req-a6375f22-ce31-4044-81f3-01213424d980 tempest-GroupSnapshotsTest-122027651 None] Path /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-768a80c9-b284-401c-9498-5dae2ec2db0a not found in is_blk_device check {{(pid=86984) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 11:43:19 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a6375f22-ce31-4044-81f3-01213424d980 tempest-GroupSnapshotsTest-122027651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-14f93866-c5c4-4e7e-bf26-b492c59abd8b /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-768a80c9-b284-401c-9498-5dae2ec2db0a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:43:19 devstack sudo[93958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-14f93866-c5c4-4e7e-bf26-b492c59abd8b /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-768a80c9-b284-401c-9498-5dae2ec2db0a Sep 25 11:43:19 devstack sudo[93958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:43:26 devstack cinder-volume[86984]: INFO cinder.volume.manager [req-9971ad6b-9b91-467f-990b-0a9ff94c8dba req-446bdb8d-daa1-4165-b9db-bce6d9f42e32 tempest-AttachVolumeTestJSON-1176057342 None] Terminate volume connection completed successfully. Sep 25 11:43:26 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [req-9971ad6b-9b91-467f-990b-0a9ff94c8dba req-446bdb8d-daa1-4165-b9db-bce6d9f42e32 tempest-AttachVolumeTestJSON-1176057342 None] Deleting attachment 78058f59-3b0c-4e81-b618-9ee2cc479364. {{(pid=86984) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 11:43:28 devstack cinder-volume[86984]: DEBUG dbcounter [-] [86984] Writing DB stats cinder:SELECT=11,cinder:UPDATE=1 {{(pid=86984) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:43:30 devstack cinder-volume[86984]: INFO cinder.volume.manager [req-7627633b-9efa-47dc-b4dc-3d2c33291db7 req-dfb78c13-2c07-4cd2-b85b-718c531a88ee tempest-ServerActionsTestOtherA-778028304 None] Terminate volume connection completed successfully. Sep 25 11:43:30 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [req-7627633b-9efa-47dc-b4dc-3d2c33291db7 req-dfb78c13-2c07-4cd2-b85b-718c531a88ee tempest-ServerActionsTestOtherA-778028304 None] Deleting attachment 776eac97-ffd2-4c4a-a82d-e6935dd7549b. {{(pid=86984) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 11:43:33 devstack sudo[93958]: pam_unix(sudo:session): session closed for user root Sep 25 11:43:33 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a6375f22-ce31-4044-81f3-01213424d980 tempest-GroupSnapshotsTest-122027651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-14f93866-c5c4-4e7e-bf26-b492c59abd8b /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-768a80c9-b284-401c-9498-5dae2ec2db0a" returned: 0 in 13.769s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:43:33 devstack cinder-volume[86984]: DEBUG cinder.image.image_utils [None req-a6375f22-ce31-4044-81f3-01213424d980 tempest-GroupSnapshotsTest-122027651 None] Image conversion details: src /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-14f93866-c5c4-4e7e-bf26-b492c59abd8b, size 1024.00 MB, duration 13.78 sec, destination /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-768a80c9-b284-401c-9498-5dae2ec2db0a {{(pid=86984) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 11:43:33 devstack cinder-volume[86984]: INFO cinder.image.image_utils [None req-a6375f22-ce31-4044-81f3-01213424d980 tempest-GroupSnapshotsTest-122027651 None] Converted 1024.00 MB image at 74.33 MB/s Sep 25 11:43:33 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-a6375f22-ce31-4044-81f3-01213424d980 tempest-GroupSnapshotsTest-122027651 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-768a80c9-b284-401c-9498-5dae2ec2db0a is being set with open permissions: ugo+rw: NotImplementedError Sep 25 11:43:33 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a6375f22-ce31-4044-81f3-01213424d980 tempest-GroupSnapshotsTest-122027651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-768a80c9-b284-401c-9498-5dae2ec2db0a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:43:33 devstack sudo[94043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-768a80c9-b284-401c-9498-5dae2ec2db0a Sep 25 11:43:33 devstack sudo[94043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:43:33 devstack sudo[94043]: pam_unix(sudo:session): session closed for user root Sep 25 11:43:33 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a6375f22-ce31-4044-81f3-01213424d980 tempest-GroupSnapshotsTest-122027651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-768a80c9-b284-401c-9498-5dae2ec2db0a" returned: 0 in 0.543s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:43:33 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-a6375f22-ce31-4044-81f3-01213424d980 tempest-GroupSnapshotsTest-122027651 None] Lock "cinder-quobyte-768a80c9-b284-401c-9498-5dae2ec2db0a" released by "_copy_volume_from_snapshot" :: held 15.533s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:43:33 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-a6375f22-ce31-4044-81f3-01213424d980 tempest-GroupSnapshotsTest-122027651 None] Lock "cinder-quobyte-2d6cdd41-afbd-4d22-8f99-7814d6585690-768a80c9-b284-401c-9498-5dae2ec2db0a" released by "_create_volume_from_snapshot" :: held 15.707s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:43:33 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-a6375f22-ce31-4044-81f3-01213424d980 tempest-GroupSnapshotsTest-122027651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 15.750s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:43:33 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-a6375f22-ce31-4044-81f3-01213424d980 tempest-GroupSnapshotsTest-122027651 None] Create group from source-snapshot-2f97364b-89a3-4eb3-8525-6ba49abc079e completed successfully. Sep 25 11:43:35 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f4f53dc9-bc7b-4894-b9d0-79d6ace69026 tempest-GroupSnapshotsTest-122027651 None] Acquiring lock "cinder-quobyte-768a80c9-b284-401c-9498-5dae2ec2db0a" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:43:35 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f4f53dc9-bc7b-4894-b9d0-79d6ace69026 tempest-GroupSnapshotsTest-122027651 None] Lock "cinder-quobyte-768a80c9-b284-401c-9498-5dae2ec2db0a" acquired by "delete_volume" :: waited 0.023s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:43:35 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1929179-02a2-420e-bab5-40cba30c6a90]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:43:35 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f4f53dc9-bc7b-4894-b9d0-79d6ace69026 tempest-GroupSnapshotsTest-122027651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-768a80c9-b284-401c-9498-5dae2ec2db0a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:43:35 devstack sudo[94101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-768a80c9-b284-401c-9498-5dae2ec2db0a Sep 25 11:43:35 devstack sudo[94101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:43:36 devstack sudo[94101]: pam_unix(sudo:session): session closed for user root Sep 25 11:43:36 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f4f53dc9-bc7b-4894-b9d0-79d6ace69026 tempest-GroupSnapshotsTest-122027651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-768a80c9-b284-401c-9498-5dae2ec2db0a" returned: 0 in 1.020s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:43:36 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f4f53dc9-bc7b-4894-b9d0-79d6ace69026 tempest-GroupSnapshotsTest-122027651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-768a80c9-b284-401c-9498-5dae2ec2db0a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:43:36 devstack sudo[94149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-768a80c9-b284-401c-9498-5dae2ec2db0a Sep 25 11:43:36 devstack sudo[94149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:43:37 devstack sudo[94149]: pam_unix(sudo:session): session closed for user root Sep 25 11:43:37 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f4f53dc9-bc7b-4894-b9d0-79d6ace69026 tempest-GroupSnapshotsTest-122027651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-768a80c9-b284-401c-9498-5dae2ec2db0a" returned: 0 in 0.581s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:43:37 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f4f53dc9-bc7b-4894-b9d0-79d6ace69026 tempest-GroupSnapshotsTest-122027651 None] Lock "cinder-quobyte-768a80c9-b284-401c-9498-5dae2ec2db0a" released by "delete_volume" :: held 1.686s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:43:37 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-f4f53dc9-bc7b-4894-b9d0-79d6ace69026 tempest-GroupSnapshotsTest-122027651 None] Created reservations ['3de96588-751e-497f-b542-273349f1b9f7'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:43:37 devstack cinder-volume[86984]: WARNING cinder.quota [None req-f4f53dc9-bc7b-4894-b9d0-79d6ace69026 tempest-GroupSnapshotsTest-122027651 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1886115126 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1886115126, it is now deprecated. Please use the default quota class for default quota. Sep 25 11:43:37 devstack cinder-volume[86984]: WARNING cinder.quota [None req-f4f53dc9-bc7b-4894-b9d0-79d6ace69026 tempest-GroupSnapshotsTest-122027651 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1886115126 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1886115126, it is now deprecated. Please use the default quota class for default quota. Sep 25 11:43:37 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-f4f53dc9-bc7b-4894-b9d0-79d6ace69026 tempest-GroupSnapshotsTest-122027651 None] Created reservations ['f659fdc9-1179-4544-ba00-936c31711c84', 'fa7d7d11-5c0f-4659-830f-636f82a97df5', '8ed8d089-3a92-410d-a364-6df2b688e97e', 'a6e4c2dc-5d9e-44d2-a9dc-d9116c9a7e8c'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:43:37 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f4f53dc9-bc7b-4894-b9d0-79d6ace69026 tempest-GroupSnapshotsTest-122027651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:43:37 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f4f53dc9-bc7b-4894-b9d0-79d6ace69026 tempest-GroupSnapshotsTest-122027651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:43:37 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-f4f53dc9-bc7b-4894-b9d0-79d6ace69026 tempest-GroupSnapshotsTest-122027651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:43:37 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-f4f53dc9-bc7b-4894-b9d0-79d6ace69026 tempest-GroupSnapshotsTest-122027651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:43:37 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f4f53dc9-bc7b-4894-b9d0-79d6ace69026 tempest-GroupSnapshotsTest-122027651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:43:37 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f4f53dc9-bc7b-4894-b9d0-79d6ace69026 tempest-GroupSnapshotsTest-122027651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:43:37 devstack sudo[94194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:43:37 devstack sudo[94194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:43:38 devstack sudo[94194]: pam_unix(sudo:session): session closed for user root Sep 25 11:43:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f4f53dc9-bc7b-4894-b9d0-79d6ace69026 tempest-GroupSnapshotsTest-122027651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.345s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:43:38 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-f4f53dc9-bc7b-4894-b9d0-79d6ace69026 tempest-GroupSnapshotsTest-122027651 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:43:38 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-f4f53dc9-bc7b-4894-b9d0-79d6ace69026 tempest-GroupSnapshotsTest-122027651 None] Delete group completed successfully. Sep 25 11:43:38 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-3f2ce0f0-9cf5-4c60-a4bb-1c9ccdcd58a6 tempest-GroupSnapshotsTest-122027651 None] group_snapshot 2f97364b-89a3-4eb3-8525-6ba49abc079e: deleting Sep 25 11:43:38 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3f2ce0f0-9cf5-4c60-a4bb-1c9ccdcd58a6 tempest-GroupSnapshotsTest-122027651 None] group_snapshot 2f97364b-89a3-4eb3-8525-6ba49abc079e: deleting {{(pid=86984) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 25 11:43:38 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-3f2ce0f0-9cf5-4c60-a4bb-1c9ccdcd58a6 tempest-GroupSnapshotsTest-122027651 None] Acquiring lock "cinder-quobyte-14f93866-c5c4-4e7e-bf26-b492c59abd8b" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:43:38 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-3f2ce0f0-9cf5-4c60-a4bb-1c9ccdcd58a6 tempest-GroupSnapshotsTest-122027651 None] Lock "cinder-quobyte-14f93866-c5c4-4e7e-bf26-b492c59abd8b" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:43:38 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-3f2ce0f0-9cf5-4c60-a4bb-1c9ccdcd58a6 tempest-GroupSnapshotsTest-122027651 None] Acquiring lock "cinder-quobyte-2d6cdd41-afbd-4d22-8f99-7814d6585690" by "_delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:43:38 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-3f2ce0f0-9cf5-4c60-a4bb-1c9ccdcd58a6 tempest-GroupSnapshotsTest-122027651 None] Lock "cinder-quobyte-2d6cdd41-afbd-4d22-8f99-7814d6585690" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:43:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-3f2ce0f0-9cf5-4c60-a4bb-1c9ccdcd58a6 tempest-GroupSnapshotsTest-122027651 None] Deleting offline snapshot 2d6cdd41-afbd-4d22-8f99-7814d6585690 of volume 14f93866-c5c4-4e7e-bf26-b492c59abd8b {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:43:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-3f2ce0f0-9cf5-4c60-a4bb-1c9ccdcd58a6 tempest-GroupSnapshotsTest-122027651 None] snapshot_file for this snap is: volume-14f93866-c5c4-4e7e-bf26-b492c59abd8b.2d6cdd41-afbd-4d22-8f99-7814d6585690 {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:43:38 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf6b259-c339-4ea0-86fe-9cfb2bba4856]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:43:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3f2ce0f0-9cf5-4c60-a4bb-1c9ccdcd58a6 tempest-GroupSnapshotsTest-122027651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-14f93866-c5c4-4e7e-bf26-b492c59abd8b.2d6cdd41-afbd-4d22-8f99-7814d6585690 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:43:38 devstack cinder-volume[86984]: DEBUG oslo_service.periodic_task [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:43:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:43:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:43:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:43:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:43:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:43:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:43:38 devstack sudo[94205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:43:38 devstack sudo[94205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:43:38 devstack sudo[94204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-14f93866-c5c4-4e7e-bf26-b492c59abd8b.2d6cdd41-afbd-4d22-8f99-7814d6585690 Sep 25 11:43:38 devstack sudo[94204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:43:39 devstack sudo[94205]: pam_unix(sudo:session): session closed for user root Sep 25 11:43:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.465s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:43:39 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:43:39 devstack cinder-volume[86984]: DEBUG oslo_service.periodic_task [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running periodic task VolumeManager._thread_info {{(pid=86984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:43:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] thread count: 8 {{(pid=86984) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 11:43:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] thread info: [<_MainThread(MainThread, started 132046492332160)>, , , , , , , ] {{(pid=86984) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 11:43:39 devstack sudo[94204]: pam_unix(sudo:session): session closed for user root Sep 25 11:43:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3f2ce0f0-9cf5-4c60-a4bb-1c9ccdcd58a6 tempest-GroupSnapshotsTest-122027651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-14f93866-c5c4-4e7e-bf26-b492c59abd8b.2d6cdd41-afbd-4d22-8f99-7814d6585690" returned: 0 in 0.759s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:43:39 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-3f2ce0f0-9cf5-4c60-a4bb-1c9ccdcd58a6 tempest-GroupSnapshotsTest-122027651 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-14f93866-c5c4-4e7e-bf26-b492c59abd8b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86984) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:43:39 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa6b832c-b79e-49c8-9a1a-798592352932]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:43:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3f2ce0f0-9cf5-4c60-a4bb-1c9ccdcd58a6 tempest-GroupSnapshotsTest-122027651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-14f93866-c5c4-4e7e-bf26-b492c59abd8b {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:43:39 devstack sudo[94248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-14f93866-c5c4-4e7e-bf26-b492c59abd8b Sep 25 11:43:39 devstack sudo[94248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:43:40 devstack sudo[94248]: pam_unix(sudo:session): session closed for user root Sep 25 11:43:40 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3f2ce0f0-9cf5-4c60-a4bb-1c9ccdcd58a6 tempest-GroupSnapshotsTest-122027651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-14f93866-c5c4-4e7e-bf26-b492c59abd8b" returned: 0 in 1.058s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:43:40 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3f2ce0f0-9cf5-4c60-a4bb-1c9ccdcd58a6 tempest-GroupSnapshotsTest-122027651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-14f93866-c5c4-4e7e-bf26-b492c59abd8b.2d6cdd41-afbd-4d22-8f99-7814d6585690 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:43:40 devstack sudo[94257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-14f93866-c5c4-4e7e-bf26-b492c59abd8b.2d6cdd41-afbd-4d22-8f99-7814d6585690 Sep 25 11:43:40 devstack sudo[94257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:43:41 devstack sudo[94257]: pam_unix(sudo:session): session closed for user root Sep 25 11:43:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3f2ce0f0-9cf5-4c60-a4bb-1c9ccdcd58a6 tempest-GroupSnapshotsTest-122027651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-14f93866-c5c4-4e7e-bf26-b492c59abd8b.2d6cdd41-afbd-4d22-8f99-7814d6585690" returned: 0 in 0.776s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:43:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3f2ce0f0-9cf5-4c60-a4bb-1c9ccdcd58a6 tempest-GroupSnapshotsTest-122027651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-14f93866-c5c4-4e7e-bf26-b492c59abd8b.2d6cdd41-afbd-4d22-8f99-7814d6585690 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:43:41 devstack sudo[94262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-14f93866-c5c4-4e7e-bf26-b492c59abd8b.2d6cdd41-afbd-4d22-8f99-7814d6585690 Sep 25 11:43:41 devstack sudo[94262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:43:41 devstack sudo[94262]: pam_unix(sudo:session): session closed for user root Sep 25 11:43:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3f2ce0f0-9cf5-4c60-a4bb-1c9ccdcd58a6 tempest-GroupSnapshotsTest-122027651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-14f93866-c5c4-4e7e-bf26-b492c59abd8b.2d6cdd41-afbd-4d22-8f99-7814d6585690" returned: 0 in 0.459s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:43:41 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-3f2ce0f0-9cf5-4c60-a4bb-1c9ccdcd58a6 tempest-GroupSnapshotsTest-122027651 None] Lock "cinder-quobyte-2d6cdd41-afbd-4d22-8f99-7814d6585690" released by "_delete_snapshot" :: held 3.310s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:43:41 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-3f2ce0f0-9cf5-4c60-a4bb-1c9ccdcd58a6 tempest-GroupSnapshotsTest-122027651 None] Lock "cinder-quobyte-14f93866-c5c4-4e7e-bf26-b492c59abd8b" released by "delete_snapshot" :: held 3.356s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:43:41 devstack cinder-volume[86984]: WARNING cinder.quota [None req-3f2ce0f0-9cf5-4c60-a4bb-1c9ccdcd58a6 tempest-GroupSnapshotsTest-122027651 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1886115126 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1886115126, it is now deprecated. Please use the default quota class for default quota. Sep 25 11:43:41 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-3f2ce0f0-9cf5-4c60-a4bb-1c9ccdcd58a6 tempest-GroupSnapshotsTest-122027651 None] Created reservations ['1fefc92b-465a-4350-bb8b-cc147e39a3ca', 'fba7dbb5-e6be-43fd-b6df-fed601d28555', '11caf003-2385-4621-b389-ca48bfe595c3', '4ae78754-23bb-426c-93b5-d48d1c6c38d2'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:43:42 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-3f2ce0f0-9cf5-4c60-a4bb-1c9ccdcd58a6 tempest-GroupSnapshotsTest-122027651 None] group_snapshot 2f97364b-89a3-4eb3-8525-6ba49abc079e: deleted successfully Sep 25 11:43:42 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3443202-4ce2-4ed6-aad7-0c8225d6a329 tempest-ServerActionsTestOtherA-778028304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:43:42 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e3443202-4ce2-4ed6-aad7-0c8225d6a329 tempest-ServerActionsTestOtherA-778028304 None] Flow 'volume_create_manager' (f3b7b597-db9a-4ab8-9e16-e51c54ef3ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:43:42 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e3443202-4ce2-4ed6-aad7-0c8225d6a329 tempest-ServerActionsTestOtherA-778028304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4135140c-e2ae-4060-9fcd-304aef70470d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:43:42 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e3443202-4ce2-4ed6-aad7-0c8225d6a329 tempest-ServerActionsTestOtherA-778028304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4135140c-e2ae-4060-9fcd-304aef70470d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:43:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1682710189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=344bc46e-74be-455c-898f-6aae2435500d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95a964563db24370a5ffb4e5f9a2fe01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:43:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:43:42Z,use_quota=True,user_id='cadf571d6acb4288ba60c4daf2ad9360',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:43:42 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e3443202-4ce2-4ed6-aad7-0c8225d6a329 tempest-ServerActionsTestOtherA-778028304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9493b52d-9893-4a36-877f-69cb2ba929fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:43:42 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e3443202-4ce2-4ed6-aad7-0c8225d6a329 tempest-ServerActionsTestOtherA-778028304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9493b52d-9893-4a36-877f-69cb2ba929fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:43:42 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e3443202-4ce2-4ed6-aad7-0c8225d6a329 tempest-ServerActionsTestOtherA-778028304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fda969d-69ff-47b4-9747-9c55acd3a898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:43:42 devstack cinder-volume[86984]: DEBUG cinder.image.glance [None req-e3443202-4ce2-4ed6-aad7-0c8225d6a329 tempest-ServerActionsTestOtherA-778028304 None] Creating Keystone auth plugin from conf {{(pid=86984) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 11:43:43 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e3443202-4ce2-4ed6-aad7-0c8225d6a329 tempest-ServerActionsTestOtherA-778028304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fda969d-69ff-47b4-9747-9c55acd3a898) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '344bc46e-74be-455c-898f-6aae2435500d', 'volume_name': 'volume-344bc46e-74be-455c-898f-6aae2435500d', 'volume_size': 1, 'image_id': 'd93b0aa8-e297-4aff-bb90-fe80872f8b63', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d93b0aa8-e297-4aff-bb90-fe80872f8b63', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a57d184bdf174982a6b60117d6d4a5b4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd93b0aa8-e297-4aff-bb90-fe80872f8b63', 'created_at': datetime.datetime(2026, 9, 25, 9, 31, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 31, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d93b0aa8-e297-4aff-bb90-fe80872f8b63/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:43:43 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e3443202-4ce2-4ed6-aad7-0c8225d6a329 tempest-ServerActionsTestOtherA-778028304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3635707-60d3-417b-848c-c6ad521bec8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:43:43 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e3443202-4ce2-4ed6-aad7-0c8225d6a329 tempest-ServerActionsTestOtherA-778028304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3635707-60d3-417b-848c-c6ad521bec8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:43:43 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e3443202-4ce2-4ed6-aad7-0c8225d6a329 tempest-ServerActionsTestOtherA-778028304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2460b73-5fff-4e9d-b9a3-2ddebdb5450d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:43:43 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-e3443202-4ce2-4ed6-aad7-0c8225d6a329 tempest-ServerActionsTestOtherA-778028304 None] Volume 344bc46e-74be-455c-898f-6aae2435500d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-344bc46e-74be-455c-898f-6aae2435500d', 'volume_size': 1, 'image_id': 'd93b0aa8-e297-4aff-bb90-fe80872f8b63', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d93b0aa8-e297-4aff-bb90-fe80872f8b63', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a57d184bdf174982a6b60117d6d4a5b4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd93b0aa8-e297-4aff-bb90-fe80872f8b63', 'created_at': datetime.datetime(2026, 9, 25, 9, 31, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 31, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d93b0aa8-e297-4aff-bb90-fe80872f8b63/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 25 11:43:43 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3443202-4ce2-4ed6-aad7-0c8225d6a329 tempest-ServerActionsTestOtherA-778028304 None] Trying to clone 344bc46e-74be-455c-898f-6aae2435500d from image d93b0aa8-e297-4aff-bb90-fe80872f8b63 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d93b0aa8-e297-4aff-bb90-fe80872f8b63', 'metadata': {}}]). {{(pid=86984) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 11:43:43 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-05245501-e559-4701-a8fb-e0212b4e2bda tempest-GroupSnapshotsTest-122027651 None] Acquiring lock "cinder-quobyte-14f93866-c5c4-4e7e-bf26-b492c59abd8b" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:43:43 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-05245501-e559-4701-a8fb-e0212b4e2bda tempest-GroupSnapshotsTest-122027651 None] Lock "cinder-quobyte-14f93866-c5c4-4e7e-bf26-b492c59abd8b" acquired by "delete_volume" :: waited 0.120s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:43:43 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b556b2b-735e-407c-8dd7-836c420fdd26]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:43:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-05245501-e559-4701-a8fb-e0212b4e2bda tempest-GroupSnapshotsTest-122027651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-14f93866-c5c4-4e7e-bf26-b492c59abd8b {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:43:43 devstack sudo[94286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-14f93866-c5c4-4e7e-bf26-b492c59abd8b Sep 25 11:43:43 devstack sudo[94286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:43:43 devstack cinder-volume[86984]: DEBUG cinder.image.image_utils [None req-e3443202-4ce2-4ed6-aad7-0c8225d6a329 tempest-ServerActionsTestOtherA-778028304 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d93b0aa8-e297-4aff-bb90-fe80872f8b63_dg65wyfsdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86984) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 11:43:43 devstack cinder-volume[86984]: INFO cinder.image.image_utils [None req-e3443202-4ce2-4ed6-aad7-0c8225d6a329 tempest-ServerActionsTestOtherA-778028304 None] Image download 20.69 MB at 20.69 MB/s Sep 25 11:43:44 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c9c286-4205-44fd-8734-44b35ede62e6]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:43:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e3443202-4ce2-4ed6-aad7-0c8225d6a329 tempest-ServerActionsTestOtherA-778028304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d93b0aa8-e297-4aff-bb90-fe80872f8b63_dg65wyfsdevstack@QuobyteHD {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:43:44 devstack sudo[94289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d93b0aa8-e297-4aff-bb90-fe80872f8b63_dg65wyfsdevstack@QuobyteHD Sep 25 11:43:44 devstack sudo[94289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:43:44 devstack sudo[94286]: pam_unix(sudo:session): session closed for user root Sep 25 11:43:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-05245501-e559-4701-a8fb-e0212b4e2bda tempest-GroupSnapshotsTest-122027651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-14f93866-c5c4-4e7e-bf26-b492c59abd8b" returned: 0 in 0.621s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:43:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-05245501-e559-4701-a8fb-e0212b4e2bda tempest-GroupSnapshotsTest-122027651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-14f93866-c5c4-4e7e-bf26-b492c59abd8b {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:43:44 devstack sudo[94296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-14f93866-c5c4-4e7e-bf26-b492c59abd8b Sep 25 11:43:44 devstack sudo[94296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:43:44 devstack sudo[94289]: pam_unix(sudo:session): session closed for user root Sep 25 11:43:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e3443202-4ce2-4ed6-aad7-0c8225d6a329 tempest-ServerActionsTestOtherA-778028304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d93b0aa8-e297-4aff-bb90-fe80872f8b63_dg65wyfsdevstack@QuobyteHD" returned: 0 in 0.438s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:43:44 devstack cinder-volume[86984]: DEBUG cinder.image.image_utils [None req-e3443202-4ce2-4ed6-aad7-0c8225d6a329 tempest-ServerActionsTestOtherA-778028304 None] Temporary image d93b0aa8-e297-4aff-bb90-fe80872f8b63 is fetched for user cadf571d6acb4288ba60c4daf2ad9360. {{(pid=86984) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 11:43:44 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[e00db6fc-8a4a-4f33-959f-d939ca5c62f8]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:43:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e3443202-4ce2-4ed6-aad7-0c8225d6a329 tempest-ServerActionsTestOtherA-778028304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d93b0aa8-e297-4aff-bb90-fe80872f8b63_dg65wyfsdevstack@QuobyteHD {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:43:44 devstack sudo[94296]: pam_unix(sudo:session): session closed for user root Sep 25 11:43:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-05245501-e559-4701-a8fb-e0212b4e2bda tempest-GroupSnapshotsTest-122027651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-14f93866-c5c4-4e7e-bf26-b492c59abd8b" returned: 0 in 0.468s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:43:44 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-05245501-e559-4701-a8fb-e0212b4e2bda tempest-GroupSnapshotsTest-122027651 None] Lock "cinder-quobyte-14f93866-c5c4-4e7e-bf26-b492c59abd8b" released by "delete_volume" :: held 1.260s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:43:44 devstack sudo[94302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d93b0aa8-e297-4aff-bb90-fe80872f8b63_dg65wyfsdevstack@QuobyteHD Sep 25 11:43:44 devstack sudo[94302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:43:44 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-05245501-e559-4701-a8fb-e0212b4e2bda tempest-GroupSnapshotsTest-122027651 None] Created reservations ['9e63d000-a846-472c-afc3-a675298004ed'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:43:45 devstack cinder-volume[86984]: WARNING cinder.db.api [None req-05245501-e559-4701-a8fb-e0212b4e2bda tempest-GroupSnapshotsTest-122027651 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1886115126'] Sep 25 11:43:45 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-05245501-e559-4701-a8fb-e0212b4e2bda tempest-GroupSnapshotsTest-122027651 None] Created reservations ['bbf9848d-1281-4729-9bfe-1dd845229061', 'a896d0d2-15a1-47cf-809a-761f858e1739', '66ff50e8-7f84-4f75-82b9-806bd93969f5', '7ccc17b7-ad66-4e93-98c1-ac2c84556a9d'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:43:45 devstack sudo[94302]: pam_unix(sudo:session): session closed for user root Sep 25 11:43:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e3443202-4ce2-4ed6-aad7-0c8225d6a329 tempest-ServerActionsTestOtherA-778028304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d93b0aa8-e297-4aff-bb90-fe80872f8b63_dg65wyfsdevstack@QuobyteHD" returned: 0 in 0.519s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:43:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-e3443202-4ce2-4ed6-aad7-0c8225d6a329 tempest-ServerActionsTestOtherA-778028304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:43:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-e3443202-4ce2-4ed6-aad7-0c8225d6a329 tempest-ServerActionsTestOtherA-778028304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:43:45 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-e3443202-4ce2-4ed6-aad7-0c8225d6a329 tempest-ServerActionsTestOtherA-778028304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:43:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1682710189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=344bc46e-74be-455c-898f-6aae2435500d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95a964563db24370a5ffb4e5f9a2fe01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:43:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:43:42Z,use_quota=True,user_id='cadf571d6acb4288ba60c4daf2ad9360',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:43:45 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-e3443202-4ce2-4ed6-aad7-0c8225d6a329 tempest-ServerActionsTestOtherA-778028304 None] Creating volume 344bc46e-74be-455c-898f-6aae2435500d {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:43:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-e3443202-4ce2-4ed6-aad7-0c8225d6a329 tempest-ServerActionsTestOtherA-778028304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:43:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-e3443202-4ce2-4ed6-aad7-0c8225d6a329 tempest-ServerActionsTestOtherA-778028304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:43:45 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-e3443202-4ce2-4ed6-aad7-0c8225d6a329 tempest-ServerActionsTestOtherA-778028304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:43:45 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-e3443202-4ce2-4ed6-aad7-0c8225d6a329 tempest-ServerActionsTestOtherA-778028304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:43:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-e3443202-4ce2-4ed6-aad7-0c8225d6a329 tempest-ServerActionsTestOtherA-778028304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:43:45 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-e3443202-4ce2-4ed6-aad7-0c8225d6a329 tempest-ServerActionsTestOtherA-778028304 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:43:45 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-e3443202-4ce2-4ed6-aad7-0c8225d6a329 tempest-ServerActionsTestOtherA-778028304 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:43:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e3443202-4ce2-4ed6-aad7-0c8225d6a329 tempest-ServerActionsTestOtherA-778028304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-344bc46e-74be-455c-898f-6aae2435500d 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:43:45 devstack sudo[94307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-344bc46e-74be-455c-898f-6aae2435500d 1073741824 Sep 25 11:43:45 devstack sudo[94307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:43:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-05245501-e559-4701-a8fb-e0212b4e2bda tempest-GroupSnapshotsTest-122027651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:43:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-05245501-e559-4701-a8fb-e0212b4e2bda tempest-GroupSnapshotsTest-122027651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:43:45 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-05245501-e559-4701-a8fb-e0212b4e2bda tempest-GroupSnapshotsTest-122027651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:43:45 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-05245501-e559-4701-a8fb-e0212b4e2bda tempest-GroupSnapshotsTest-122027651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:43:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-05245501-e559-4701-a8fb-e0212b4e2bda tempest-GroupSnapshotsTest-122027651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:43:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-05245501-e559-4701-a8fb-e0212b4e2bda tempest-GroupSnapshotsTest-122027651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:43:45 devstack sudo[94309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:43:45 devstack sudo[94309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:43:45 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4436833-402f-4ab4-95e4-7a024123b985 tempest-AttachVolumeNegativeTest-2039869332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:43:45 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d4436833-402f-4ab4-95e4-7a024123b985 tempest-AttachVolumeNegativeTest-2039869332 None] Flow 'volume_create_manager' (44017139-a2ad-426d-b509-38edeaa0127b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:43:45 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d4436833-402f-4ab4-95e4-7a024123b985 tempest-AttachVolumeNegativeTest-2039869332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e2196f5-4780-4277-9c07-fac425acaf09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:43:45 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d4436833-402f-4ab4-95e4-7a024123b985 tempest-AttachVolumeNegativeTest-2039869332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e2196f5-4780-4277-9c07-fac425acaf09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:43:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-905917552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a255f6c-db3f-4491-ab2c-686ec6468785,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa55515db8ae443fad5a3c89c67cb652',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:43:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:43:45Z,use_quota=True,user_id='36548203342a4f23961550f0f9060f1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:43:45 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d4436833-402f-4ab4-95e4-7a024123b985 tempest-AttachVolumeNegativeTest-2039869332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e62f1eaa-12d9-446c-82fb-297caa84585c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:43:45 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d4436833-402f-4ab4-95e4-7a024123b985 tempest-AttachVolumeNegativeTest-2039869332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e62f1eaa-12d9-446c-82fb-297caa84585c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:43:45 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d4436833-402f-4ab4-95e4-7a024123b985 tempest-AttachVolumeNegativeTest-2039869332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91f2a90f-9b01-4226-bf45-f340079006d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:43:45 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d4436833-402f-4ab4-95e4-7a024123b985 tempest-AttachVolumeNegativeTest-2039869332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91f2a90f-9b01-4226-bf45-f340079006d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a255f6c-db3f-4491-ab2c-686ec6468785', 'volume_name': 'volume-1a255f6c-db3f-4491-ab2c-686ec6468785', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:43:45 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d4436833-402f-4ab4-95e4-7a024123b985 tempest-AttachVolumeNegativeTest-2039869332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bb07d38-5bb9-48a9-b547-ed5550dc508e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:43:45 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d4436833-402f-4ab4-95e4-7a024123b985 tempest-AttachVolumeNegativeTest-2039869332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bb07d38-5bb9-48a9-b547-ed5550dc508e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:43:45 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d4436833-402f-4ab4-95e4-7a024123b985 tempest-AttachVolumeNegativeTest-2039869332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (103d05fb-ad0f-46d6-af77-cbfd6021dbe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:43:45 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-d4436833-402f-4ab4-95e4-7a024123b985 tempest-AttachVolumeNegativeTest-2039869332 None] Volume 1a255f6c-db3f-4491-ab2c-686ec6468785: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a255f6c-db3f-4491-ab2c-686ec6468785', 'volume_size': 1} Sep 25 11:43:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d4436833-402f-4ab4-95e4-7a024123b985 tempest-AttachVolumeNegativeTest-2039869332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:43:45 devstack sudo[94309]: pam_unix(sudo:session): session closed for user root Sep 25 11:43:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-05245501-e559-4701-a8fb-e0212b4e2bda tempest-GroupSnapshotsTest-122027651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.428s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:43:45 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-05245501-e559-4701-a8fb-e0212b4e2bda tempest-GroupSnapshotsTest-122027651 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:43:45 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-05245501-e559-4701-a8fb-e0212b4e2bda tempest-GroupSnapshotsTest-122027651 None] Delete group completed successfully. Sep 25 11:43:45 devstack sudo[94307]: pam_unix(sudo:session): session closed for user root Sep 25 11:43:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e3443202-4ce2-4ed6-aad7-0c8225d6a329 tempest-ServerActionsTestOtherA-778028304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-344bc46e-74be-455c-898f-6aae2435500d 1073741824" returned: 0 in 0.607s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:43:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e3443202-4ce2-4ed6-aad7-0c8225d6a329 tempest-ServerActionsTestOtherA-778028304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-344bc46e-74be-455c-898f-6aae2435500d {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:43:45 devstack sudo[94316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-344bc46e-74be-455c-898f-6aae2435500d Sep 25 11:43:45 devstack sudo[94316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:43:46 devstack sudo[94316]: pam_unix(sudo:session): session closed for user root Sep 25 11:43:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e3443202-4ce2-4ed6-aad7-0c8225d6a329 tempest-ServerActionsTestOtherA-778028304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-344bc46e-74be-455c-898f-6aae2435500d" returned: 0 in 0.351s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:43:46 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-e3443202-4ce2-4ed6-aad7-0c8225d6a329 tempest-ServerActionsTestOtherA-778028304 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:43:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-e3443202-4ce2-4ed6-aad7-0c8225d6a329 tempest-ServerActionsTestOtherA-778028304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:43:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d4436833-402f-4ab4-95e4-7a024123b985 tempest-AttachVolumeNegativeTest-2039869332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.646s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:43:46 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-d4436833-402f-4ab4-95e4-7a024123b985 tempest-AttachVolumeNegativeTest-2039869332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:43:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-905917552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a255f6c-db3f-4491-ab2c-686ec6468785,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa55515db8ae443fad5a3c89c67cb652',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:43:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:43:45Z,use_quota=True,user_id='36548203342a4f23961550f0f9060f1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:43:46 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-d4436833-402f-4ab4-95e4-7a024123b985 tempest-AttachVolumeNegativeTest-2039869332 None] Creating volume 1a255f6c-db3f-4491-ab2c-686ec6468785 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:43:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d4436833-402f-4ab4-95e4-7a024123b985 tempest-AttachVolumeNegativeTest-2039869332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:43:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d4436833-402f-4ab4-95e4-7a024123b985 tempest-AttachVolumeNegativeTest-2039869332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:43:46 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-d4436833-402f-4ab4-95e4-7a024123b985 tempest-AttachVolumeNegativeTest-2039869332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:43:46 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-d4436833-402f-4ab4-95e4-7a024123b985 tempest-AttachVolumeNegativeTest-2039869332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:43:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d4436833-402f-4ab4-95e4-7a024123b985 tempest-AttachVolumeNegativeTest-2039869332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:43:46 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-d4436833-402f-4ab4-95e4-7a024123b985 tempest-AttachVolumeNegativeTest-2039869332 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:43:46 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-d4436833-402f-4ab4-95e4-7a024123b985 tempest-AttachVolumeNegativeTest-2039869332 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:43:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d4436833-402f-4ab4-95e4-7a024123b985 tempest-AttachVolumeNegativeTest-2039869332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a255f6c-db3f-4491-ab2c-686ec6468785 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:43:46 devstack cinder-volume[86984]: DEBUG cinder.volume.volume_utils [None req-e3443202-4ce2-4ed6-aad7-0c8225d6a329 tempest-ServerActionsTestOtherA-778028304 None] Attempting download of d93b0aa8-e297-4aff-bb90-fe80872f8b63 ((None, [{'url': 'file:///opt/stack/data/glance/images/d93b0aa8-e297-4aff-bb90-fe80872f8b63', 'metadata': {}}])) to volume 344bc46e-74be-455c-898f-6aae2435500d. {{(pid=86984) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 11:43:46 devstack sudo[94319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a255f6c-db3f-4491-ab2c-686ec6468785 1073741824 Sep 25 11:43:46 devstack sudo[94319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:43:46 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e659c1-2f99-4da7-b61e-5072289048f7]: (4, 'raw') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:43:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e3443202-4ce2-4ed6-aad7-0c8225d6a329 tempest-ServerActionsTestOtherA-778028304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d93b0aa8-e297-4aff-bb90-fe80872f8b63_4oeni7mu {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:43:46 devstack sudo[94321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d93b0aa8-e297-4aff-bb90-fe80872f8b63_4oeni7mu Sep 25 11:43:46 devstack sudo[94321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:43:46 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-676d9630-311b-46ab-b55e-6b5d5bf9b805 tempest-GroupSnapshotsTest-122027651 None] Group tempest-GroupSnapshotsTest-Group-443774476: creating Sep 25 11:43:47 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-676d9630-311b-46ab-b55e-6b5d5bf9b805 tempest-GroupSnapshotsTest-122027651 None] Group tempest-GroupSnapshotsTest-Group-443774476: created successfully Sep 25 11:43:47 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-676d9630-311b-46ab-b55e-6b5d5bf9b805 tempest-GroupSnapshotsTest-122027651 None] Create group completed successfully. Sep 25 11:43:47 devstack sudo[94321]: pam_unix(sudo:session): session closed for user root Sep 25 11:43:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e3443202-4ce2-4ed6-aad7-0c8225d6a329 tempest-ServerActionsTestOtherA-778028304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d93b0aa8-e297-4aff-bb90-fe80872f8b63_4oeni7mu" returned: 0 in 0.645s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:43:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e3443202-4ce2-4ed6-aad7-0c8225d6a329 tempest-ServerActionsTestOtherA-778028304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d93b0aa8-e297-4aff-bb90-fe80872f8b63_4oeni7mu {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:43:47 devstack sudo[94319]: pam_unix(sudo:session): session closed for user root Sep 25 11:43:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d4436833-402f-4ab4-95e4-7a024123b985 tempest-AttachVolumeNegativeTest-2039869332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a255f6c-db3f-4491-ab2c-686ec6468785 1073741824" returned: 0 in 0.852s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:43:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d4436833-402f-4ab4-95e4-7a024123b985 tempest-AttachVolumeNegativeTest-2039869332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a255f6c-db3f-4491-ab2c-686ec6468785 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:43:47 devstack sudo[94330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a255f6c-db3f-4491-ab2c-686ec6468785 Sep 25 11:43:47 devstack sudo[94330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:43:47 devstack sudo[94329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d93b0aa8-e297-4aff-bb90-fe80872f8b63_4oeni7mu Sep 25 11:43:47 devstack sudo[94329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:43:47 devstack sudo[94330]: pam_unix(sudo:session): session closed for user root Sep 25 11:43:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d4436833-402f-4ab4-95e4-7a024123b985 tempest-AttachVolumeNegativeTest-2039869332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a255f6c-db3f-4491-ab2c-686ec6468785" returned: 0 in 0.315s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:43:47 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-d4436833-402f-4ab4-95e4-7a024123b985 tempest-AttachVolumeNegativeTest-2039869332 None] <== create_volume: return (1234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:43:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d4436833-402f-4ab4-95e4-7a024123b985 tempest-AttachVolumeNegativeTest-2039869332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.239s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:43:47 devstack sudo[94329]: pam_unix(sudo:session): session closed for user root Sep 25 11:43:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e3443202-4ce2-4ed6-aad7-0c8225d6a329 tempest-ServerActionsTestOtherA-778028304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d93b0aa8-e297-4aff-bb90-fe80872f8b63_4oeni7mu" returned: 1 in 0.435s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:43:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e3443202-4ce2-4ed6-aad7-0c8225d6a329 tempest-ServerActionsTestOtherA-778028304 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d93b0aa8-e297-4aff-bb90-fe80872f8b63_4oeni7mu' failed. Not Retrying. {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 11:43:47 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d4436833-402f-4ab4-95e4-7a024123b985 tempest-AttachVolumeNegativeTest-2039869332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (103d05fb-ad0f-46d6-af77-cbfd6021dbe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a255f6c-db3f-4491-ab2c-686ec6468785', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:43:47 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d4436833-402f-4ab4-95e4-7a024123b985 tempest-AttachVolumeNegativeTest-2039869332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdd3f33b-a0e4-4f8a-b976-1532a0bdc97c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:43:47 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[da69be26-f80d-4dca-a13c-1e7c8fe3f23b]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:43:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e3443202-4ce2-4ed6-aad7-0c8225d6a329 tempest-ServerActionsTestOtherA-778028304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d93b0aa8-e297-4aff-bb90-fe80872f8b63_dg65wyfsdevstack@QuobyteHD {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:43:47 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-d4436833-402f-4ab4-95e4-7a024123b985 tempest-AttachVolumeNegativeTest-2039869332 None] Volume volume-1a255f6c-db3f-4491-ab2c-686ec6468785 (1a255f6c-db3f-4491-ab2c-686ec6468785): created successfully Sep 25 11:43:47 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d4436833-402f-4ab4-95e4-7a024123b985 tempest-AttachVolumeNegativeTest-2039869332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdd3f33b-a0e4-4f8a-b976-1532a0bdc97c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:43:47 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d4436833-402f-4ab4-95e4-7a024123b985 tempest-AttachVolumeNegativeTest-2039869332 None] Flow 'volume_create_manager' (44017139-a2ad-426d-b509-38edeaa0127b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:43:47 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-d4436833-402f-4ab4-95e4-7a024123b985 tempest-AttachVolumeNegativeTest-2039869332 None] Created volume successfully. Sep 25 11:43:47 devstack sudo[94336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d93b0aa8-e297-4aff-bb90-fe80872f8b63_dg65wyfsdevstack@QuobyteHD Sep 25 11:43:47 devstack sudo[94336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:43:48 devstack sudo[94336]: pam_unix(sudo:session): session closed for user root Sep 25 11:43:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e3443202-4ce2-4ed6-aad7-0c8225d6a329 tempest-ServerActionsTestOtherA-778028304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d93b0aa8-e297-4aff-bb90-fe80872f8b63_dg65wyfsdevstack@QuobyteHD" returned: 0 in 0.487s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:43:48 devstack cinder-volume[86984]: DEBUG cinder.image.image_utils [None req-e3443202-4ce2-4ed6-aad7-0c8225d6a329 tempest-ServerActionsTestOtherA-778028304 None] d93b0aa8-e297-4aff-bb90-fe80872f8b63 was qcow2, converting to qcow2 {{(pid=86984) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 11:43:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e3443202-4ce2-4ed6-aad7-0c8225d6a329 tempest-ServerActionsTestOtherA-778028304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d93b0aa8-e297-4aff-bb90-fe80872f8b63_dg65wyfsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-344bc46e-74be-455c-898f-6aae2435500d {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:43:48 devstack sudo[94341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d93b0aa8-e297-4aff-bb90-fe80872f8b63_dg65wyfsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-344bc46e-74be-455c-898f-6aae2435500d Sep 25 11:43:48 devstack sudo[94341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:43:49 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-68635def-76c0-4dfe-8a80-f0edc0707033 tempest-GroupSnapshotsTest-122027651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:43:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-68635def-76c0-4dfe-8a80-f0edc0707033 tempest-GroupSnapshotsTest-122027651 None] Flow 'volume_create_manager' (17b4f1a0-7f40-4e42-ba8d-3d1376f3fe21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:43:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-68635def-76c0-4dfe-8a80-f0edc0707033 tempest-GroupSnapshotsTest-122027651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4799dc34-f7a7-4aa4-9847-edab52e17950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:43:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-68635def-76c0-4dfe-8a80-f0edc0707033 tempest-GroupSnapshotsTest-122027651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4799dc34-f7a7-4aa4-9847-edab52e17950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:43:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1504880993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a6c9ba09-b40d-478c-ba46-5232176fd39c,host='devstack@QuobyteHD#QuobyteHD',id=928b2518-91ae-4f46-bbf5-a3f6e4a1499e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9d9f0643087407bbcbcdcc879f8e8b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:43:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:43:49Z,use_quota=True,user_id='17a666ec9d3d49519f3f9c6284176a33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba004b54-aeb7-4516-a359-5b01b3e7afa6),volume_type_id=ba004b54-aeb7-4516-a359-5b01b3e7afa6)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:43:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-68635def-76c0-4dfe-8a80-f0edc0707033 tempest-GroupSnapshotsTest-122027651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbc748c5-4bee-42e0-9748-ccf73538a982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:43:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-68635def-76c0-4dfe-8a80-f0edc0707033 tempest-GroupSnapshotsTest-122027651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbc748c5-4bee-42e0-9748-ccf73538a982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:43:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-68635def-76c0-4dfe-8a80-f0edc0707033 tempest-GroupSnapshotsTest-122027651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b45c1be7-ea13-43c7-a38a-a311a17db64b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:43:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-68635def-76c0-4dfe-8a80-f0edc0707033 tempest-GroupSnapshotsTest-122027651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b45c1be7-ea13-43c7-a38a-a311a17db64b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '928b2518-91ae-4f46-bbf5-a3f6e4a1499e', 'volume_name': 'volume-928b2518-91ae-4f46-bbf5-a3f6e4a1499e', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:43:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-68635def-76c0-4dfe-8a80-f0edc0707033 tempest-GroupSnapshotsTest-122027651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb93aa56-243b-45d9-91bd-7002538817bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:43:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-68635def-76c0-4dfe-8a80-f0edc0707033 tempest-GroupSnapshotsTest-122027651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb93aa56-243b-45d9-91bd-7002538817bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:43:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-68635def-76c0-4dfe-8a80-f0edc0707033 tempest-GroupSnapshotsTest-122027651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1523a890-3e2e-4223-9855-fbf80d2255c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:43:49 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-68635def-76c0-4dfe-8a80-f0edc0707033 tempest-GroupSnapshotsTest-122027651 None] Volume 928b2518-91ae-4f46-bbf5-a3f6e4a1499e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-928b2518-91ae-4f46-bbf5-a3f6e4a1499e', 'volume_size': 1} Sep 25 11:43:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-68635def-76c0-4dfe-8a80-f0edc0707033 tempest-GroupSnapshotsTest-122027651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:43:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-68635def-76c0-4dfe-8a80-f0edc0707033 tempest-GroupSnapshotsTest-122027651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:43:49 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-68635def-76c0-4dfe-8a80-f0edc0707033 tempest-GroupSnapshotsTest-122027651 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a6c9ba09-b40d-478c-ba46-5232176fd39c,created_at=2026-09-25T09:43:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1504880993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a6c9ba09-b40d-478c-ba46-5232176fd39c,host='devstack@QuobyteHD#QuobyteHD',id=928b2518-91ae-4f46-bbf5-a3f6e4a1499e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9d9f0643087407bbcbcdcc879f8e8b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:43:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:43:49Z,use_quota=True,user_id='17a666ec9d3d49519f3f9c6284176a33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba004b54-aeb7-4516-a359-5b01b3e7afa6),volume_type_id=ba004b54-aeb7-4516-a359-5b01b3e7afa6)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:43:49 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-68635def-76c0-4dfe-8a80-f0edc0707033 tempest-GroupSnapshotsTest-122027651 None] Creating volume 928b2518-91ae-4f46-bbf5-a3f6e4a1499e {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:43:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-68635def-76c0-4dfe-8a80-f0edc0707033 tempest-GroupSnapshotsTest-122027651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:43:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-68635def-76c0-4dfe-8a80-f0edc0707033 tempest-GroupSnapshotsTest-122027651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:43:49 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-68635def-76c0-4dfe-8a80-f0edc0707033 tempest-GroupSnapshotsTest-122027651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:43:49 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-68635def-76c0-4dfe-8a80-f0edc0707033 tempest-GroupSnapshotsTest-122027651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:43:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-68635def-76c0-4dfe-8a80-f0edc0707033 tempest-GroupSnapshotsTest-122027651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:43:49 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-68635def-76c0-4dfe-8a80-f0edc0707033 tempest-GroupSnapshotsTest-122027651 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:43:49 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-68635def-76c0-4dfe-8a80-f0edc0707033 tempest-GroupSnapshotsTest-122027651 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:43:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-68635def-76c0-4dfe-8a80-f0edc0707033 tempest-GroupSnapshotsTest-122027651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-928b2518-91ae-4f46-bbf5-a3f6e4a1499e 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:43:49 devstack sudo[94354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-928b2518-91ae-4f46-bbf5-a3f6e4a1499e 1073741824 Sep 25 11:43:49 devstack sudo[94354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:43:50 devstack sudo[94354]: pam_unix(sudo:session): session closed for user root Sep 25 11:43:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-68635def-76c0-4dfe-8a80-f0edc0707033 tempest-GroupSnapshotsTest-122027651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-928b2518-91ae-4f46-bbf5-a3f6e4a1499e 1073741824" returned: 0 in 0.999s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:43:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-68635def-76c0-4dfe-8a80-f0edc0707033 tempest-GroupSnapshotsTest-122027651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-928b2518-91ae-4f46-bbf5-a3f6e4a1499e {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:43:50 devstack sudo[94369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-928b2518-91ae-4f46-bbf5-a3f6e4a1499e Sep 25 11:43:50 devstack sudo[94369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:43:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-2f4f3c61-6251-4c70-86f8-d0fcc9fcb83d req-f8c60a65-cbc0-4f66-bfb2-bb71a2d692e7 tempest-AttachVolumeNegativeTest-2039869332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:43:50 devstack sudo[94369]: pam_unix(sudo:session): session closed for user root Sep 25 11:43:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-68635def-76c0-4dfe-8a80-f0edc0707033 tempest-GroupSnapshotsTest-122027651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-928b2518-91ae-4f46-bbf5-a3f6e4a1499e" returned: 0 in 0.494s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:43:50 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-68635def-76c0-4dfe-8a80-f0edc0707033 tempest-GroupSnapshotsTest-122027651 None] <== create_volume: return (1629ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:43:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-68635def-76c0-4dfe-8a80-f0edc0707033 tempest-GroupSnapshotsTest-122027651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.636s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:43:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-2f4f3c61-6251-4c70-86f8-d0fcc9fcb83d req-f8c60a65-cbc0-4f66-bfb2-bb71a2d692e7 tempest-AttachVolumeNegativeTest-2039869332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.429s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:43:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-2f4f3c61-6251-4c70-86f8-d0fcc9fcb83d req-f8c60a65-cbc0-4f66-bfb2-bb71a2d692e7 tempest-AttachVolumeNegativeTest-2039869332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:43:50 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-68635def-76c0-4dfe-8a80-f0edc0707033 tempest-GroupSnapshotsTest-122027651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1523a890-3e2e-4223-9855-fbf80d2255c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-928b2518-91ae-4f46-bbf5-a3f6e4a1499e', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:43:50 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-68635def-76c0-4dfe-8a80-f0edc0707033 tempest-GroupSnapshotsTest-122027651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (100c01ea-47f9-4379-bb13-d40d808190cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:43:51 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [req-2f4f3c61-6251-4c70-86f8-d0fcc9fcb83d req-f8c60a65-cbc0-4f66-bfb2-bb71a2d692e7 tempest-AttachVolumeNegativeTest-2039869332 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba', 'name': 'volume-1a255f6c-db3f-4491-ab2c-686ec6468785', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '92280314-7941-4a83-a1d4-9de5fc25ba77', 'enforce_multipath': True} {{(pid=86984) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 11:43:51 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-68635def-76c0-4dfe-8a80-f0edc0707033 tempest-GroupSnapshotsTest-122027651 None] Volume volume-928b2518-91ae-4f46-bbf5-a3f6e4a1499e (928b2518-91ae-4f46-bbf5-a3f6e4a1499e): created successfully Sep 25 11:43:51 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-68635def-76c0-4dfe-8a80-f0edc0707033 tempest-GroupSnapshotsTest-122027651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (100c01ea-47f9-4379-bb13-d40d808190cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:43:51 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-68635def-76c0-4dfe-8a80-f0edc0707033 tempest-GroupSnapshotsTest-122027651 None] Flow 'volume_create_manager' (17b4f1a0-7f40-4e42-ba8d-3d1376f3fe21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:43:51 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-68635def-76c0-4dfe-8a80-f0edc0707033 tempest-GroupSnapshotsTest-122027651 None] Created volume successfully. Sep 25 11:43:51 devstack cinder-volume[86984]: INFO cinder.volume.manager [req-2f4f3c61-6251-4c70-86f8-d0fcc9fcb83d req-f8c60a65-cbc0-4f66-bfb2-bb71a2d692e7 tempest-AttachVolumeNegativeTest-2039869332 None] attachment_update completed successfully. Sep 25 11:43:51 devstack sudo[94341]: pam_unix(sudo:session): session closed for user root Sep 25 11:43:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e3443202-4ce2-4ed6-aad7-0c8225d6a329 tempest-ServerActionsTestOtherA-778028304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d93b0aa8-e297-4aff-bb90-fe80872f8b63_dg65wyfsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-344bc46e-74be-455c-898f-6aae2435500d" returned: 0 in 3.322s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:43:51 devstack cinder-volume[86984]: DEBUG cinder.image.image_utils [None req-e3443202-4ce2-4ed6-aad7-0c8225d6a329 tempest-ServerActionsTestOtherA-778028304 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d93b0aa8-e297-4aff-bb90-fe80872f8b63_dg65wyfsdevstack@QuobyteHD, size 112.00 MB, duration 3.32 sec, destination /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-344bc46e-74be-455c-898f-6aae2435500d {{(pid=86984) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 11:43:51 devstack cinder-volume[86984]: INFO cinder.image.image_utils [None req-e3443202-4ce2-4ed6-aad7-0c8225d6a329 tempest-ServerActionsTestOtherA-778028304 None] Converted 112.00 MB image at 33.70 MB/s Sep 25 11:43:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e3443202-4ce2-4ed6-aad7-0c8225d6a329 tempest-ServerActionsTestOtherA-778028304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-344bc46e-74be-455c-898f-6aae2435500d 1G {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:43:51 devstack sudo[94447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-344bc46e-74be-455c-898f-6aae2435500d 1G Sep 25 11:43:51 devstack sudo[94447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:43:52 devstack sudo[94447]: pam_unix(sudo:session): session closed for user root Sep 25 11:43:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e3443202-4ce2-4ed6-aad7-0c8225d6a329 tempest-ServerActionsTestOtherA-778028304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-344bc46e-74be-455c-898f-6aae2435500d 1G" returned: 0 in 0.680s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:43:52 devstack cinder-volume[86984]: DEBUG cinder.volume.volume_utils [None req-e3443202-4ce2-4ed6-aad7-0c8225d6a329 tempest-ServerActionsTestOtherA-778028304 None] Downloaded image d93b0aa8-e297-4aff-bb90-fe80872f8b63 ((None, [{'url': 'file:///opt/stack/data/glance/images/d93b0aa8-e297-4aff-bb90-fe80872f8b63', 'metadata': {}}])) to volume 344bc46e-74be-455c-898f-6aae2435500d successfully. {{(pid=86984) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 11:43:52 devstack cinder-volume[86984]: DEBUG cinder.image.image_utils [None req-e3443202-4ce2-4ed6-aad7-0c8225d6a329 tempest-ServerActionsTestOtherA-778028304 None] Temporary image d93b0aa8-e297-4aff-bb90-fe80872f8b63 for user cadf571d6acb4288ba60c4daf2ad9360 is deleted. {{(pid=86984) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 11:43:52 devstack cinder-volume[86984]: DEBUG cinder.volume.volume_utils [None req-e3443202-4ce2-4ed6-aad7-0c8225d6a329 tempest-ServerActionsTestOtherA-778028304 None] Marking volume 344bc46e-74be-455c-898f-6aae2435500d as bootable. {{(pid=86984) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 11:43:52 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3443202-4ce2-4ed6-aad7-0c8225d6a329 tempest-ServerActionsTestOtherA-778028304 None] Copying metadata from image d93b0aa8-e297-4aff-bb90-fe80872f8b63 to 344bc46e-74be-455c-898f-6aae2435500d. {{(pid=86984) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 11:43:52 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3443202-4ce2-4ed6-aad7-0c8225d6a329 tempest-ServerActionsTestOtherA-778028304 None] Creating volume glance metadata for volume 344bc46e-74be-455c-898f-6aae2435500d backed by image d93b0aa8-e297-4aff-bb90-fe80872f8b63 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd93b0aa8-e297-4aff-bb90-fe80872f8b63', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86984) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 11:43:52 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e3443202-4ce2-4ed6-aad7-0c8225d6a329 tempest-ServerActionsTestOtherA-778028304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2460b73-5fff-4e9d-b9a3-2ddebdb5450d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-344bc46e-74be-455c-898f-6aae2435500d', 'volume_size': 1, 'image_id': 'd93b0aa8-e297-4aff-bb90-fe80872f8b63', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d93b0aa8-e297-4aff-bb90-fe80872f8b63', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a57d184bdf174982a6b60117d6d4a5b4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd93b0aa8-e297-4aff-bb90-fe80872f8b63', 'created_at': datetime.datetime(2026, 9, 25, 9, 31, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 31, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d93b0aa8-e297-4aff-bb90-fe80872f8b63/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:43:52 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e3443202-4ce2-4ed6-aad7-0c8225d6a329 tempest-ServerActionsTestOtherA-778028304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cad7ecf5-56dd-47ae-b148-b3deac68e008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:43:52 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-e3443202-4ce2-4ed6-aad7-0c8225d6a329 tempest-ServerActionsTestOtherA-778028304 None] Volume volume-344bc46e-74be-455c-898f-6aae2435500d (344bc46e-74be-455c-898f-6aae2435500d): created successfully Sep 25 11:43:52 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e3443202-4ce2-4ed6-aad7-0c8225d6a329 tempest-ServerActionsTestOtherA-778028304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cad7ecf5-56dd-47ae-b148-b3deac68e008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:43:52 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e3443202-4ce2-4ed6-aad7-0c8225d6a329 tempest-ServerActionsTestOtherA-778028304 None] Flow 'volume_create_manager' (f3b7b597-db9a-4ab8-9e16-e51c54ef3ace) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:43:52 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-e3443202-4ce2-4ed6-aad7-0c8225d6a329 tempest-ServerActionsTestOtherA-778028304 None] Created volume successfully. Sep 25 11:43:53 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-37aa4bcf-9c1a-4b90-8249-89dcc3ab1b4f tempest-GroupSnapshotsTest-122027651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:43:53 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-37aa4bcf-9c1a-4b90-8249-89dcc3ab1b4f tempest-GroupSnapshotsTest-122027651 None] Flow 'volume_create_manager' (14aaf313-b401-45ac-bb14-6112fa73cae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:43:53 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-37aa4bcf-9c1a-4b90-8249-89dcc3ab1b4f tempest-GroupSnapshotsTest-122027651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81774916-0c82-48b8-aa0c-dbd7676a5a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:43:53 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-37aa4bcf-9c1a-4b90-8249-89dcc3ab1b4f tempest-GroupSnapshotsTest-122027651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81774916-0c82-48b8-aa0c-dbd7676a5a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:43:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1259319134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a6c9ba09-b40d-478c-ba46-5232176fd39c,host='devstack@QuobyteHD#QuobyteHD',id=3c46d91d-8de8-495b-8598-f8e18d53c8f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9d9f0643087407bbcbcdcc879f8e8b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:43:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:43:53Z,use_quota=True,user_id='17a666ec9d3d49519f3f9c6284176a33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba004b54-aeb7-4516-a359-5b01b3e7afa6),volume_type_id=ba004b54-aeb7-4516-a359-5b01b3e7afa6)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:43:53 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-37aa4bcf-9c1a-4b90-8249-89dcc3ab1b4f tempest-GroupSnapshotsTest-122027651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74f15d55-da16-4762-b1e7-1a21a532c72d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:43:53 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-37aa4bcf-9c1a-4b90-8249-89dcc3ab1b4f tempest-GroupSnapshotsTest-122027651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74f15d55-da16-4762-b1e7-1a21a532c72d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:43:53 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-37aa4bcf-9c1a-4b90-8249-89dcc3ab1b4f tempest-GroupSnapshotsTest-122027651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7b16a1b-4e0f-4b30-a67c-1151f6cfccb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:43:53 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-37aa4bcf-9c1a-4b90-8249-89dcc3ab1b4f tempest-GroupSnapshotsTest-122027651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7b16a1b-4e0f-4b30-a67c-1151f6cfccb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c46d91d-8de8-495b-8598-f8e18d53c8f7', 'volume_name': 'volume-3c46d91d-8de8-495b-8598-f8e18d53c8f7', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:43:53 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-37aa4bcf-9c1a-4b90-8249-89dcc3ab1b4f tempest-GroupSnapshotsTest-122027651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dde3041-d9a6-48a3-990d-1904aeeb13aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:43:53 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-37aa4bcf-9c1a-4b90-8249-89dcc3ab1b4f tempest-GroupSnapshotsTest-122027651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dde3041-d9a6-48a3-990d-1904aeeb13aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:43:53 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-37aa4bcf-9c1a-4b90-8249-89dcc3ab1b4f tempest-GroupSnapshotsTest-122027651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a222931-c11d-4a97-bb08-485a380628c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:43:53 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-37aa4bcf-9c1a-4b90-8249-89dcc3ab1b4f tempest-GroupSnapshotsTest-122027651 None] Volume 3c46d91d-8de8-495b-8598-f8e18d53c8f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c46d91d-8de8-495b-8598-f8e18d53c8f7', 'volume_size': 1} Sep 25 11:43:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-37aa4bcf-9c1a-4b90-8249-89dcc3ab1b4f tempest-GroupSnapshotsTest-122027651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:43:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-37aa4bcf-9c1a-4b90-8249-89dcc3ab1b4f tempest-GroupSnapshotsTest-122027651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:43:53 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-37aa4bcf-9c1a-4b90-8249-89dcc3ab1b4f tempest-GroupSnapshotsTest-122027651 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a6c9ba09-b40d-478c-ba46-5232176fd39c,created_at=2026-09-25T09:43:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1259319134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a6c9ba09-b40d-478c-ba46-5232176fd39c,host='devstack@QuobyteHD#QuobyteHD',id=3c46d91d-8de8-495b-8598-f8e18d53c8f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9d9f0643087407bbcbcdcc879f8e8b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:43:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:43:53Z,use_quota=True,user_id='17a666ec9d3d49519f3f9c6284176a33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba004b54-aeb7-4516-a359-5b01b3e7afa6),volume_type_id=ba004b54-aeb7-4516-a359-5b01b3e7afa6)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:43:53 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-37aa4bcf-9c1a-4b90-8249-89dcc3ab1b4f tempest-GroupSnapshotsTest-122027651 None] Creating volume 3c46d91d-8de8-495b-8598-f8e18d53c8f7 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:43:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-37aa4bcf-9c1a-4b90-8249-89dcc3ab1b4f tempest-GroupSnapshotsTest-122027651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:43:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-37aa4bcf-9c1a-4b90-8249-89dcc3ab1b4f tempest-GroupSnapshotsTest-122027651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:43:53 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-37aa4bcf-9c1a-4b90-8249-89dcc3ab1b4f tempest-GroupSnapshotsTest-122027651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:43:53 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-37aa4bcf-9c1a-4b90-8249-89dcc3ab1b4f tempest-GroupSnapshotsTest-122027651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:43:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-37aa4bcf-9c1a-4b90-8249-89dcc3ab1b4f tempest-GroupSnapshotsTest-122027651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:43:53 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-37aa4bcf-9c1a-4b90-8249-89dcc3ab1b4f tempest-GroupSnapshotsTest-122027651 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:43:53 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-37aa4bcf-9c1a-4b90-8249-89dcc3ab1b4f tempest-GroupSnapshotsTest-122027651 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:43:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-37aa4bcf-9c1a-4b90-8249-89dcc3ab1b4f tempest-GroupSnapshotsTest-122027651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-3c46d91d-8de8-495b-8598-f8e18d53c8f7 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:43:53 devstack sudo[94796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-3c46d91d-8de8-495b-8598-f8e18d53c8f7 1073741824 Sep 25 11:43:53 devstack sudo[94796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:43:54 devstack sudo[94796]: pam_unix(sudo:session): session closed for user root Sep 25 11:43:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-37aa4bcf-9c1a-4b90-8249-89dcc3ab1b4f tempest-GroupSnapshotsTest-122027651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-3c46d91d-8de8-495b-8598-f8e18d53c8f7 1073741824" returned: 0 in 0.673s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:43:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-37aa4bcf-9c1a-4b90-8249-89dcc3ab1b4f tempest-GroupSnapshotsTest-122027651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-3c46d91d-8de8-495b-8598-f8e18d53c8f7 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:43:54 devstack sudo[94802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-3c46d91d-8de8-495b-8598-f8e18d53c8f7 Sep 25 11:43:54 devstack sudo[94802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:43:54 devstack sudo[94802]: pam_unix(sudo:session): session closed for user root Sep 25 11:43:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-37aa4bcf-9c1a-4b90-8249-89dcc3ab1b4f tempest-GroupSnapshotsTest-122027651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-3c46d91d-8de8-495b-8598-f8e18d53c8f7" returned: 0 in 0.365s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:43:54 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-37aa4bcf-9c1a-4b90-8249-89dcc3ab1b4f tempest-GroupSnapshotsTest-122027651 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:43:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-37aa4bcf-9c1a-4b90-8249-89dcc3ab1b4f tempest-GroupSnapshotsTest-122027651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:43:54 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-37aa4bcf-9c1a-4b90-8249-89dcc3ab1b4f tempest-GroupSnapshotsTest-122027651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a222931-c11d-4a97-bb08-485a380628c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c46d91d-8de8-495b-8598-f8e18d53c8f7', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:43:54 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-37aa4bcf-9c1a-4b90-8249-89dcc3ab1b4f tempest-GroupSnapshotsTest-122027651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1115471e-5094-40fc-9a29-d6e182cecd1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:43:54 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-37aa4bcf-9c1a-4b90-8249-89dcc3ab1b4f tempest-GroupSnapshotsTest-122027651 None] Volume volume-3c46d91d-8de8-495b-8598-f8e18d53c8f7 (3c46d91d-8de8-495b-8598-f8e18d53c8f7): created successfully Sep 25 11:43:54 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-37aa4bcf-9c1a-4b90-8249-89dcc3ab1b4f tempest-GroupSnapshotsTest-122027651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1115471e-5094-40fc-9a29-d6e182cecd1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:43:54 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-37aa4bcf-9c1a-4b90-8249-89dcc3ab1b4f tempest-GroupSnapshotsTest-122027651 None] Flow 'volume_create_manager' (14aaf313-b401-45ac-bb14-6112fa73cae9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:43:54 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-37aa4bcf-9c1a-4b90-8249-89dcc3ab1b4f tempest-GroupSnapshotsTest-122027651 None] Created volume successfully. Sep 25 11:43:54 devstack cinder-volume[86984]: INFO cinder.volume.manager [req-c26e7873-d053-4f36-8e6c-c41b253bb198 req-c03977b9-26de-489d-8d7d-d13d2e710e93 tempest-AttachVolumeNegativeTest-2039869332 None] Terminate volume connection completed successfully. Sep 25 11:43:54 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [req-c26e7873-d053-4f36-8e6c-c41b253bb198 req-c03977b9-26de-489d-8d7d-d13d2e710e93 tempest-AttachVolumeNegativeTest-2039869332 None] Deleting attachment 92280314-7941-4a83-a1d4-9de5fc25ba77. {{(pid=86984) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 11:43:56 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-4c11b05a-1625-490d-b026-ce31af7d5415 tempest-GroupSnapshotsTest-122027651 None] Update group completed successfully. Sep 25 11:43:56 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-67ac1f0f-29d8-45ae-83cf-ed6fe67f90f1 req-e28845f0-bcc6-4214-9d57-ac1f70d51f7f tempest-ServerActionsTestOtherA-778028304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:43:56 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-67ac1f0f-29d8-45ae-83cf-ed6fe67f90f1 req-e28845f0-bcc6-4214-9d57-ac1f70d51f7f tempest-ServerActionsTestOtherA-778028304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:43:56 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-67ac1f0f-29d8-45ae-83cf-ed6fe67f90f1 req-e28845f0-bcc6-4214-9d57-ac1f70d51f7f tempest-ServerActionsTestOtherA-778028304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:43:56 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [req-67ac1f0f-29d8-45ae-83cf-ed6fe67f90f1 req-e28845f0-bcc6-4214-9d57-ac1f70d51f7f tempest-ServerActionsTestOtherA-778028304 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba', 'name': 'volume-344bc46e-74be-455c-898f-6aae2435500d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6f22b6ba-ee8e-4310-af1e-61c7288c32f9', 'enforce_multipath': True} {{(pid=86984) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 11:43:57 devstack cinder-volume[86984]: INFO cinder.volume.manager [req-67ac1f0f-29d8-45ae-83cf-ed6fe67f90f1 req-e28845f0-bcc6-4214-9d57-ac1f70d51f7f tempest-ServerActionsTestOtherA-778028304 None] attachment_update completed successfully. Sep 25 11:43:57 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-34afdda0-8888-4067-a57f-29c701234e61 tempest-GroupSnapshotsTest-122027651 None] Update group completed successfully. Sep 25 11:43:58 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-121269e7-cfc3-4c99-a1b9-b641f9792a51 tempest-GroupSnapshotsTest-122027651 None] Update group completed successfully. Sep 25 11:43:59 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-12ed22ff-a88f-4e30-930b-a58dc8ee0daa tempest-GroupSnapshotsTest-122027651 None] Update group completed successfully. Sep 25 11:44:02 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-10456608-9bfe-483d-9c45-d5fb119f07b2 tempest-AttachVolumeNegativeTest-2039869332 None] Acquiring lock "cinder-1a255f6c-db3f-4491-ab2c-686ec6468785-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:44:02 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-d11d34c4-fa3e-441e-a437-94ded459d209 tempest-GroupSnapshotsTest-122027651 None] GroupSnapshot a1321b8f-2a90-4bc4-b4f8-f9594a7ad566: creating. Sep 25 11:44:02 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-10456608-9bfe-483d-9c45-d5fb119f07b2 tempest-AttachVolumeNegativeTest-2039869332 None] Lock "cinder-1a255f6c-db3f-4491-ab2c-686ec6468785-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:44:02 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d11d34c4-fa3e-441e-a437-94ded459d209 tempest-GroupSnapshotsTest-122027651 None] Group snapshot a1321b8f-2a90-4bc4-b4f8-f9594a7ad566: creating. {{(pid=86984) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 25 11:44:02 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d11d34c4-fa3e-441e-a437-94ded459d209 tempest-GroupSnapshotsTest-122027651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:44:02 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d11d34c4-fa3e-441e-a437-94ded459d209 tempest-GroupSnapshotsTest-122027651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:44:02 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-d11d34c4-fa3e-441e-a437-94ded459d209 tempest-GroupSnapshotsTest-122027651 None] Creating offline snapshot 47a096a4-5469-429f-bff9-eb97ffe780fb of volume 3c46d91d-8de8-495b-8598-f8e18d53c8f7 {{(pid=86984) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:44:02 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-10456608-9bfe-483d-9c45-d5fb119f07b2 tempest-AttachVolumeNegativeTest-2039869332 None] Acquiring lock "cinder-quobyte-1a255f6c-db3f-4491-ab2c-686ec6468785" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:44:02 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[22504c91-930e-4c36-a6a1-039696ba21d5]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:44:02 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d11d34c4-fa3e-441e-a437-94ded459d209 tempest-GroupSnapshotsTest-122027651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-3c46d91d-8de8-495b-8598-f8e18d53c8f7 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:02 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-10456608-9bfe-483d-9c45-d5fb119f07b2 tempest-AttachVolumeNegativeTest-2039869332 None] Lock "cinder-quobyte-1a255f6c-db3f-4491-ab2c-686ec6468785" acquired by "delete_volume" :: waited 0.082s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:44:02 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f370b1e-0dee-48a9-973d-7b68af925a51]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:44:02 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-10456608-9bfe-483d-9c45-d5fb119f07b2 tempest-AttachVolumeNegativeTest-2039869332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a255f6c-db3f-4491-ab2c-686ec6468785 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:02 devstack sudo[95313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-3c46d91d-8de8-495b-8598-f8e18d53c8f7 Sep 25 11:44:02 devstack sudo[95313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:02 devstack sudo[95316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a255f6c-db3f-4491-ab2c-686ec6468785 Sep 25 11:44:02 devstack sudo[95316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:03 devstack sudo[95313]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d11d34c4-fa3e-441e-a437-94ded459d209 tempest-GroupSnapshotsTest-122027651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-3c46d91d-8de8-495b-8598-f8e18d53c8f7" returned: 0 in 1.118s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:03 devstack sudo[95316]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d11d34c4-fa3e-441e-a437-94ded459d209 tempest-GroupSnapshotsTest-122027651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-3c46d91d-8de8-495b-8598-f8e18d53c8f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-3c46d91d-8de8-495b-8598-f8e18d53c8f7.47a096a4-5469-429f-bff9-eb97ffe780fb 1G {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-10456608-9bfe-483d-9c45-d5fb119f07b2 tempest-AttachVolumeNegativeTest-2039869332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a255f6c-db3f-4491-ab2c-686ec6468785" returned: 0 in 1.032s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-10456608-9bfe-483d-9c45-d5fb119f07b2 tempest-AttachVolumeNegativeTest-2039869332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a255f6c-db3f-4491-ab2c-686ec6468785 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:03 devstack sudo[95339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-3c46d91d-8de8-495b-8598-f8e18d53c8f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-3c46d91d-8de8-495b-8598-f8e18d53c8f7.47a096a4-5469-429f-bff9-eb97ffe780fb 1G Sep 25 11:44:03 devstack sudo[95339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:03 devstack sudo[95340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a255f6c-db3f-4491-ab2c-686ec6468785 Sep 25 11:44:03 devstack sudo[95340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:04 devstack sudo[95340]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:04 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-10456608-9bfe-483d-9c45-d5fb119f07b2 tempest-AttachVolumeNegativeTest-2039869332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a255f6c-db3f-4491-ab2c-686ec6468785" returned: 0 in 0.594s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:04 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-10456608-9bfe-483d-9c45-d5fb119f07b2 tempest-AttachVolumeNegativeTest-2039869332 None] Lock "cinder-quobyte-1a255f6c-db3f-4491-ab2c-686ec6468785" released by "delete_volume" :: held 1.735s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:44:04 devstack sudo[95339]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:04 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d11d34c4-fa3e-441e-a437-94ded459d209 tempest-GroupSnapshotsTest-122027651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-3c46d91d-8de8-495b-8598-f8e18d53c8f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-3c46d91d-8de8-495b-8598-f8e18d53c8f7.47a096a4-5469-429f-bff9-eb97ffe780fb 1G" returned: 0 in 0.733s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:04 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d11d34c4-fa3e-441e-a437-94ded459d209 tempest-GroupSnapshotsTest-122027651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c46d91d-8de8-495b-8598-f8e18d53c8f7 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-3c46d91d-8de8-495b-8598-f8e18d53c8f7.47a096a4-5469-429f-bff9-eb97ffe780fb {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:04 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-10456608-9bfe-483d-9c45-d5fb119f07b2 tempest-AttachVolumeNegativeTest-2039869332 None] Created reservations ['2e466b19-5512-4213-bb48-a508e508fa79', 'b2652e68-76a8-4be9-9206-6bee78750bee', 'ad0b5ea8-2ad6-4af1-ba28-8dc91fe992e1', '7b46a2a3-7eb4-4d65-9422-aa5577cdc892'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:44:04 devstack sudo[95363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c46d91d-8de8-495b-8598-f8e18d53c8f7 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-3c46d91d-8de8-495b-8598-f8e18d53c8f7.47a096a4-5469-429f-bff9-eb97ffe780fb Sep 25 11:44:04 devstack sudo[95363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:04 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-10456608-9bfe-483d-9c45-d5fb119f07b2 tempest-AttachVolumeNegativeTest-2039869332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:44:04 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-10456608-9bfe-483d-9c45-d5fb119f07b2 tempest-AttachVolumeNegativeTest-2039869332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:44:04 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-10456608-9bfe-483d-9c45-d5fb119f07b2 tempest-AttachVolumeNegativeTest-2039869332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:44:04 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-10456608-9bfe-483d-9c45-d5fb119f07b2 tempest-AttachVolumeNegativeTest-2039869332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:44:04 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-10456608-9bfe-483d-9c45-d5fb119f07b2 tempest-AttachVolumeNegativeTest-2039869332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:44:04 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-10456608-9bfe-483d-9c45-d5fb119f07b2 tempest-AttachVolumeNegativeTest-2039869332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:04 devstack sudo[95365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:44:04 devstack sudo[95365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:04 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-c3a53378-d093-4de9-895d-e9c74137d136 tempest-AttachVolumeNegativeTest-2039869332 None] Acquiring lock "cinder-6992cfbc-0b7f-450e-915e-7567dfea7f8c-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:44:04 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-c3a53378-d093-4de9-895d-e9c74137d136 tempest-AttachVolumeNegativeTest-2039869332 None] Lock "cinder-6992cfbc-0b7f-450e-915e-7567dfea7f8c-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:44:04 devstack sudo[95363]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:04 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d11d34c4-fa3e-441e-a437-94ded459d209 tempest-GroupSnapshotsTest-122027651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c46d91d-8de8-495b-8598-f8e18d53c8f7 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-3c46d91d-8de8-495b-8598-f8e18d53c8f7.47a096a4-5469-429f-bff9-eb97ffe780fb" returned: 0 in 0.593s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:04 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-d11d34c4-fa3e-441e-a437-94ded459d209 tempest-GroupSnapshotsTest-122027651 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-3c46d91d-8de8-495b-8598-f8e18d53c8f7.47a096a4-5469-429f-bff9-eb97ffe780fb is being set with open permissions: ugo+rw: NotImplementedError Sep 25 11:44:04 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d11d34c4-fa3e-441e-a437-94ded459d209 tempest-GroupSnapshotsTest-122027651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-3c46d91d-8de8-495b-8598-f8e18d53c8f7.47a096a4-5469-429f-bff9-eb97ffe780fb {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:04 devstack sudo[95365]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:04 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-10456608-9bfe-483d-9c45-d5fb119f07b2 tempest-AttachVolumeNegativeTest-2039869332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.509s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:04 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-10456608-9bfe-483d-9c45-d5fb119f07b2 tempest-AttachVolumeNegativeTest-2039869332 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:44:04 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-10456608-9bfe-483d-9c45-d5fb119f07b2 tempest-AttachVolumeNegativeTest-2039869332 None] Deleted volume successfully. Sep 25 11:44:04 devstack sudo[95371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-3c46d91d-8de8-495b-8598-f8e18d53c8f7.47a096a4-5469-429f-bff9-eb97ffe780fb Sep 25 11:44:04 devstack sudo[95371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:04 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-c3a53378-d093-4de9-895d-e9c74137d136 tempest-AttachVolumeNegativeTest-2039869332 None] Acquiring lock "cinder-quobyte-6992cfbc-0b7f-450e-915e-7567dfea7f8c" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:44:04 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-c3a53378-d093-4de9-895d-e9c74137d136 tempest-AttachVolumeNegativeTest-2039869332 None] Lock "cinder-quobyte-6992cfbc-0b7f-450e-915e-7567dfea7f8c" acquired by "delete_volume" :: waited 0.043s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:44:04 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-10456608-9bfe-483d-9c45-d5fb119f07b2 tempest-AttachVolumeNegativeTest-2039869332 None] Lock "cinder-1a255f6c-db3f-4491-ab2c-686ec6468785-delete_volume" released by "delete_volume" :: held 2.798s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:44:04 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f0e65e-41f0-453d-ab45-52bad34824cc]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:44:04 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-c3a53378-d093-4de9-895d-e9c74137d136 tempest-AttachVolumeNegativeTest-2039869332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6992cfbc-0b7f-450e-915e-7567dfea7f8c {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:05 devstack sudo[95373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6992cfbc-0b7f-450e-915e-7567dfea7f8c Sep 25 11:44:05 devstack sudo[95373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:05 devstack sudo[95371]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d11d34c4-fa3e-441e-a437-94ded459d209 tempest-GroupSnapshotsTest-122027651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-3c46d91d-8de8-495b-8598-f8e18d53c8f7.47a096a4-5469-429f-bff9-eb97ffe780fb" returned: 0 in 0.494s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d11d34c4-fa3e-441e-a437-94ded459d209 tempest-GroupSnapshotsTest-122027651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-3c46d91d-8de8-495b-8598-f8e18d53c8f7.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:05 devstack sudo[95376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-3c46d91d-8de8-495b-8598-f8e18d53c8f7.info Sep 25 11:44:05 devstack sudo[95376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:05 devstack sudo[95373]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-c3a53378-d093-4de9-895d-e9c74137d136 tempest-AttachVolumeNegativeTest-2039869332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6992cfbc-0b7f-450e-915e-7567dfea7f8c" returned: 0 in 0.698s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-c3a53378-d093-4de9-895d-e9c74137d136 tempest-AttachVolumeNegativeTest-2039869332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6992cfbc-0b7f-450e-915e-7567dfea7f8c {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:05 devstack sudo[95383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6992cfbc-0b7f-450e-915e-7567dfea7f8c Sep 25 11:44:05 devstack sudo[95383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:05 devstack sudo[95376]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d11d34c4-fa3e-441e-a437-94ded459d209 tempest-GroupSnapshotsTest-122027651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-3c46d91d-8de8-495b-8598-f8e18d53c8f7.info" returned: 0 in 0.502s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:05 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-d11d34c4-fa3e-441e-a437-94ded459d209 tempest-GroupSnapshotsTest-122027651 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-3c46d91d-8de8-495b-8598-f8e18d53c8f7.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 11:44:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d11d34c4-fa3e-441e-a437-94ded459d209 tempest-GroupSnapshotsTest-122027651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-3c46d91d-8de8-495b-8598-f8e18d53c8f7.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:05 devstack sudo[95386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-3c46d91d-8de8-495b-8598-f8e18d53c8f7.info Sep 25 11:44:05 devstack sudo[95386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:06 devstack sudo[95383]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-c3a53378-d093-4de9-895d-e9c74137d136 tempest-AttachVolumeNegativeTest-2039869332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6992cfbc-0b7f-450e-915e-7567dfea7f8c" returned: 0 in 0.386s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:06 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-c3a53378-d093-4de9-895d-e9c74137d136 tempest-AttachVolumeNegativeTest-2039869332 None] Lock "cinder-quobyte-6992cfbc-0b7f-450e-915e-7567dfea7f8c" released by "delete_volume" :: held 1.174s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:44:06 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-c3a53378-d093-4de9-895d-e9c74137d136 tempest-AttachVolumeNegativeTest-2039869332 None] Created reservations ['769967c0-3ae3-4f54-84aa-c253ec061b6b', '6ad131c0-d1d4-4e03-9ca9-14d915b9df36', '270b55c5-6f2d-49a4-8d11-0e2ade4d37fe', '0d7dc100-6cef-45b8-9db1-5cf4ee2c5571'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:44:06 devstack sudo[95386]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d11d34c4-fa3e-441e-a437-94ded459d209 tempest-GroupSnapshotsTest-122027651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-3c46d91d-8de8-495b-8598-f8e18d53c8f7.info" returned: 0 in 0.463s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d11d34c4-fa3e-441e-a437-94ded459d209 tempest-GroupSnapshotsTest-122027651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.132s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:44:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d11d34c4-fa3e-441e-a437-94ded459d209 tempest-GroupSnapshotsTest-122027651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:44:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d11d34c4-fa3e-441e-a437-94ded459d209 tempest-GroupSnapshotsTest-122027651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:44:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-c3a53378-d093-4de9-895d-e9c74137d136 tempest-AttachVolumeNegativeTest-2039869332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:44:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-c3a53378-d093-4de9-895d-e9c74137d136 tempest-AttachVolumeNegativeTest-2039869332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:44:06 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-c3a53378-d093-4de9-895d-e9c74137d136 tempest-AttachVolumeNegativeTest-2039869332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:44:06 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-c3a53378-d093-4de9-895d-e9c74137d136 tempest-AttachVolumeNegativeTest-2039869332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:44:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-c3a53378-d093-4de9-895d-e9c74137d136 tempest-AttachVolumeNegativeTest-2039869332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:44:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-c3a53378-d093-4de9-895d-e9c74137d136 tempest-AttachVolumeNegativeTest-2039869332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:06 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-d11d34c4-fa3e-441e-a437-94ded459d209 tempest-GroupSnapshotsTest-122027651 None] Creating offline snapshot e274eaf5-c9df-43c4-8202-b5f5e829cc51 of volume 928b2518-91ae-4f46-bbf5-a3f6e4a1499e {{(pid=86984) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:44:06 devstack sudo[95390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:44:06 devstack sudo[95390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:06 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[699a28f3-01f6-4c6b-9160-982295b4f17f]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:44:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d11d34c4-fa3e-441e-a437-94ded459d209 tempest-GroupSnapshotsTest-122027651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-928b2518-91ae-4f46-bbf5-a3f6e4a1499e {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:06 devstack sudo[95392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-928b2518-91ae-4f46-bbf5-a3f6e4a1499e Sep 25 11:44:06 devstack sudo[95392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:06 devstack sudo[95390]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-c3a53378-d093-4de9-895d-e9c74137d136 tempest-AttachVolumeNegativeTest-2039869332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.573s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:06 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-c3a53378-d093-4de9-895d-e9c74137d136 tempest-AttachVolumeNegativeTest-2039869332 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:44:06 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-c3a53378-d093-4de9-895d-e9c74137d136 tempest-AttachVolumeNegativeTest-2039869332 None] Deleted volume successfully. Sep 25 11:44:07 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-c3a53378-d093-4de9-895d-e9c74137d136 tempest-AttachVolumeNegativeTest-2039869332 None] Lock "cinder-6992cfbc-0b7f-450e-915e-7567dfea7f8c-delete_volume" released by "delete_volume" :: held 2.324s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:44:07 devstack sudo[95392]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d11d34c4-fa3e-441e-a437-94ded459d209 tempest-GroupSnapshotsTest-122027651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-928b2518-91ae-4f46-bbf5-a3f6e4a1499e" returned: 0 in 1.038s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d11d34c4-fa3e-441e-a437-94ded459d209 tempest-GroupSnapshotsTest-122027651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-928b2518-91ae-4f46-bbf5-a3f6e4a1499e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-928b2518-91ae-4f46-bbf5-a3f6e4a1499e.e274eaf5-c9df-43c4-8202-b5f5e829cc51 1G {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:07 devstack sudo[95398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-928b2518-91ae-4f46-bbf5-a3f6e4a1499e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-928b2518-91ae-4f46-bbf5-a3f6e4a1499e.e274eaf5-c9df-43c4-8202-b5f5e829cc51 1G Sep 25 11:44:07 devstack sudo[95398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:07 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-d586932b-7ec0-467c-88d0-848309529bb0 tempest-AttachVolumeNegativeTest-2039869332 None] Acquiring lock "cinder-23d96563-0d42-4ff5-bb2a-40dee012e3a4-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:44:07 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-d586932b-7ec0-467c-88d0-848309529bb0 tempest-AttachVolumeNegativeTest-2039869332 None] Lock "cinder-23d96563-0d42-4ff5-bb2a-40dee012e3a4-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:44:07 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-d586932b-7ec0-467c-88d0-848309529bb0 tempest-AttachVolumeNegativeTest-2039869332 None] Acquiring lock "cinder-quobyte-23d96563-0d42-4ff5-bb2a-40dee012e3a4" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:44:08 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-d586932b-7ec0-467c-88d0-848309529bb0 tempest-AttachVolumeNegativeTest-2039869332 None] Lock "cinder-quobyte-23d96563-0d42-4ff5-bb2a-40dee012e3a4" acquired by "delete_volume" :: waited 0.057s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:44:08 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e24cb1e-307d-4a80-be3e-7a4b734d6def]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:44:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d586932b-7ec0-467c-88d0-848309529bb0 tempest-AttachVolumeNegativeTest-2039869332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23d96563-0d42-4ff5-bb2a-40dee012e3a4 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:08 devstack sudo[95400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23d96563-0d42-4ff5-bb2a-40dee012e3a4 Sep 25 11:44:08 devstack sudo[95400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:08 devstack sudo[95398]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d11d34c4-fa3e-441e-a437-94ded459d209 tempest-GroupSnapshotsTest-122027651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-928b2518-91ae-4f46-bbf5-a3f6e4a1499e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-928b2518-91ae-4f46-bbf5-a3f6e4a1499e.e274eaf5-c9df-43c4-8202-b5f5e829cc51 1G" returned: 0 in 1.293s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d11d34c4-fa3e-441e-a437-94ded459d209 tempest-GroupSnapshotsTest-122027651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-928b2518-91ae-4f46-bbf5-a3f6e4a1499e -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-928b2518-91ae-4f46-bbf5-a3f6e4a1499e.e274eaf5-c9df-43c4-8202-b5f5e829cc51 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:08 devstack sudo[95405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-928b2518-91ae-4f46-bbf5-a3f6e4a1499e -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-928b2518-91ae-4f46-bbf5-a3f6e4a1499e.e274eaf5-c9df-43c4-8202-b5f5e829cc51 Sep 25 11:44:08 devstack sudo[95405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:09 devstack sudo[95400]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d586932b-7ec0-467c-88d0-848309529bb0 tempest-AttachVolumeNegativeTest-2039869332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23d96563-0d42-4ff5-bb2a-40dee012e3a4" returned: 0 in 1.042s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d586932b-7ec0-467c-88d0-848309529bb0 tempest-AttachVolumeNegativeTest-2039869332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23d96563-0d42-4ff5-bb2a-40dee012e3a4 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:09 devstack sudo[95410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23d96563-0d42-4ff5-bb2a-40dee012e3a4 Sep 25 11:44:09 devstack sudo[95410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:09 devstack sudo[95405]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d11d34c4-fa3e-441e-a437-94ded459d209 tempest-GroupSnapshotsTest-122027651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-928b2518-91ae-4f46-bbf5-a3f6e4a1499e -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-928b2518-91ae-4f46-bbf5-a3f6e4a1499e.e274eaf5-c9df-43c4-8202-b5f5e829cc51" returned: 0 in 0.858s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:09 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-d11d34c4-fa3e-441e-a437-94ded459d209 tempest-GroupSnapshotsTest-122027651 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-928b2518-91ae-4f46-bbf5-a3f6e4a1499e.e274eaf5-c9df-43c4-8202-b5f5e829cc51 is being set with open permissions: ugo+rw: NotImplementedError Sep 25 11:44:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d11d34c4-fa3e-441e-a437-94ded459d209 tempest-GroupSnapshotsTest-122027651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-928b2518-91ae-4f46-bbf5-a3f6e4a1499e.e274eaf5-c9df-43c4-8202-b5f5e829cc51 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:09 devstack sudo[95417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-928b2518-91ae-4f46-bbf5-a3f6e4a1499e.e274eaf5-c9df-43c4-8202-b5f5e829cc51 Sep 25 11:44:09 devstack sudo[95417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:10 devstack sudo[95410]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d586932b-7ec0-467c-88d0-848309529bb0 tempest-AttachVolumeNegativeTest-2039869332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23d96563-0d42-4ff5-bb2a-40dee012e3a4" returned: 0 in 0.845s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:10 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-d586932b-7ec0-467c-88d0-848309529bb0 tempest-AttachVolumeNegativeTest-2039869332 None] Lock "cinder-quobyte-23d96563-0d42-4ff5-bb2a-40dee012e3a4" released by "delete_volume" :: held 2.011s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:44:10 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-d586932b-7ec0-467c-88d0-848309529bb0 tempest-AttachVolumeNegativeTest-2039869332 None] Created reservations ['113fd625-0972-412c-ad74-3dcd2a9cd0dc', '06aaf43f-d31d-4c02-a45c-298903cf60c7', 'f461730e-1d7e-4cc0-8956-1f74175c896a', '346fd12d-e3b3-479a-83f1-2d43b405ff5f'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:44:10 devstack sudo[95417]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d11d34c4-fa3e-441e-a437-94ded459d209 tempest-GroupSnapshotsTest-122027651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-928b2518-91ae-4f46-bbf5-a3f6e4a1499e.e274eaf5-c9df-43c4-8202-b5f5e829cc51" returned: 0 in 0.630s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d11d34c4-fa3e-441e-a437-94ded459d209 tempest-GroupSnapshotsTest-122027651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-928b2518-91ae-4f46-bbf5-a3f6e4a1499e.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:10 devstack cinder-volume[86984]: DEBUG dbcounter [-] [86984] Writing DB stats cinder:SELECT=89,cinder:INSERT=27,cinder:UPDATE=77,cinder:DELETE=6 {{(pid=86984) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:44:10 devstack sudo[95422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-928b2518-91ae-4f46-bbf5-a3f6e4a1499e.info Sep 25 11:44:10 devstack sudo[95422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d586932b-7ec0-467c-88d0-848309529bb0 tempest-AttachVolumeNegativeTest-2039869332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:44:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d586932b-7ec0-467c-88d0-848309529bb0 tempest-AttachVolumeNegativeTest-2039869332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:44:10 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-d586932b-7ec0-467c-88d0-848309529bb0 tempest-AttachVolumeNegativeTest-2039869332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:44:10 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-d586932b-7ec0-467c-88d0-848309529bb0 tempest-AttachVolumeNegativeTest-2039869332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:44:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d586932b-7ec0-467c-88d0-848309529bb0 tempest-AttachVolumeNegativeTest-2039869332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:44:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d586932b-7ec0-467c-88d0-848309529bb0 tempest-AttachVolumeNegativeTest-2039869332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:10 devstack sudo[95424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:44:10 devstack sudo[95424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:11 devstack sudo[95422]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d11d34c4-fa3e-441e-a437-94ded459d209 tempest-GroupSnapshotsTest-122027651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-928b2518-91ae-4f46-bbf5-a3f6e4a1499e.info" returned: 0 in 0.812s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:11 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-d11d34c4-fa3e-441e-a437-94ded459d209 tempest-GroupSnapshotsTest-122027651 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-928b2518-91ae-4f46-bbf5-a3f6e4a1499e.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 11:44:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d11d34c4-fa3e-441e-a437-94ded459d209 tempest-GroupSnapshotsTest-122027651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-928b2518-91ae-4f46-bbf5-a3f6e4a1499e.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:11 devstack sudo[95428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-928b2518-91ae-4f46-bbf5-a3f6e4a1499e.info Sep 25 11:44:11 devstack sudo[95428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:11 devstack sudo[95424]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d586932b-7ec0-467c-88d0-848309529bb0 tempest-AttachVolumeNegativeTest-2039869332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.821s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:11 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-d586932b-7ec0-467c-88d0-848309529bb0 tempest-AttachVolumeNegativeTest-2039869332 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:44:11 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-d586932b-7ec0-467c-88d0-848309529bb0 tempest-AttachVolumeNegativeTest-2039869332 None] Deleted volume successfully. Sep 25 11:44:11 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-d586932b-7ec0-467c-88d0-848309529bb0 tempest-AttachVolumeNegativeTest-2039869332 None] Lock "cinder-23d96563-0d42-4ff5-bb2a-40dee012e3a4-delete_volume" released by "delete_volume" :: held 3.663s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:44:11 devstack sudo[95428]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d11d34c4-fa3e-441e-a437-94ded459d209 tempest-GroupSnapshotsTest-122027651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-928b2518-91ae-4f46-bbf5-a3f6e4a1499e.info" returned: 0 in 0.702s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d11d34c4-fa3e-441e-a437-94ded459d209 tempest-GroupSnapshotsTest-122027651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.645s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:44:12 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-d11d34c4-fa3e-441e-a437-94ded459d209 tempest-GroupSnapshotsTest-122027651 None] group_snapshot a1321b8f-2a90-4bc4-b4f8-f9594a7ad566: created successfully Sep 25 11:44:12 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-7f327420-171f-4a1c-89a3-c06b30f84921 tempest-GroupSnapshotsTest-122027651 None] group_snapshot a1321b8f-2a90-4bc4-b4f8-f9594a7ad566: deleting Sep 25 11:44:13 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7f327420-171f-4a1c-89a3-c06b30f84921 tempest-GroupSnapshotsTest-122027651 None] group_snapshot a1321b8f-2a90-4bc4-b4f8-f9594a7ad566: deleting {{(pid=86984) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 25 11:44:13 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-7f327420-171f-4a1c-89a3-c06b30f84921 tempest-GroupSnapshotsTest-122027651 None] Acquiring lock "cinder-quobyte-3c46d91d-8de8-495b-8598-f8e18d53c8f7" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:44:13 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-7f327420-171f-4a1c-89a3-c06b30f84921 tempest-GroupSnapshotsTest-122027651 None] Lock "cinder-quobyte-3c46d91d-8de8-495b-8598-f8e18d53c8f7" acquired by "delete_snapshot" :: waited 0.065s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:44:13 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-7f327420-171f-4a1c-89a3-c06b30f84921 tempest-GroupSnapshotsTest-122027651 None] Acquiring lock "cinder-quobyte-47a096a4-5469-429f-bff9-eb97ffe780fb" by "_delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:44:13 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-7f327420-171f-4a1c-89a3-c06b30f84921 tempest-GroupSnapshotsTest-122027651 None] Lock "cinder-quobyte-47a096a4-5469-429f-bff9-eb97ffe780fb" acquired by "_delete_snapshot" :: waited 0.077s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:44:13 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-7f327420-171f-4a1c-89a3-c06b30f84921 tempest-GroupSnapshotsTest-122027651 None] Deleting offline snapshot 47a096a4-5469-429f-bff9-eb97ffe780fb of volume 3c46d91d-8de8-495b-8598-f8e18d53c8f7 {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:44:13 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-7f327420-171f-4a1c-89a3-c06b30f84921 tempest-GroupSnapshotsTest-122027651 None] snapshot_file for this snap is: volume-3c46d91d-8de8-495b-8598-f8e18d53c8f7.47a096a4-5469-429f-bff9-eb97ffe780fb {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:44:13 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[81cb05bc-c510-4a62-9596-8b3f3f076e62]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:44:13 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7f327420-171f-4a1c-89a3-c06b30f84921 tempest-GroupSnapshotsTest-122027651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-3c46d91d-8de8-495b-8598-f8e18d53c8f7.47a096a4-5469-429f-bff9-eb97ffe780fb {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:13 devstack sudo[95436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-3c46d91d-8de8-495b-8598-f8e18d53c8f7.47a096a4-5469-429f-bff9-eb97ffe780fb Sep 25 11:44:13 devstack sudo[95436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:15 devstack sudo[95436]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:15 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7f327420-171f-4a1c-89a3-c06b30f84921 tempest-GroupSnapshotsTest-122027651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-3c46d91d-8de8-495b-8598-f8e18d53c8f7.47a096a4-5469-429f-bff9-eb97ffe780fb" returned: 0 in 1.545s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:15 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-7f327420-171f-4a1c-89a3-c06b30f84921 tempest-GroupSnapshotsTest-122027651 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c46d91d-8de8-495b-8598-f8e18d53c8f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86984) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:44:15 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c108944-7c2e-4dc6-9def-90126e1fbfd8]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:44:15 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7f327420-171f-4a1c-89a3-c06b30f84921 tempest-GroupSnapshotsTest-122027651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-3c46d91d-8de8-495b-8598-f8e18d53c8f7 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:15 devstack sudo[95453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-3c46d91d-8de8-495b-8598-f8e18d53c8f7 Sep 25 11:44:15 devstack sudo[95453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:16 devstack sudo[95453]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:16 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7f327420-171f-4a1c-89a3-c06b30f84921 tempest-GroupSnapshotsTest-122027651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-3c46d91d-8de8-495b-8598-f8e18d53c8f7" returned: 0 in 1.259s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:16 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7f327420-171f-4a1c-89a3-c06b30f84921 tempest-GroupSnapshotsTest-122027651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-3c46d91d-8de8-495b-8598-f8e18d53c8f7.47a096a4-5469-429f-bff9-eb97ffe780fb {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:16 devstack sudo[95459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-3c46d91d-8de8-495b-8598-f8e18d53c8f7.47a096a4-5469-429f-bff9-eb97ffe780fb Sep 25 11:44:16 devstack sudo[95459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:17 devstack sudo[95459]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:17 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7f327420-171f-4a1c-89a3-c06b30f84921 tempest-GroupSnapshotsTest-122027651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-3c46d91d-8de8-495b-8598-f8e18d53c8f7.47a096a4-5469-429f-bff9-eb97ffe780fb" returned: 0 in 0.884s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:17 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7f327420-171f-4a1c-89a3-c06b30f84921 tempest-GroupSnapshotsTest-122027651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-3c46d91d-8de8-495b-8598-f8e18d53c8f7.47a096a4-5469-429f-bff9-eb97ffe780fb {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:17 devstack sudo[95468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-3c46d91d-8de8-495b-8598-f8e18d53c8f7.47a096a4-5469-429f-bff9-eb97ffe780fb Sep 25 11:44:17 devstack sudo[95468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:17 devstack sudo[95468]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:17 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7f327420-171f-4a1c-89a3-c06b30f84921 tempest-GroupSnapshotsTest-122027651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-3c46d91d-8de8-495b-8598-f8e18d53c8f7.47a096a4-5469-429f-bff9-eb97ffe780fb" returned: 0 in 0.563s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:18 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-7f327420-171f-4a1c-89a3-c06b30f84921 tempest-GroupSnapshotsTest-122027651 None] Lock "cinder-quobyte-47a096a4-5469-429f-bff9-eb97ffe780fb" released by "_delete_snapshot" :: held 4.594s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:44:18 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-7f327420-171f-4a1c-89a3-c06b30f84921 tempest-GroupSnapshotsTest-122027651 None] Lock "cinder-quobyte-3c46d91d-8de8-495b-8598-f8e18d53c8f7" released by "delete_snapshot" :: held 4.692s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:44:18 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-7f327420-171f-4a1c-89a3-c06b30f84921 tempest-GroupSnapshotsTest-122027651 None] Acquiring lock "cinder-quobyte-928b2518-91ae-4f46-bbf5-a3f6e4a1499e" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:44:18 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-7f327420-171f-4a1c-89a3-c06b30f84921 tempest-GroupSnapshotsTest-122027651 None] Lock "cinder-quobyte-928b2518-91ae-4f46-bbf5-a3f6e4a1499e" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:44:18 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-7f327420-171f-4a1c-89a3-c06b30f84921 tempest-GroupSnapshotsTest-122027651 None] Acquiring lock "cinder-quobyte-e274eaf5-c9df-43c4-8202-b5f5e829cc51" by "_delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:44:18 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-7f327420-171f-4a1c-89a3-c06b30f84921 tempest-GroupSnapshotsTest-122027651 None] Lock "cinder-quobyte-e274eaf5-c9df-43c4-8202-b5f5e829cc51" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:44:18 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-7f327420-171f-4a1c-89a3-c06b30f84921 tempest-GroupSnapshotsTest-122027651 None] Deleting offline snapshot e274eaf5-c9df-43c4-8202-b5f5e829cc51 of volume 928b2518-91ae-4f46-bbf5-a3f6e4a1499e {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:44:18 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-7f327420-171f-4a1c-89a3-c06b30f84921 tempest-GroupSnapshotsTest-122027651 None] snapshot_file for this snap is: volume-928b2518-91ae-4f46-bbf5-a3f6e4a1499e.e274eaf5-c9df-43c4-8202-b5f5e829cc51 {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:44:18 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be0cfa1-782e-4dd3-9705-2825cabbf875]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:44:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7f327420-171f-4a1c-89a3-c06b30f84921 tempest-GroupSnapshotsTest-122027651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-928b2518-91ae-4f46-bbf5-a3f6e4a1499e.e274eaf5-c9df-43c4-8202-b5f5e829cc51 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:18 devstack sudo[95474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-928b2518-91ae-4f46-bbf5-a3f6e4a1499e.e274eaf5-c9df-43c4-8202-b5f5e829cc51 Sep 25 11:44:18 devstack sudo[95474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:19 devstack sudo[95474]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:19 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7f327420-171f-4a1c-89a3-c06b30f84921 tempest-GroupSnapshotsTest-122027651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-928b2518-91ae-4f46-bbf5-a3f6e4a1499e.e274eaf5-c9df-43c4-8202-b5f5e829cc51" returned: 0 in 0.825s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:19 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-7f327420-171f-4a1c-89a3-c06b30f84921 tempest-GroupSnapshotsTest-122027651 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-928b2518-91ae-4f46-bbf5-a3f6e4a1499e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86984) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:44:19 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ef990b-c0d7-4822-9795-a5794868a683]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:44:19 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7f327420-171f-4a1c-89a3-c06b30f84921 tempest-GroupSnapshotsTest-122027651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-928b2518-91ae-4f46-bbf5-a3f6e4a1499e {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:19 devstack sudo[95487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-928b2518-91ae-4f46-bbf5-a3f6e4a1499e Sep 25 11:44:19 devstack sudo[95487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:20 devstack sudo[95487]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7f327420-171f-4a1c-89a3-c06b30f84921 tempest-GroupSnapshotsTest-122027651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-928b2518-91ae-4f46-bbf5-a3f6e4a1499e" returned: 0 in 1.391s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7f327420-171f-4a1c-89a3-c06b30f84921 tempest-GroupSnapshotsTest-122027651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-928b2518-91ae-4f46-bbf5-a3f6e4a1499e.e274eaf5-c9df-43c4-8202-b5f5e829cc51 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:20 devstack sudo[95509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-928b2518-91ae-4f46-bbf5-a3f6e4a1499e.e274eaf5-c9df-43c4-8202-b5f5e829cc51 Sep 25 11:44:20 devstack sudo[95509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:21 devstack sudo[95509]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:21 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7f327420-171f-4a1c-89a3-c06b30f84921 tempest-GroupSnapshotsTest-122027651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-928b2518-91ae-4f46-bbf5-a3f6e4a1499e.e274eaf5-c9df-43c4-8202-b5f5e829cc51" returned: 0 in 0.686s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:21 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7f327420-171f-4a1c-89a3-c06b30f84921 tempest-GroupSnapshotsTest-122027651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-928b2518-91ae-4f46-bbf5-a3f6e4a1499e.e274eaf5-c9df-43c4-8202-b5f5e829cc51 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:21 devstack sudo[95539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-928b2518-91ae-4f46-bbf5-a3f6e4a1499e.e274eaf5-c9df-43c4-8202-b5f5e829cc51 Sep 25 11:44:21 devstack sudo[95539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:21 devstack sudo[95539]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:21 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7f327420-171f-4a1c-89a3-c06b30f84921 tempest-GroupSnapshotsTest-122027651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-928b2518-91ae-4f46-bbf5-a3f6e4a1499e.e274eaf5-c9df-43c4-8202-b5f5e829cc51" returned: 0 in 0.702s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:22 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-7f327420-171f-4a1c-89a3-c06b30f84921 tempest-GroupSnapshotsTest-122027651 None] Lock "cinder-quobyte-e274eaf5-c9df-43c4-8202-b5f5e829cc51" released by "_delete_snapshot" :: held 3.849s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:44:22 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-7f327420-171f-4a1c-89a3-c06b30f84921 tempest-GroupSnapshotsTest-122027651 None] Lock "cinder-quobyte-928b2518-91ae-4f46-bbf5-a3f6e4a1499e" released by "delete_snapshot" :: held 3.894s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:44:22 devstack cinder-volume[86984]: WARNING cinder.quota [None req-7f327420-171f-4a1c-89a3-c06b30f84921 tempest-GroupSnapshotsTest-122027651 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-390321021 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-390321021, it is now deprecated. Please use the default quota class for default quota. Sep 25 11:44:22 devstack cinder-volume[86984]: WARNING cinder.quota [None req-7f327420-171f-4a1c-89a3-c06b30f84921 tempest-GroupSnapshotsTest-122027651 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-390321021 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-390321021, it is now deprecated. Please use the default quota class for default quota. Sep 25 11:44:22 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-7f327420-171f-4a1c-89a3-c06b30f84921 tempest-GroupSnapshotsTest-122027651 None] Created reservations ['57af3260-dc47-439b-b6e5-db1b0672b629', 'e543a3d7-50ac-486d-8bb4-76c1e6e84cea', '8cb5b3e7-faa6-470a-b30a-103141a9242b', '07f7f1b1-0d24-4d03-90c9-025e2cf4913f'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:44:22 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-7f327420-171f-4a1c-89a3-c06b30f84921 tempest-GroupSnapshotsTest-122027651 None] Created reservations ['795cee85-988d-43f8-957c-cef5db49115d', '56bb8d79-c957-4777-9579-a5cfa5496f81', 'cc047995-d78c-498c-bf1b-7fc6bf2f0543', '64910fe8-a22d-462a-bd48-bbba4d04bf24'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:44:22 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-7f327420-171f-4a1c-89a3-c06b30f84921 tempest-GroupSnapshotsTest-122027651 None] group_snapshot a1321b8f-2a90-4bc4-b4f8-f9594a7ad566: deleted successfully Sep 25 11:44:23 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-71cf8f51-a261-4667-9c8b-d353b4cbbc01 tempest-GroupSnapshotsTest-122027651 None] Acquiring lock "cinder-quobyte-3c46d91d-8de8-495b-8598-f8e18d53c8f7" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:44:23 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-71cf8f51-a261-4667-9c8b-d353b4cbbc01 tempest-GroupSnapshotsTest-122027651 None] Lock "cinder-quobyte-3c46d91d-8de8-495b-8598-f8e18d53c8f7" acquired by "delete_volume" :: waited 0.045s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:44:24 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd41d8d-4b17-4c56-9c0e-1a886523f57e]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:44:24 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-71cf8f51-a261-4667-9c8b-d353b4cbbc01 tempest-GroupSnapshotsTest-122027651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-3c46d91d-8de8-495b-8598-f8e18d53c8f7 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:24 devstack sudo[95546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-3c46d91d-8de8-495b-8598-f8e18d53c8f7 Sep 25 11:44:24 devstack sudo[95546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:25 devstack sudo[95546]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:25 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-71cf8f51-a261-4667-9c8b-d353b4cbbc01 tempest-GroupSnapshotsTest-122027651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-3c46d91d-8de8-495b-8598-f8e18d53c8f7" returned: 0 in 1.238s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:25 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-71cf8f51-a261-4667-9c8b-d353b4cbbc01 tempest-GroupSnapshotsTest-122027651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-3c46d91d-8de8-495b-8598-f8e18d53c8f7 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:25 devstack sudo[95557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-3c46d91d-8de8-495b-8598-f8e18d53c8f7 Sep 25 11:44:25 devstack sudo[95557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:25 devstack sudo[95557]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:25 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-71cf8f51-a261-4667-9c8b-d353b4cbbc01 tempest-GroupSnapshotsTest-122027651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-3c46d91d-8de8-495b-8598-f8e18d53c8f7" returned: 0 in 0.494s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:25 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-71cf8f51-a261-4667-9c8b-d353b4cbbc01 tempest-GroupSnapshotsTest-122027651 None] Lock "cinder-quobyte-3c46d91d-8de8-495b-8598-f8e18d53c8f7" released by "delete_volume" :: held 1.935s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:44:25 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-71cf8f51-a261-4667-9c8b-d353b4cbbc01 tempest-GroupSnapshotsTest-122027651 None] Acquiring lock "cinder-quobyte-928b2518-91ae-4f46-bbf5-a3f6e4a1499e" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:44:25 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-71cf8f51-a261-4667-9c8b-d353b4cbbc01 tempest-GroupSnapshotsTest-122027651 None] Lock "cinder-quobyte-928b2518-91ae-4f46-bbf5-a3f6e4a1499e" acquired by "delete_volume" :: waited 0.039s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:44:25 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[74cd2ff4-237e-4945-b943-5d5c6f1195ae]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:44:26 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-71cf8f51-a261-4667-9c8b-d353b4cbbc01 tempest-GroupSnapshotsTest-122027651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-928b2518-91ae-4f46-bbf5-a3f6e4a1499e {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:26 devstack sudo[95560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-928b2518-91ae-4f46-bbf5-a3f6e4a1499e Sep 25 11:44:26 devstack sudo[95560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:26 devstack sudo[95560]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:26 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-71cf8f51-a261-4667-9c8b-d353b4cbbc01 tempest-GroupSnapshotsTest-122027651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-928b2518-91ae-4f46-bbf5-a3f6e4a1499e" returned: 0 in 0.738s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:26 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-71cf8f51-a261-4667-9c8b-d353b4cbbc01 tempest-GroupSnapshotsTest-122027651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-928b2518-91ae-4f46-bbf5-a3f6e4a1499e {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:26 devstack sudo[95565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-928b2518-91ae-4f46-bbf5-a3f6e4a1499e Sep 25 11:44:26 devstack sudo[95565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:27 devstack sudo[95565]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:27 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-71cf8f51-a261-4667-9c8b-d353b4cbbc01 tempest-GroupSnapshotsTest-122027651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-928b2518-91ae-4f46-bbf5-a3f6e4a1499e" returned: 0 in 0.562s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:27 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-71cf8f51-a261-4667-9c8b-d353b4cbbc01 tempest-GroupSnapshotsTest-122027651 None] Lock "cinder-quobyte-928b2518-91ae-4f46-bbf5-a3f6e4a1499e" released by "delete_volume" :: held 1.476s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:44:27 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-71cf8f51-a261-4667-9c8b-d353b4cbbc01 tempest-GroupSnapshotsTest-122027651 None] Created reservations ['ea9409fc-67c1-491d-b493-0e582a36c5b9'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:44:27 devstack cinder-volume[86984]: WARNING cinder.quota [None req-71cf8f51-a261-4667-9c8b-d353b4cbbc01 tempest-GroupSnapshotsTest-122027651 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-390321021 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-390321021, it is now deprecated. Please use the default quota class for default quota. Sep 25 11:44:27 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-71cf8f51-a261-4667-9c8b-d353b4cbbc01 tempest-GroupSnapshotsTest-122027651 None] Created reservations ['094f9b42-18e3-467b-95d2-199c69923ab5', '21885a1f-f450-4316-93d4-e315de28d838', '3a7ee650-dfbf-4dca-a03e-6d030fd5cff8', '22d0724c-300c-431a-bcc1-fdc28ef4c1a0'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:44:28 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-71cf8f51-a261-4667-9c8b-d353b4cbbc01 tempest-GroupSnapshotsTest-122027651 None] Created reservations ['c78f2568-a1a1-4207-a423-854dd16aeac8', '9404b59f-1f3a-4fce-bb60-1c7d859e57f7', 'c096b2fe-0222-442a-97f7-7ad03083d046', '5af04704-53d0-486a-bb2a-e204cc6f4d82'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:44:28 devstack cinder-volume[86984]: DEBUG dbcounter [-] [86984] Writing DB stats cinder:SELECT=123,cinder:UPDATE=114,cinder:INSERT=32,cinder:DELETE=1 {{(pid=86984) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:44:28 devstack cinder-volume[86984]: INFO cinder.volume.manager [req-98d2610b-9d46-492c-9646-37455e01b037 req-8ec89920-30f3-473a-8e6c-553c810f8d24 tempest-ServerActionsTestOtherA-778028304 None] Terminate volume connection completed successfully. Sep 25 11:44:28 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [req-98d2610b-9d46-492c-9646-37455e01b037 req-8ec89920-30f3-473a-8e6c-553c810f8d24 tempest-ServerActionsTestOtherA-778028304 None] Deleting attachment 6f22b6ba-ee8e-4310-af1e-61c7288c32f9. {{(pid=86984) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 11:44:28 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-71cf8f51-a261-4667-9c8b-d353b4cbbc01 tempest-GroupSnapshotsTest-122027651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:44:28 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-71cf8f51-a261-4667-9c8b-d353b4cbbc01 tempest-GroupSnapshotsTest-122027651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:44:28 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-71cf8f51-a261-4667-9c8b-d353b4cbbc01 tempest-GroupSnapshotsTest-122027651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:44:28 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-71cf8f51-a261-4667-9c8b-d353b4cbbc01 tempest-GroupSnapshotsTest-122027651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:44:28 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-71cf8f51-a261-4667-9c8b-d353b4cbbc01 tempest-GroupSnapshotsTest-122027651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:44:28 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-71cf8f51-a261-4667-9c8b-d353b4cbbc01 tempest-GroupSnapshotsTest-122027651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:28 devstack sudo[95594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:44:28 devstack sudo[95594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:28 devstack sudo[95594]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:28 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-71cf8f51-a261-4667-9c8b-d353b4cbbc01 tempest-GroupSnapshotsTest-122027651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.385s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:28 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-71cf8f51-a261-4667-9c8b-d353b4cbbc01 tempest-GroupSnapshotsTest-122027651 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:44:28 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-71cf8f51-a261-4667-9c8b-d353b4cbbc01 tempest-GroupSnapshotsTest-122027651 None] Delete group completed successfully. Sep 25 11:44:30 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-e37d51b1-1917-482f-b9db-0797d42f290b tempest-GroupSnapshotsTest-122027651 None] Group tempest-GroupSnapshotsTest-Group-516688449: creating Sep 25 11:44:30 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-e37d51b1-1917-482f-b9db-0797d42f290b tempest-GroupSnapshotsTest-122027651 None] Group tempest-GroupSnapshotsTest-Group-516688449: created successfully Sep 25 11:44:30 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-e37d51b1-1917-482f-b9db-0797d42f290b tempest-GroupSnapshotsTest-122027651 None] Create group completed successfully. Sep 25 11:44:30 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-98d2610b-9d46-492c-9646-37455e01b037 req-1ca1a5bd-0ba0-403f-bbd8-ff9285b5f967 tempest-ServerActionsTestOtherA-778028304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:44:30 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-98d2610b-9d46-492c-9646-37455e01b037 req-1ca1a5bd-0ba0-403f-bbd8-ff9285b5f967 tempest-ServerActionsTestOtherA-778028304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:44:30 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-98d2610b-9d46-492c-9646-37455e01b037 req-1ca1a5bd-0ba0-403f-bbd8-ff9285b5f967 tempest-ServerActionsTestOtherA-778028304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:44:31 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [req-98d2610b-9d46-492c-9646-37455e01b037 req-1ca1a5bd-0ba0-403f-bbd8-ff9285b5f967 tempest-ServerActionsTestOtherA-778028304 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba', 'name': 'volume-344bc46e-74be-455c-898f-6aae2435500d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '88ffa181-dec4-4787-a3b0-49b286261f17', 'enforce_multipath': True} {{(pid=86984) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 11:44:31 devstack cinder-volume[86984]: INFO cinder.volume.manager [req-98d2610b-9d46-492c-9646-37455e01b037 req-1ca1a5bd-0ba0-403f-bbd8-ff9285b5f967 tempest-ServerActionsTestOtherA-778028304 None] attachment_update completed successfully. Sep 25 11:44:31 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [req-6964d813-7351-4f26-8b61-d667a203d5c0 req-12541d5a-c34d-46da-bb17-76eef4ffd3f1 tempest-VolumesSnapshotsTestJSON-797010404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:44:31 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [req-6964d813-7351-4f26-8b61-d667a203d5c0 req-12541d5a-c34d-46da-bb17-76eef4ffd3f1 tempest-VolumesSnapshotsTestJSON-797010404 None] Flow 'volume_create_manager' (ecbae23f-f652-437f-8c93-80ac0f33ec53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:44:31 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [req-6964d813-7351-4f26-8b61-d667a203d5c0 req-12541d5a-c34d-46da-bb17-76eef4ffd3f1 tempest-VolumesSnapshotsTestJSON-797010404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4bc6b6e-4d2b-4fca-80de-8fecab731734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:44:31 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [req-6964d813-7351-4f26-8b61-d667a203d5c0 req-12541d5a-c34d-46da-bb17-76eef4ffd3f1 tempest-VolumesSnapshotsTestJSON-797010404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4bc6b6e-4d2b-4fca-80de-8fecab731734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:44:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-720024196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a55e394-0fd5-4bf9-bce7-184ef556e657,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36546f32e48d42678cbee11cd8f6ce2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:44:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:44:31Z,use_quota=True,user_id='882a04f4b4ed42938f6046e9c868451f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:44:31 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [req-6964d813-7351-4f26-8b61-d667a203d5c0 req-12541d5a-c34d-46da-bb17-76eef4ffd3f1 tempest-VolumesSnapshotsTestJSON-797010404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7be011c1-95e8-4165-8eec-a0ef3bd57060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:44:31 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [req-6964d813-7351-4f26-8b61-d667a203d5c0 req-12541d5a-c34d-46da-bb17-76eef4ffd3f1 tempest-VolumesSnapshotsTestJSON-797010404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7be011c1-95e8-4165-8eec-a0ef3bd57060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:44:31 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [req-6964d813-7351-4f26-8b61-d667a203d5c0 req-12541d5a-c34d-46da-bb17-76eef4ffd3f1 tempest-VolumesSnapshotsTestJSON-797010404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05646309-0870-4411-92a1-d6bf32cac3a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:44:31 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [req-6964d813-7351-4f26-8b61-d667a203d5c0 req-12541d5a-c34d-46da-bb17-76eef4ffd3f1 tempest-VolumesSnapshotsTestJSON-797010404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05646309-0870-4411-92a1-d6bf32cac3a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a55e394-0fd5-4bf9-bce7-184ef556e657', 'volume_name': 'volume-5a55e394-0fd5-4bf9-bce7-184ef556e657', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:44:31 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [req-6964d813-7351-4f26-8b61-d667a203d5c0 req-12541d5a-c34d-46da-bb17-76eef4ffd3f1 tempest-VolumesSnapshotsTestJSON-797010404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5295d09-86e6-4275-8e7f-6c6e67fa910c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:44:31 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [req-6964d813-7351-4f26-8b61-d667a203d5c0 req-12541d5a-c34d-46da-bb17-76eef4ffd3f1 tempest-VolumesSnapshotsTestJSON-797010404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5295d09-86e6-4275-8e7f-6c6e67fa910c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:44:31 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [req-6964d813-7351-4f26-8b61-d667a203d5c0 req-12541d5a-c34d-46da-bb17-76eef4ffd3f1 tempest-VolumesSnapshotsTestJSON-797010404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c09b363-f601-4cf3-a1f2-d9e6a497f03f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:44:31 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [req-6964d813-7351-4f26-8b61-d667a203d5c0 req-12541d5a-c34d-46da-bb17-76eef4ffd3f1 tempest-VolumesSnapshotsTestJSON-797010404 None] Volume 5a55e394-0fd5-4bf9-bce7-184ef556e657: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a55e394-0fd5-4bf9-bce7-184ef556e657', 'volume_size': 1} Sep 25 11:44:31 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-6964d813-7351-4f26-8b61-d667a203d5c0 req-12541d5a-c34d-46da-bb17-76eef4ffd3f1 tempest-VolumesSnapshotsTestJSON-797010404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:44:31 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-6964d813-7351-4f26-8b61-d667a203d5c0 req-12541d5a-c34d-46da-bb17-76eef4ffd3f1 tempest-VolumesSnapshotsTestJSON-797010404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:44:31 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [req-6964d813-7351-4f26-8b61-d667a203d5c0 req-12541d5a-c34d-46da-bb17-76eef4ffd3f1 tempest-VolumesSnapshotsTestJSON-797010404 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:44:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-720024196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a55e394-0fd5-4bf9-bce7-184ef556e657,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36546f32e48d42678cbee11cd8f6ce2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:44:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:44:31Z,use_quota=True,user_id='882a04f4b4ed42938f6046e9c868451f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:44:31 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [req-6964d813-7351-4f26-8b61-d667a203d5c0 req-12541d5a-c34d-46da-bb17-76eef4ffd3f1 tempest-VolumesSnapshotsTestJSON-797010404 None] Creating volume 5a55e394-0fd5-4bf9-bce7-184ef556e657 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:44:31 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-6964d813-7351-4f26-8b61-d667a203d5c0 req-12541d5a-c34d-46da-bb17-76eef4ffd3f1 tempest-VolumesSnapshotsTestJSON-797010404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:44:31 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-6964d813-7351-4f26-8b61-d667a203d5c0 req-12541d5a-c34d-46da-bb17-76eef4ffd3f1 tempest-VolumesSnapshotsTestJSON-797010404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:44:31 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [req-6964d813-7351-4f26-8b61-d667a203d5c0 req-12541d5a-c34d-46da-bb17-76eef4ffd3f1 tempest-VolumesSnapshotsTestJSON-797010404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:44:31 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [req-6964d813-7351-4f26-8b61-d667a203d5c0 req-12541d5a-c34d-46da-bb17-76eef4ffd3f1 tempest-VolumesSnapshotsTestJSON-797010404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:44:31 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-6964d813-7351-4f26-8b61-d667a203d5c0 req-12541d5a-c34d-46da-bb17-76eef4ffd3f1 tempest-VolumesSnapshotsTestJSON-797010404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:44:31 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [req-6964d813-7351-4f26-8b61-d667a203d5c0 req-12541d5a-c34d-46da-bb17-76eef4ffd3f1 tempest-VolumesSnapshotsTestJSON-797010404 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:44:31 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [req-6964d813-7351-4f26-8b61-d667a203d5c0 req-12541d5a-c34d-46da-bb17-76eef4ffd3f1 tempest-VolumesSnapshotsTestJSON-797010404 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:44:31 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [req-6964d813-7351-4f26-8b61-d667a203d5c0 req-12541d5a-c34d-46da-bb17-76eef4ffd3f1 tempest-VolumesSnapshotsTestJSON-797010404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5a55e394-0fd5-4bf9-bce7-184ef556e657 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:31 devstack sudo[95610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5a55e394-0fd5-4bf9-bce7-184ef556e657 1073741824 Sep 25 11:44:31 devstack sudo[95610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:32 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6fcfbe6-002b-49b9-8c1b-6ec46a012eb6 tempest-GroupSnapshotsTest-122027651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:44:32 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b6fcfbe6-002b-49b9-8c1b-6ec46a012eb6 tempest-GroupSnapshotsTest-122027651 None] Flow 'volume_create_manager' (db36bfa2-66d1-49a7-a39a-7a394ec287f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:44:32 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b6fcfbe6-002b-49b9-8c1b-6ec46a012eb6 tempest-GroupSnapshotsTest-122027651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20beebd9-b6e8-4155-9400-686bbd0a9948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:44:32 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b6fcfbe6-002b-49b9-8c1b-6ec46a012eb6 tempest-GroupSnapshotsTest-122027651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20beebd9-b6e8-4155-9400-686bbd0a9948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:44:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1615210910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a0e20e78-a29a-4192-9a2b-f8f98d7840c0,host='devstack@QuobyteHD#QuobyteHD',id=23a6d001-3bda-4baa-ad9e-54415bd5cca1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9d9f0643087407bbcbcdcc879f8e8b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:44:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:44:32Z,use_quota=True,user_id='17a666ec9d3d49519f3f9c6284176a33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3f0c598-6170-4d87-b712-9fbb00aa6524),volume_type_id=c3f0c598-6170-4d87-b712-9fbb00aa6524)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:44:32 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b6fcfbe6-002b-49b9-8c1b-6ec46a012eb6 tempest-GroupSnapshotsTest-122027651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eae583be-86e9-49e8-8167-02066beee6c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:44:32 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b6fcfbe6-002b-49b9-8c1b-6ec46a012eb6 tempest-GroupSnapshotsTest-122027651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eae583be-86e9-49e8-8167-02066beee6c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:44:32 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b6fcfbe6-002b-49b9-8c1b-6ec46a012eb6 tempest-GroupSnapshotsTest-122027651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73591e5a-a4e2-442a-b73e-de2acd9be97b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:44:32 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b6fcfbe6-002b-49b9-8c1b-6ec46a012eb6 tempest-GroupSnapshotsTest-122027651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73591e5a-a4e2-442a-b73e-de2acd9be97b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23a6d001-3bda-4baa-ad9e-54415bd5cca1', 'volume_name': 'volume-23a6d001-3bda-4baa-ad9e-54415bd5cca1', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:44:32 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b6fcfbe6-002b-49b9-8c1b-6ec46a012eb6 tempest-GroupSnapshotsTest-122027651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87ae680b-bf31-4807-94f9-6c80466fa521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:44:32 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b6fcfbe6-002b-49b9-8c1b-6ec46a012eb6 tempest-GroupSnapshotsTest-122027651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87ae680b-bf31-4807-94f9-6c80466fa521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:44:32 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b6fcfbe6-002b-49b9-8c1b-6ec46a012eb6 tempest-GroupSnapshotsTest-122027651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (555a7e1d-46f4-4cdb-859c-1493adfa4280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:44:32 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-b6fcfbe6-002b-49b9-8c1b-6ec46a012eb6 tempest-GroupSnapshotsTest-122027651 None] Volume 23a6d001-3bda-4baa-ad9e-54415bd5cca1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23a6d001-3bda-4baa-ad9e-54415bd5cca1', 'volume_size': 1} Sep 25 11:44:32 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-b6fcfbe6-002b-49b9-8c1b-6ec46a012eb6 tempest-GroupSnapshotsTest-122027651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:44:32 devstack sudo[95610]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:32 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [req-6964d813-7351-4f26-8b61-d667a203d5c0 req-12541d5a-c34d-46da-bb17-76eef4ffd3f1 tempest-VolumesSnapshotsTestJSON-797010404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5a55e394-0fd5-4bf9-bce7-184ef556e657 1073741824" returned: 0 in 0.960s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:32 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [req-6964d813-7351-4f26-8b61-d667a203d5c0 req-12541d5a-c34d-46da-bb17-76eef4ffd3f1 tempest-VolumesSnapshotsTestJSON-797010404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5a55e394-0fd5-4bf9-bce7-184ef556e657 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:32 devstack sudo[96048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5a55e394-0fd5-4bf9-bce7-184ef556e657 Sep 25 11:44:32 devstack sudo[96048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:33 devstack sudo[96048]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:33 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [req-6964d813-7351-4f26-8b61-d667a203d5c0 req-12541d5a-c34d-46da-bb17-76eef4ffd3f1 tempest-VolumesSnapshotsTestJSON-797010404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5a55e394-0fd5-4bf9-bce7-184ef556e657" returned: 0 in 0.422s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:33 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [req-6964d813-7351-4f26-8b61-d667a203d5c0 req-12541d5a-c34d-46da-bb17-76eef4ffd3f1 tempest-VolumesSnapshotsTestJSON-797010404 None] <== create_volume: return (1478ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:44:33 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-6964d813-7351-4f26-8b61-d667a203d5c0 req-12541d5a-c34d-46da-bb17-76eef4ffd3f1 tempest-VolumesSnapshotsTestJSON-797010404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.482s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:44:33 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-b6fcfbe6-002b-49b9-8c1b-6ec46a012eb6 tempest-GroupSnapshotsTest-122027651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.843s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:44:33 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-b6fcfbe6-002b-49b9-8c1b-6ec46a012eb6 tempest-GroupSnapshotsTest-122027651 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a0e20e78-a29a-4192-9a2b-f8f98d7840c0,created_at=2026-09-25T09:44:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1615210910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a0e20e78-a29a-4192-9a2b-f8f98d7840c0,host='devstack@QuobyteHD#QuobyteHD',id=23a6d001-3bda-4baa-ad9e-54415bd5cca1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9d9f0643087407bbcbcdcc879f8e8b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:44:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:44:32Z,use_quota=True,user_id='17a666ec9d3d49519f3f9c6284176a33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3f0c598-6170-4d87-b712-9fbb00aa6524),volume_type_id=c3f0c598-6170-4d87-b712-9fbb00aa6524)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:44:33 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-b6fcfbe6-002b-49b9-8c1b-6ec46a012eb6 tempest-GroupSnapshotsTest-122027651 None] Creating volume 23a6d001-3bda-4baa-ad9e-54415bd5cca1 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:44:33 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-b6fcfbe6-002b-49b9-8c1b-6ec46a012eb6 tempest-GroupSnapshotsTest-122027651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:44:33 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-b6fcfbe6-002b-49b9-8c1b-6ec46a012eb6 tempest-GroupSnapshotsTest-122027651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:44:33 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-b6fcfbe6-002b-49b9-8c1b-6ec46a012eb6 tempest-GroupSnapshotsTest-122027651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:44:33 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-b6fcfbe6-002b-49b9-8c1b-6ec46a012eb6 tempest-GroupSnapshotsTest-122027651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:44:33 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-b6fcfbe6-002b-49b9-8c1b-6ec46a012eb6 tempest-GroupSnapshotsTest-122027651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:44:33 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-b6fcfbe6-002b-49b9-8c1b-6ec46a012eb6 tempest-GroupSnapshotsTest-122027651 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:44:33 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-b6fcfbe6-002b-49b9-8c1b-6ec46a012eb6 tempest-GroupSnapshotsTest-122027651 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:44:33 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-b6fcfbe6-002b-49b9-8c1b-6ec46a012eb6 tempest-GroupSnapshotsTest-122027651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23a6d001-3bda-4baa-ad9e-54415bd5cca1 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:33 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [req-6964d813-7351-4f26-8b61-d667a203d5c0 req-12541d5a-c34d-46da-bb17-76eef4ffd3f1 tempest-VolumesSnapshotsTestJSON-797010404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c09b363-f601-4cf3-a1f2-d9e6a497f03f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a55e394-0fd5-4bf9-bce7-184ef556e657', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:44:33 devstack sudo[96061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23a6d001-3bda-4baa-ad9e-54415bd5cca1 1073741824 Sep 25 11:44:33 devstack sudo[96061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:33 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [req-6964d813-7351-4f26-8b61-d667a203d5c0 req-12541d5a-c34d-46da-bb17-76eef4ffd3f1 tempest-VolumesSnapshotsTestJSON-797010404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36881ec3-1130-4372-a797-8a0ed88d84c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:44:33 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [req-6964d813-7351-4f26-8b61-d667a203d5c0 req-12541d5a-c34d-46da-bb17-76eef4ffd3f1 tempest-VolumesSnapshotsTestJSON-797010404 None] Volume volume-5a55e394-0fd5-4bf9-bce7-184ef556e657 (5a55e394-0fd5-4bf9-bce7-184ef556e657): created successfully Sep 25 11:44:33 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [req-6964d813-7351-4f26-8b61-d667a203d5c0 req-12541d5a-c34d-46da-bb17-76eef4ffd3f1 tempest-VolumesSnapshotsTestJSON-797010404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36881ec3-1130-4372-a797-8a0ed88d84c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:44:33 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [req-6964d813-7351-4f26-8b61-d667a203d5c0 req-12541d5a-c34d-46da-bb17-76eef4ffd3f1 tempest-VolumesSnapshotsTestJSON-797010404 None] Flow 'volume_create_manager' (ecbae23f-f652-437f-8c93-80ac0f33ec53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:44:33 devstack cinder-volume[86984]: INFO cinder.volume.manager [req-6964d813-7351-4f26-8b61-d667a203d5c0 req-12541d5a-c34d-46da-bb17-76eef4ffd3f1 tempest-VolumesSnapshotsTestJSON-797010404 None] Created volume successfully. Sep 25 11:44:34 devstack sudo[96061]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:34 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-b6fcfbe6-002b-49b9-8c1b-6ec46a012eb6 tempest-GroupSnapshotsTest-122027651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23a6d001-3bda-4baa-ad9e-54415bd5cca1 1073741824" returned: 0 in 0.882s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:34 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-b6fcfbe6-002b-49b9-8c1b-6ec46a012eb6 tempest-GroupSnapshotsTest-122027651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23a6d001-3bda-4baa-ad9e-54415bd5cca1 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:34 devstack sudo[96079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23a6d001-3bda-4baa-ad9e-54415bd5cca1 Sep 25 11:44:34 devstack sudo[96079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:34 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-039776cf-42f5-405e-82bd-83b349955d03 req-2c3e6064-fac6-4224-bada-37d38588f158 tempest-VolumesSnapshotsTestJSON-797010404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:44:34 devstack sudo[96079]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:34 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-b6fcfbe6-002b-49b9-8c1b-6ec46a012eb6 tempest-GroupSnapshotsTest-122027651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23a6d001-3bda-4baa-ad9e-54415bd5cca1" returned: 0 in 0.503s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:34 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-b6fcfbe6-002b-49b9-8c1b-6ec46a012eb6 tempest-GroupSnapshotsTest-122027651 None] <== create_volume: return (1441ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:44:34 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-b6fcfbe6-002b-49b9-8c1b-6ec46a012eb6 tempest-GroupSnapshotsTest-122027651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.450s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:44:34 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-039776cf-42f5-405e-82bd-83b349955d03 req-2c3e6064-fac6-4224-bada-37d38588f158 tempest-VolumesSnapshotsTestJSON-797010404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.143s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:44:34 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b6fcfbe6-002b-49b9-8c1b-6ec46a012eb6 tempest-GroupSnapshotsTest-122027651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (555a7e1d-46f4-4cdb-859c-1493adfa4280) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23a6d001-3bda-4baa-ad9e-54415bd5cca1', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:44:34 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b6fcfbe6-002b-49b9-8c1b-6ec46a012eb6 tempest-GroupSnapshotsTest-122027651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc743c65-8d52-46b8-a629-a3fcc4105552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:44:34 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [req-039776cf-42f5-405e-82bd-83b349955d03 req-2c3e6064-fac6-4224-bada-37d38588f158 tempest-VolumesSnapshotsTestJSON-797010404 None] Creating offline snapshot e1aa9314-d15a-4a5e-80f0-aa7b45148eb6 of volume 5a55e394-0fd5-4bf9-bce7-184ef556e657 {{(pid=86984) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:44:34 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-b6fcfbe6-002b-49b9-8c1b-6ec46a012eb6 tempest-GroupSnapshotsTest-122027651 None] Volume volume-23a6d001-3bda-4baa-ad9e-54415bd5cca1 (23a6d001-3bda-4baa-ad9e-54415bd5cca1): created successfully Sep 25 11:44:34 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b6fcfbe6-002b-49b9-8c1b-6ec46a012eb6 tempest-GroupSnapshotsTest-122027651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc743c65-8d52-46b8-a629-a3fcc4105552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:44:34 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b6fcfbe6-002b-49b9-8c1b-6ec46a012eb6 tempest-GroupSnapshotsTest-122027651 None] Flow 'volume_create_manager' (db36bfa2-66d1-49a7-a39a-7a394ec287f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:44:34 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[14300bd4-8226-424b-9ac7-612506da324c]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:44:34 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [req-039776cf-42f5-405e-82bd-83b349955d03 req-2c3e6064-fac6-4224-bada-37d38588f158 tempest-VolumesSnapshotsTestJSON-797010404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5a55e394-0fd5-4bf9-bce7-184ef556e657 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:34 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-b6fcfbe6-002b-49b9-8c1b-6ec46a012eb6 tempest-GroupSnapshotsTest-122027651 None] Created volume successfully. Sep 25 11:44:34 devstack sudo[96098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5a55e394-0fd5-4bf9-bce7-184ef556e657 Sep 25 11:44:34 devstack sudo[96098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:35 devstack sudo[96098]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:35 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [req-039776cf-42f5-405e-82bd-83b349955d03 req-2c3e6064-fac6-4224-bada-37d38588f158 tempest-VolumesSnapshotsTestJSON-797010404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5a55e394-0fd5-4bf9-bce7-184ef556e657" returned: 0 in 0.826s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:35 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [req-039776cf-42f5-405e-82bd-83b349955d03 req-2c3e6064-fac6-4224-bada-37d38588f158 tempest-VolumesSnapshotsTestJSON-797010404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5a55e394-0fd5-4bf9-bce7-184ef556e657,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5a55e394-0fd5-4bf9-bce7-184ef556e657.e1aa9314-d15a-4a5e-80f0-aa7b45148eb6 1G {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:35 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-cbfa7f47-1028-411f-a1e0-6fe78981bc6b tempest-GroupSnapshotsTest-122027651 None] GroupSnapshot 5ca90b9a-99b4-4696-9861-399863481dfe: creating. Sep 25 11:44:35 devstack sudo[96103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5a55e394-0fd5-4bf9-bce7-184ef556e657,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5a55e394-0fd5-4bf9-bce7-184ef556e657.e1aa9314-d15a-4a5e-80f0-aa7b45148eb6 1G Sep 25 11:44:35 devstack sudo[96103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:35 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cbfa7f47-1028-411f-a1e0-6fe78981bc6b tempest-GroupSnapshotsTest-122027651 None] Group snapshot 5ca90b9a-99b4-4696-9861-399863481dfe: creating. {{(pid=86984) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 25 11:44:35 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-cbfa7f47-1028-411f-a1e0-6fe78981bc6b tempest-GroupSnapshotsTest-122027651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:44:36 devstack sudo[96103]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:36 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [req-039776cf-42f5-405e-82bd-83b349955d03 req-2c3e6064-fac6-4224-bada-37d38588f158 tempest-VolumesSnapshotsTestJSON-797010404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5a55e394-0fd5-4bf9-bce7-184ef556e657,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5a55e394-0fd5-4bf9-bce7-184ef556e657.e1aa9314-d15a-4a5e-80f0-aa7b45148eb6 1G" returned: 0 in 1.145s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:36 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [req-039776cf-42f5-405e-82bd-83b349955d03 req-2c3e6064-fac6-4224-bada-37d38588f158 tempest-VolumesSnapshotsTestJSON-797010404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a55e394-0fd5-4bf9-bce7-184ef556e657 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5a55e394-0fd5-4bf9-bce7-184ef556e657.e1aa9314-d15a-4a5e-80f0-aa7b45148eb6 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:36 devstack sudo[96116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a55e394-0fd5-4bf9-bce7-184ef556e657 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5a55e394-0fd5-4bf9-bce7-184ef556e657.e1aa9314-d15a-4a5e-80f0-aa7b45148eb6 Sep 25 11:44:36 devstack sudo[96116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:37 devstack sudo[96116]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:37 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [req-039776cf-42f5-405e-82bd-83b349955d03 req-2c3e6064-fac6-4224-bada-37d38588f158 tempest-VolumesSnapshotsTestJSON-797010404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a55e394-0fd5-4bf9-bce7-184ef556e657 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5a55e394-0fd5-4bf9-bce7-184ef556e657.e1aa9314-d15a-4a5e-80f0-aa7b45148eb6" returned: 0 in 0.569s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:37 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [req-039776cf-42f5-405e-82bd-83b349955d03 req-2c3e6064-fac6-4224-bada-37d38588f158 tempest-VolumesSnapshotsTestJSON-797010404 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5a55e394-0fd5-4bf9-bce7-184ef556e657.e1aa9314-d15a-4a5e-80f0-aa7b45148eb6 is being set with open permissions: ugo+rw Sep 25 11:44:37 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [req-039776cf-42f5-405e-82bd-83b349955d03 req-2c3e6064-fac6-4224-bada-37d38588f158 tempest-VolumesSnapshotsTestJSON-797010404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5a55e394-0fd5-4bf9-bce7-184ef556e657.e1aa9314-d15a-4a5e-80f0-aa7b45148eb6 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:37 devstack sudo[96129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5a55e394-0fd5-4bf9-bce7-184ef556e657.e1aa9314-d15a-4a5e-80f0-aa7b45148eb6 Sep 25 11:44:37 devstack sudo[96129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:37 devstack sudo[96129]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:37 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [req-039776cf-42f5-405e-82bd-83b349955d03 req-2c3e6064-fac6-4224-bada-37d38588f158 tempest-VolumesSnapshotsTestJSON-797010404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5a55e394-0fd5-4bf9-bce7-184ef556e657.e1aa9314-d15a-4a5e-80f0-aa7b45148eb6" returned: 0 in 0.381s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:37 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [req-039776cf-42f5-405e-82bd-83b349955d03 req-2c3e6064-fac6-4224-bada-37d38588f158 tempest-VolumesSnapshotsTestJSON-797010404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5a55e394-0fd5-4bf9-bce7-184ef556e657.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:37 devstack sudo[96138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5a55e394-0fd5-4bf9-bce7-184ef556e657.info Sep 25 11:44:37 devstack sudo[96138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:38 devstack sudo[96138]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [req-039776cf-42f5-405e-82bd-83b349955d03 req-2c3e6064-fac6-4224-bada-37d38588f158 tempest-VolumesSnapshotsTestJSON-797010404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5a55e394-0fd5-4bf9-bce7-184ef556e657.info" returned: 0 in 0.588s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:38 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [req-039776cf-42f5-405e-82bd-83b349955d03 req-2c3e6064-fac6-4224-bada-37d38588f158 tempest-VolumesSnapshotsTestJSON-797010404 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5a55e394-0fd5-4bf9-bce7-184ef556e657.info is being set with open permissions: ugo+rw Sep 25 11:44:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [req-039776cf-42f5-405e-82bd-83b349955d03 req-2c3e6064-fac6-4224-bada-37d38588f158 tempest-VolumesSnapshotsTestJSON-797010404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5a55e394-0fd5-4bf9-bce7-184ef556e657.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:38 devstack sudo[96147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5a55e394-0fd5-4bf9-bce7-184ef556e657.info Sep 25 11:44:38 devstack sudo[96147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:38 devstack cinder-volume[86984]: DEBUG oslo_service.periodic_task [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:44:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:44:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:44:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:44:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:44:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:44:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:38 devstack sudo[96150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:44:38 devstack sudo[96150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:38 devstack sudo[96147]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [req-039776cf-42f5-405e-82bd-83b349955d03 req-2c3e6064-fac6-4224-bada-37d38588f158 tempest-VolumesSnapshotsTestJSON-797010404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5a55e394-0fd5-4bf9-bce7-184ef556e657.info" returned: 0 in 0.553s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-039776cf-42f5-405e-82bd-83b349955d03 req-2c3e6064-fac6-4224-bada-37d38588f158 tempest-VolumesSnapshotsTestJSON-797010404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.332s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:44:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-cbfa7f47-1028-411f-a1e0-6fe78981bc6b tempest-GroupSnapshotsTest-122027651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.243s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:44:39 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-cbfa7f47-1028-411f-a1e0-6fe78981bc6b tempest-GroupSnapshotsTest-122027651 None] Creating offline snapshot cb9a6f17-7763-491d-866a-afab3237bdc7 of volume 23a6d001-3bda-4baa-ad9e-54415bd5cca1 {{(pid=86984) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:44:39 devstack cinder-volume[86984]: INFO cinder.volume.manager [req-039776cf-42f5-405e-82bd-83b349955d03 req-2c3e6064-fac6-4224-bada-37d38588f158 tempest-VolumesSnapshotsTestJSON-797010404 None] Create snapshot completed successfully Sep 25 11:44:39 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e70708-78fa-48ea-97d8-27856ccf42ce]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:44:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cbfa7f47-1028-411f-a1e0-6fe78981bc6b tempest-GroupSnapshotsTest-122027651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23a6d001-3bda-4baa-ad9e-54415bd5cca1 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:39 devstack sudo[96150]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.850s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:39 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:44:39 devstack cinder-volume[86984]: DEBUG oslo_service.periodic_task [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running periodic task VolumeManager._thread_info {{(pid=86984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:44:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] thread count: 28 {{(pid=86984) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 11:44:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] thread info: [<_MainThread(MainThread, started 132046492332160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86984) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 11:44:39 devstack sudo[96153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23a6d001-3bda-4baa-ad9e-54415bd5cca1 Sep 25 11:44:39 devstack sudo[96153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:40 devstack sudo[96153]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:40 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cbfa7f47-1028-411f-a1e0-6fe78981bc6b tempest-GroupSnapshotsTest-122027651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23a6d001-3bda-4baa-ad9e-54415bd5cca1" returned: 0 in 0.826s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:40 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cbfa7f47-1028-411f-a1e0-6fe78981bc6b tempest-GroupSnapshotsTest-122027651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23a6d001-3bda-4baa-ad9e-54415bd5cca1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23a6d001-3bda-4baa-ad9e-54415bd5cca1.cb9a6f17-7763-491d-866a-afab3237bdc7 1G {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:40 devstack cinder-volume[86984]: DEBUG cinder.coordination [req-48e61286-940b-4983-bf9c-ce3eb6ddd234 req-9ccbeb5a-cb3d-4731-9dd6-98e133c4e735 tempest-VolumesSnapshotsTestJSON-797010404 None] Acquiring lock "cinder-e1aa9314-d15a-4a5e-80f0-aa7b45148eb6-delete_snapshot" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:44:40 devstack sudo[96159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23a6d001-3bda-4baa-ad9e-54415bd5cca1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23a6d001-3bda-4baa-ad9e-54415bd5cca1.cb9a6f17-7763-491d-866a-afab3237bdc7 1G Sep 25 11:44:40 devstack cinder-volume[86984]: DEBUG cinder.coordination [req-48e61286-940b-4983-bf9c-ce3eb6ddd234 req-9ccbeb5a-cb3d-4731-9dd6-98e133c4e735 tempest-VolumesSnapshotsTestJSON-797010404 None] Lock "cinder-e1aa9314-d15a-4a5e-80f0-aa7b45148eb6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.060s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:44:40 devstack cinder-volume[86984]: DEBUG cinder.coordination [req-48e61286-940b-4983-bf9c-ce3eb6ddd234 req-9ccbeb5a-cb3d-4731-9dd6-98e133c4e735 tempest-VolumesSnapshotsTestJSON-797010404 None] Acquiring lock "cinder-quobyte-5a55e394-0fd5-4bf9-bce7-184ef556e657" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:44:40 devstack sudo[96159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:40 devstack cinder-volume[86984]: DEBUG cinder.coordination [req-48e61286-940b-4983-bf9c-ce3eb6ddd234 req-9ccbeb5a-cb3d-4731-9dd6-98e133c4e735 tempest-VolumesSnapshotsTestJSON-797010404 None] Lock "cinder-quobyte-5a55e394-0fd5-4bf9-bce7-184ef556e657" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:44:40 devstack cinder-volume[86984]: DEBUG cinder.coordination [req-48e61286-940b-4983-bf9c-ce3eb6ddd234 req-9ccbeb5a-cb3d-4731-9dd6-98e133c4e735 tempest-VolumesSnapshotsTestJSON-797010404 None] Acquiring lock "cinder-quobyte-e1aa9314-d15a-4a5e-80f0-aa7b45148eb6" by "_delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:44:40 devstack cinder-volume[86984]: DEBUG cinder.coordination [req-48e61286-940b-4983-bf9c-ce3eb6ddd234 req-9ccbeb5a-cb3d-4731-9dd6-98e133c4e735 tempest-VolumesSnapshotsTestJSON-797010404 None] Lock "cinder-quobyte-e1aa9314-d15a-4a5e-80f0-aa7b45148eb6" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:44:40 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [req-48e61286-940b-4983-bf9c-ce3eb6ddd234 req-9ccbeb5a-cb3d-4731-9dd6-98e133c4e735 tempest-VolumesSnapshotsTestJSON-797010404 None] Deleting offline snapshot e1aa9314-d15a-4a5e-80f0-aa7b45148eb6 of volume 5a55e394-0fd5-4bf9-bce7-184ef556e657 {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:44:40 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [req-48e61286-940b-4983-bf9c-ce3eb6ddd234 req-9ccbeb5a-cb3d-4731-9dd6-98e133c4e735 tempest-VolumesSnapshotsTestJSON-797010404 None] snapshot_file for this snap is: volume-5a55e394-0fd5-4bf9-bce7-184ef556e657.e1aa9314-d15a-4a5e-80f0-aa7b45148eb6 {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:44:40 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[690dd9fa-64a2-44cb-9c7a-3f85fc62a9a0]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:44:40 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [req-48e61286-940b-4983-bf9c-ce3eb6ddd234 req-9ccbeb5a-cb3d-4731-9dd6-98e133c4e735 tempest-VolumesSnapshotsTestJSON-797010404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5a55e394-0fd5-4bf9-bce7-184ef556e657.e1aa9314-d15a-4a5e-80f0-aa7b45148eb6 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:40 devstack sudo[96174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5a55e394-0fd5-4bf9-bce7-184ef556e657.e1aa9314-d15a-4a5e-80f0-aa7b45148eb6 Sep 25 11:44:40 devstack sudo[96174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:41 devstack sudo[96174]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [req-48e61286-940b-4983-bf9c-ce3eb6ddd234 req-9ccbeb5a-cb3d-4731-9dd6-98e133c4e735 tempest-VolumesSnapshotsTestJSON-797010404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5a55e394-0fd5-4bf9-bce7-184ef556e657.e1aa9314-d15a-4a5e-80f0-aa7b45148eb6" returned: 0 in 1.005s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:41 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [req-48e61286-940b-4983-bf9c-ce3eb6ddd234 req-9ccbeb5a-cb3d-4731-9dd6-98e133c4e735 tempest-VolumesSnapshotsTestJSON-797010404 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a55e394-0fd5-4bf9-bce7-184ef556e657(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86984) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:44:41 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[952def87-aa94-41c7-b791-275a057f17e0]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:44:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [req-48e61286-940b-4983-bf9c-ce3eb6ddd234 req-9ccbeb5a-cb3d-4731-9dd6-98e133c4e735 tempest-VolumesSnapshotsTestJSON-797010404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5a55e394-0fd5-4bf9-bce7-184ef556e657 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:41 devstack sudo[96159]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cbfa7f47-1028-411f-a1e0-6fe78981bc6b tempest-GroupSnapshotsTest-122027651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23a6d001-3bda-4baa-ad9e-54415bd5cca1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23a6d001-3bda-4baa-ad9e-54415bd5cca1.cb9a6f17-7763-491d-866a-afab3237bdc7 1G" returned: 0 in 1.455s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cbfa7f47-1028-411f-a1e0-6fe78981bc6b tempest-GroupSnapshotsTest-122027651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23a6d001-3bda-4baa-ad9e-54415bd5cca1 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23a6d001-3bda-4baa-ad9e-54415bd5cca1.cb9a6f17-7763-491d-866a-afab3237bdc7 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:41 devstack sudo[96207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23a6d001-3bda-4baa-ad9e-54415bd5cca1 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23a6d001-3bda-4baa-ad9e-54415bd5cca1.cb9a6f17-7763-491d-866a-afab3237bdc7 Sep 25 11:44:41 devstack sudo[96207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:41 devstack sudo[96206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5a55e394-0fd5-4bf9-bce7-184ef556e657 Sep 25 11:44:41 devstack sudo[96206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:42 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [req-48e61286-940b-4983-bf9c-ce3eb6ddd234 req-9ccbeb5a-cb3d-4731-9dd6-98e133c4e735 tempest-VolumesSnapshotsTestJSON-797010404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5a55e394-0fd5-4bf9-bce7-184ef556e657" returned: 0 in 1.406s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:42 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [req-48e61286-940b-4983-bf9c-ce3eb6ddd234 req-9ccbeb5a-cb3d-4731-9dd6-98e133c4e735 tempest-VolumesSnapshotsTestJSON-797010404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5a55e394-0fd5-4bf9-bce7-184ef556e657.e1aa9314-d15a-4a5e-80f0-aa7b45148eb6 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:42 devstack sudo[96206]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:42 devstack sudo[96207]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:42 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cbfa7f47-1028-411f-a1e0-6fe78981bc6b tempest-GroupSnapshotsTest-122027651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23a6d001-3bda-4baa-ad9e-54415bd5cca1 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23a6d001-3bda-4baa-ad9e-54415bd5cca1.cb9a6f17-7763-491d-866a-afab3237bdc7" returned: 0 in 1.414s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:42 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-cbfa7f47-1028-411f-a1e0-6fe78981bc6b tempest-GroupSnapshotsTest-122027651 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23a6d001-3bda-4baa-ad9e-54415bd5cca1.cb9a6f17-7763-491d-866a-afab3237bdc7 is being set with open permissions: ugo+rw: NotImplementedError Sep 25 11:44:42 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cbfa7f47-1028-411f-a1e0-6fe78981bc6b tempest-GroupSnapshotsTest-122027651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23a6d001-3bda-4baa-ad9e-54415bd5cca1.cb9a6f17-7763-491d-866a-afab3237bdc7 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:42 devstack sudo[96254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5a55e394-0fd5-4bf9-bce7-184ef556e657.e1aa9314-d15a-4a5e-80f0-aa7b45148eb6 Sep 25 11:44:42 devstack sudo[96254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:43 devstack sudo[96258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23a6d001-3bda-4baa-ad9e-54415bd5cca1.cb9a6f17-7763-491d-866a-afab3237bdc7 Sep 25 11:44:43 devstack sudo[96258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:43 devstack sudo[96258]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cbfa7f47-1028-411f-a1e0-6fe78981bc6b tempest-GroupSnapshotsTest-122027651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23a6d001-3bda-4baa-ad9e-54415bd5cca1.cb9a6f17-7763-491d-866a-afab3237bdc7" returned: 0 in 0.739s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cbfa7f47-1028-411f-a1e0-6fe78981bc6b tempest-GroupSnapshotsTest-122027651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23a6d001-3bda-4baa-ad9e-54415bd5cca1.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:44 devstack sudo[96280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23a6d001-3bda-4baa-ad9e-54415bd5cca1.info Sep 25 11:44:44 devstack sudo[96280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:44 devstack sudo[96254]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [req-48e61286-940b-4983-bf9c-ce3eb6ddd234 req-9ccbeb5a-cb3d-4731-9dd6-98e133c4e735 tempest-VolumesSnapshotsTestJSON-797010404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5a55e394-0fd5-4bf9-bce7-184ef556e657.e1aa9314-d15a-4a5e-80f0-aa7b45148eb6" returned: 0 in 1.329s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [req-48e61286-940b-4983-bf9c-ce3eb6ddd234 req-9ccbeb5a-cb3d-4731-9dd6-98e133c4e735 tempest-VolumesSnapshotsTestJSON-797010404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5a55e394-0fd5-4bf9-bce7-184ef556e657.e1aa9314-d15a-4a5e-80f0-aa7b45148eb6 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:44 devstack sudo[96293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5a55e394-0fd5-4bf9-bce7-184ef556e657.e1aa9314-d15a-4a5e-80f0-aa7b45148eb6 Sep 25 11:44:44 devstack sudo[96293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:45 devstack sudo[96280]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cbfa7f47-1028-411f-a1e0-6fe78981bc6b tempest-GroupSnapshotsTest-122027651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23a6d001-3bda-4baa-ad9e-54415bd5cca1.info" returned: 0 in 1.312s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:45 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-cbfa7f47-1028-411f-a1e0-6fe78981bc6b tempest-GroupSnapshotsTest-122027651 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23a6d001-3bda-4baa-ad9e-54415bd5cca1.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 11:44:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cbfa7f47-1028-411f-a1e0-6fe78981bc6b tempest-GroupSnapshotsTest-122027651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23a6d001-3bda-4baa-ad9e-54415bd5cca1.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:45 devstack sudo[96311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23a6d001-3bda-4baa-ad9e-54415bd5cca1.info Sep 25 11:44:45 devstack sudo[96311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:45 devstack sudo[96293]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [req-48e61286-940b-4983-bf9c-ce3eb6ddd234 req-9ccbeb5a-cb3d-4731-9dd6-98e133c4e735 tempest-VolumesSnapshotsTestJSON-797010404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5a55e394-0fd5-4bf9-bce7-184ef556e657.e1aa9314-d15a-4a5e-80f0-aa7b45148eb6" returned: 0 in 0.987s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:45 devstack cinder-volume[86984]: DEBUG cinder.coordination [req-48e61286-940b-4983-bf9c-ce3eb6ddd234 req-9ccbeb5a-cb3d-4731-9dd6-98e133c4e735 tempest-VolumesSnapshotsTestJSON-797010404 None] Lock "cinder-quobyte-e1aa9314-d15a-4a5e-80f0-aa7b45148eb6" released by "_delete_snapshot" :: held 5.082s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:44:45 devstack cinder-volume[86984]: DEBUG cinder.coordination [req-48e61286-940b-4983-bf9c-ce3eb6ddd234 req-9ccbeb5a-cb3d-4731-9dd6-98e133c4e735 tempest-VolumesSnapshotsTestJSON-797010404 None] Lock "cinder-quobyte-5a55e394-0fd5-4bf9-bce7-184ef556e657" released by "delete_snapshot" :: held 5.161s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:44:45 devstack cinder-volume[86984]: WARNING cinder.quota [req-48e61286-940b-4983-bf9c-ce3eb6ddd234 req-9ccbeb5a-cb3d-4731-9dd6-98e133c4e735 tempest-VolumesSnapshotsTestJSON-797010404 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 25 11:44:45 devstack cinder-volume[86984]: DEBUG cinder.quota [req-48e61286-940b-4983-bf9c-ce3eb6ddd234 req-9ccbeb5a-cb3d-4731-9dd6-98e133c4e735 tempest-VolumesSnapshotsTestJSON-797010404 None] Created reservations ['07462744-5638-40c3-b4c2-83b4fee04011', 'dd7ddeed-434d-4fdd-89b5-aa201d2a71af', 'f639eb11-846c-4c8d-bc01-ccd3ff9dbb09', '4ed60849-adc8-4527-ab41-a98790232e79'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:44:45 devstack cinder-volume[86984]: INFO cinder.volume.manager [req-48e61286-940b-4983-bf9c-ce3eb6ddd234 req-9ccbeb5a-cb3d-4731-9dd6-98e133c4e735 tempest-VolumesSnapshotsTestJSON-797010404 None] Delete snapshot completed successfully. Sep 25 11:44:45 devstack cinder-volume[86984]: DEBUG cinder.coordination [req-48e61286-940b-4983-bf9c-ce3eb6ddd234 req-9ccbeb5a-cb3d-4731-9dd6-98e133c4e735 tempest-VolumesSnapshotsTestJSON-797010404 None] Lock "cinder-e1aa9314-d15a-4a5e-80f0-aa7b45148eb6-delete_snapshot" released by "delete_snapshot" :: held 5.511s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:44:45 devstack sudo[96311]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cbfa7f47-1028-411f-a1e0-6fe78981bc6b tempest-GroupSnapshotsTest-122027651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23a6d001-3bda-4baa-ad9e-54415bd5cca1.info" returned: 0 in 0.833s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-cbfa7f47-1028-411f-a1e0-6fe78981bc6b tempest-GroupSnapshotsTest-122027651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.914s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:44:46 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-cbfa7f47-1028-411f-a1e0-6fe78981bc6b tempest-GroupSnapshotsTest-122027651 None] group_snapshot 5ca90b9a-99b4-4696-9861-399863481dfe: created successfully Sep 25 11:44:46 devstack cinder-volume[86984]: DEBUG cinder.coordination [req-e2d033ae-32fb-4b7b-af14-4c6f91e931ea req-3b5eb235-00ef-427a-a573-fa881ca8d2b0 tempest-VolumesSnapshotsTestJSON-797010404 None] Acquiring lock "cinder-5a55e394-0fd5-4bf9-bce7-184ef556e657-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:44:46 devstack cinder-volume[86984]: DEBUG cinder.coordination [req-e2d033ae-32fb-4b7b-af14-4c6f91e931ea req-3b5eb235-00ef-427a-a573-fa881ca8d2b0 tempest-VolumesSnapshotsTestJSON-797010404 None] Lock "cinder-5a55e394-0fd5-4bf9-bce7-184ef556e657-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:44:46 devstack cinder-volume[86984]: DEBUG cinder.coordination [req-e2d033ae-32fb-4b7b-af14-4c6f91e931ea req-3b5eb235-00ef-427a-a573-fa881ca8d2b0 tempest-VolumesSnapshotsTestJSON-797010404 None] Acquiring lock "cinder-quobyte-5a55e394-0fd5-4bf9-bce7-184ef556e657" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:44:46 devstack cinder-volume[86984]: DEBUG cinder.coordination [req-e2d033ae-32fb-4b7b-af14-4c6f91e931ea req-3b5eb235-00ef-427a-a573-fa881ca8d2b0 tempest-VolumesSnapshotsTestJSON-797010404 None] Lock "cinder-quobyte-5a55e394-0fd5-4bf9-bce7-184ef556e657" acquired by "delete_volume" :: waited 0.027s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:44:46 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[df55ba21-4dd2-42bf-922c-792b38a1b88c]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:44:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [req-e2d033ae-32fb-4b7b-af14-4c6f91e931ea req-3b5eb235-00ef-427a-a573-fa881ca8d2b0 tempest-VolumesSnapshotsTestJSON-797010404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5a55e394-0fd5-4bf9-bce7-184ef556e657 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:47 devstack sudo[96321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5a55e394-0fd5-4bf9-bce7-184ef556e657 Sep 25 11:44:47 devstack sudo[96321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:47 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-18689d51-0f07-4775-a2a7-ea7f085c6fae tempest-GroupSnapshotsTest-122027651 None] group_snapshot 5ca90b9a-99b4-4696-9861-399863481dfe: deleting Sep 25 11:44:47 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-18689d51-0f07-4775-a2a7-ea7f085c6fae tempest-GroupSnapshotsTest-122027651 None] group_snapshot 5ca90b9a-99b4-4696-9861-399863481dfe: deleting {{(pid=86984) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 25 11:44:47 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-18689d51-0f07-4775-a2a7-ea7f085c6fae tempest-GroupSnapshotsTest-122027651 None] Acquiring lock "cinder-quobyte-23a6d001-3bda-4baa-ad9e-54415bd5cca1" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:44:47 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-18689d51-0f07-4775-a2a7-ea7f085c6fae tempest-GroupSnapshotsTest-122027651 None] Lock "cinder-quobyte-23a6d001-3bda-4baa-ad9e-54415bd5cca1" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:44:47 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-18689d51-0f07-4775-a2a7-ea7f085c6fae tempest-GroupSnapshotsTest-122027651 None] Acquiring lock "cinder-quobyte-cb9a6f17-7763-491d-866a-afab3237bdc7" by "_delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:44:47 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-18689d51-0f07-4775-a2a7-ea7f085c6fae tempest-GroupSnapshotsTest-122027651 None] Lock "cinder-quobyte-cb9a6f17-7763-491d-866a-afab3237bdc7" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:44:47 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-18689d51-0f07-4775-a2a7-ea7f085c6fae tempest-GroupSnapshotsTest-122027651 None] Deleting offline snapshot cb9a6f17-7763-491d-866a-afab3237bdc7 of volume 23a6d001-3bda-4baa-ad9e-54415bd5cca1 {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:44:47 devstack sudo[96321]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:47 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-18689d51-0f07-4775-a2a7-ea7f085c6fae tempest-GroupSnapshotsTest-122027651 None] snapshot_file for this snap is: volume-23a6d001-3bda-4baa-ad9e-54415bd5cca1.cb9a6f17-7763-491d-866a-afab3237bdc7 {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:44:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [req-e2d033ae-32fb-4b7b-af14-4c6f91e931ea req-3b5eb235-00ef-427a-a573-fa881ca8d2b0 tempest-VolumesSnapshotsTestJSON-797010404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5a55e394-0fd5-4bf9-bce7-184ef556e657" returned: 0 in 0.770s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [req-e2d033ae-32fb-4b7b-af14-4c6f91e931ea req-3b5eb235-00ef-427a-a573-fa881ca8d2b0 tempest-VolumesSnapshotsTestJSON-797010404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5a55e394-0fd5-4bf9-bce7-184ef556e657 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:47 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea917bf0-8696-4f9f-a14f-45e3ff9c3bc8]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:44:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-18689d51-0f07-4775-a2a7-ea7f085c6fae tempest-GroupSnapshotsTest-122027651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23a6d001-3bda-4baa-ad9e-54415bd5cca1.cb9a6f17-7763-491d-866a-afab3237bdc7 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:47 devstack sudo[96327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5a55e394-0fd5-4bf9-bce7-184ef556e657 Sep 25 11:44:47 devstack sudo[96327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:47 devstack sudo[96328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23a6d001-3bda-4baa-ad9e-54415bd5cca1.cb9a6f17-7763-491d-866a-afab3237bdc7 Sep 25 11:44:47 devstack sudo[96328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:48 devstack sudo[96327]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [req-e2d033ae-32fb-4b7b-af14-4c6f91e931ea req-3b5eb235-00ef-427a-a573-fa881ca8d2b0 tempest-VolumesSnapshotsTestJSON-797010404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5a55e394-0fd5-4bf9-bce7-184ef556e657" returned: 0 in 0.746s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:48 devstack cinder-volume[86984]: DEBUG cinder.coordination [req-e2d033ae-32fb-4b7b-af14-4c6f91e931ea req-3b5eb235-00ef-427a-a573-fa881ca8d2b0 tempest-VolumesSnapshotsTestJSON-797010404 None] Lock "cinder-quobyte-5a55e394-0fd5-4bf9-bce7-184ef556e657" released by "delete_volume" :: held 1.703s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:44:48 devstack cinder-volume[86984]: DEBUG cinder.quota [req-e2d033ae-32fb-4b7b-af14-4c6f91e931ea req-3b5eb235-00ef-427a-a573-fa881ca8d2b0 tempest-VolumesSnapshotsTestJSON-797010404 None] Created reservations ['bd086be1-7d8b-457b-ae4f-7ad1b4aa5139', '473f2829-6bb6-4d4a-b2c2-c93307f728a7', 'ab1bbecf-f115-423c-87c7-18f1d41a81a2', '99ecae01-eb9e-4632-95c8-765f4980a1ac'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:44:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-e2d033ae-32fb-4b7b-af14-4c6f91e931ea req-3b5eb235-00ef-427a-a573-fa881ca8d2b0 tempest-VolumesSnapshotsTestJSON-797010404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:44:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-e2d033ae-32fb-4b7b-af14-4c6f91e931ea req-3b5eb235-00ef-427a-a573-fa881ca8d2b0 tempest-VolumesSnapshotsTestJSON-797010404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:44:48 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [req-e2d033ae-32fb-4b7b-af14-4c6f91e931ea req-3b5eb235-00ef-427a-a573-fa881ca8d2b0 tempest-VolumesSnapshotsTestJSON-797010404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:44:48 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [req-e2d033ae-32fb-4b7b-af14-4c6f91e931ea req-3b5eb235-00ef-427a-a573-fa881ca8d2b0 tempest-VolumesSnapshotsTestJSON-797010404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:44:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-e2d033ae-32fb-4b7b-af14-4c6f91e931ea req-3b5eb235-00ef-427a-a573-fa881ca8d2b0 tempest-VolumesSnapshotsTestJSON-797010404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:44:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [req-e2d033ae-32fb-4b7b-af14-4c6f91e931ea req-3b5eb235-00ef-427a-a573-fa881ca8d2b0 tempest-VolumesSnapshotsTestJSON-797010404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:48 devstack sudo[96337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:44:48 devstack sudo[96337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:48 devstack sudo[96328]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-18689d51-0f07-4775-a2a7-ea7f085c6fae tempest-GroupSnapshotsTest-122027651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23a6d001-3bda-4baa-ad9e-54415bd5cca1.cb9a6f17-7763-491d-866a-afab3237bdc7" returned: 0 in 1.124s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:48 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-18689d51-0f07-4775-a2a7-ea7f085c6fae tempest-GroupSnapshotsTest-122027651 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23a6d001-3bda-4baa-ad9e-54415bd5cca1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86984) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:44:48 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e7224a-357c-49c1-8c99-81dc4c7fa130]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:44:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-18689d51-0f07-4775-a2a7-ea7f085c6fae tempest-GroupSnapshotsTest-122027651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23a6d001-3bda-4baa-ad9e-54415bd5cca1 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:49 devstack sudo[96339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23a6d001-3bda-4baa-ad9e-54415bd5cca1 Sep 25 11:44:49 devstack sudo[96339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:49 devstack sudo[96337]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [req-e2d033ae-32fb-4b7b-af14-4c6f91e931ea req-3b5eb235-00ef-427a-a573-fa881ca8d2b0 tempest-VolumesSnapshotsTestJSON-797010404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.622s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:49 devstack cinder-volume[86984]: DEBUG cinder.manager [req-e2d033ae-32fb-4b7b-af14-4c6f91e931ea req-3b5eb235-00ef-427a-a573-fa881ca8d2b0 tempest-VolumesSnapshotsTestJSON-797010404 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:44:49 devstack cinder-volume[86984]: INFO cinder.volume.manager [req-e2d033ae-32fb-4b7b-af14-4c6f91e931ea req-3b5eb235-00ef-427a-a573-fa881ca8d2b0 tempest-VolumesSnapshotsTestJSON-797010404 None] Deleted volume successfully. Sep 25 11:44:49 devstack cinder-volume[86984]: DEBUG cinder.coordination [req-e2d033ae-32fb-4b7b-af14-4c6f91e931ea req-3b5eb235-00ef-427a-a573-fa881ca8d2b0 tempest-VolumesSnapshotsTestJSON-797010404 None] Lock "cinder-5a55e394-0fd5-4bf9-bce7-184ef556e657-delete_volume" released by "delete_volume" :: held 2.833s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:44:49 devstack sudo[96339]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-18689d51-0f07-4775-a2a7-ea7f085c6fae tempest-GroupSnapshotsTest-122027651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23a6d001-3bda-4baa-ad9e-54415bd5cca1" returned: 0 in 1.136s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-18689d51-0f07-4775-a2a7-ea7f085c6fae tempest-GroupSnapshotsTest-122027651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23a6d001-3bda-4baa-ad9e-54415bd5cca1.cb9a6f17-7763-491d-866a-afab3237bdc7 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:49 devstack sudo[96347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23a6d001-3bda-4baa-ad9e-54415bd5cca1.cb9a6f17-7763-491d-866a-afab3237bdc7 Sep 25 11:44:49 devstack sudo[96347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:50 devstack sudo[96347]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-18689d51-0f07-4775-a2a7-ea7f085c6fae tempest-GroupSnapshotsTest-122027651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23a6d001-3bda-4baa-ad9e-54415bd5cca1.cb9a6f17-7763-491d-866a-afab3237bdc7" returned: 0 in 0.864s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-18689d51-0f07-4775-a2a7-ea7f085c6fae tempest-GroupSnapshotsTest-122027651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23a6d001-3bda-4baa-ad9e-54415bd5cca1.cb9a6f17-7763-491d-866a-afab3237bdc7 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:50 devstack sudo[96352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23a6d001-3bda-4baa-ad9e-54415bd5cca1.cb9a6f17-7763-491d-866a-afab3237bdc7 Sep 25 11:44:50 devstack sudo[96352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:51 devstack sudo[96352]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-18689d51-0f07-4775-a2a7-ea7f085c6fae tempest-GroupSnapshotsTest-122027651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23a6d001-3bda-4baa-ad9e-54415bd5cca1.cb9a6f17-7763-491d-866a-afab3237bdc7" returned: 0 in 0.728s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:51 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-18689d51-0f07-4775-a2a7-ea7f085c6fae tempest-GroupSnapshotsTest-122027651 None] Lock "cinder-quobyte-cb9a6f17-7763-491d-866a-afab3237bdc7" released by "_delete_snapshot" :: held 4.133s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:44:51 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-18689d51-0f07-4775-a2a7-ea7f085c6fae tempest-GroupSnapshotsTest-122027651 None] Lock "cinder-quobyte-23a6d001-3bda-4baa-ad9e-54415bd5cca1" released by "delete_snapshot" :: held 4.174s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:44:51 devstack cinder-volume[86984]: WARNING cinder.quota [None req-18689d51-0f07-4775-a2a7-ea7f085c6fae tempest-GroupSnapshotsTest-122027651 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-998897853 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-998897853, it is now deprecated. Please use the default quota class for default quota. Sep 25 11:44:51 devstack cinder-volume[86984]: WARNING cinder.quota [None req-18689d51-0f07-4775-a2a7-ea7f085c6fae tempest-GroupSnapshotsTest-122027651 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-998897853 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-998897853, it is now deprecated. Please use the default quota class for default quota. Sep 25 11:44:51 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-18689d51-0f07-4775-a2a7-ea7f085c6fae tempest-GroupSnapshotsTest-122027651 None] Created reservations ['56f8a4c8-989e-4763-b0fc-af349ee2e17e', '8939cbec-5c8e-4cce-a2eb-96a166851e35', '3ef77d6f-eab2-4fc6-b86e-c8757cb38c6e', 'd575176a-fdf0-4b87-a24a-55b553a722ad'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:44:52 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-18689d51-0f07-4775-a2a7-ea7f085c6fae tempest-GroupSnapshotsTest-122027651 None] group_snapshot 5ca90b9a-99b4-4696-9861-399863481dfe: deleted successfully Sep 25 11:44:53 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-a964be1e-2406-407d-a550-e63767bb6d69 tempest-GroupSnapshotsTest-122027651 None] Acquiring lock "cinder-quobyte-23a6d001-3bda-4baa-ad9e-54415bd5cca1" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:44:53 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-a964be1e-2406-407d-a550-e63767bb6d69 tempest-GroupSnapshotsTest-122027651 None] Lock "cinder-quobyte-23a6d001-3bda-4baa-ad9e-54415bd5cca1" acquired by "delete_volume" :: waited 0.054s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:44:53 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a7d618-3647-4c31-81c8-423e978d9caa]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:44:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a964be1e-2406-407d-a550-e63767bb6d69 tempest-GroupSnapshotsTest-122027651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23a6d001-3bda-4baa-ad9e-54415bd5cca1 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:53 devstack sudo[96381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23a6d001-3bda-4baa-ad9e-54415bd5cca1 Sep 25 11:44:53 devstack sudo[96381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:53 devstack sudo[96381]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a964be1e-2406-407d-a550-e63767bb6d69 tempest-GroupSnapshotsTest-122027651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23a6d001-3bda-4baa-ad9e-54415bd5cca1" returned: 0 in 0.543s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a964be1e-2406-407d-a550-e63767bb6d69 tempest-GroupSnapshotsTest-122027651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23a6d001-3bda-4baa-ad9e-54415bd5cca1 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:53 devstack sudo[96386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23a6d001-3bda-4baa-ad9e-54415bd5cca1 Sep 25 11:44:53 devstack sudo[96386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:54 devstack sudo[96386]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a964be1e-2406-407d-a550-e63767bb6d69 tempest-GroupSnapshotsTest-122027651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23a6d001-3bda-4baa-ad9e-54415bd5cca1" returned: 0 in 0.431s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:54 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-a964be1e-2406-407d-a550-e63767bb6d69 tempest-GroupSnapshotsTest-122027651 None] Lock "cinder-quobyte-23a6d001-3bda-4baa-ad9e-54415bd5cca1" released by "delete_volume" :: held 1.182s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:44:54 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-a964be1e-2406-407d-a550-e63767bb6d69 tempest-GroupSnapshotsTest-122027651 None] Created reservations ['1de6130d-308c-49d0-88b3-380a43be56b8'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:44:54 devstack cinder-volume[86984]: WARNING cinder.quota [None req-a964be1e-2406-407d-a550-e63767bb6d69 tempest-GroupSnapshotsTest-122027651 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-998897853 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-998897853, it is now deprecated. Please use the default quota class for default quota. Sep 25 11:44:54 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-a964be1e-2406-407d-a550-e63767bb6d69 tempest-GroupSnapshotsTest-122027651 None] Created reservations ['dede5143-978d-4529-8d9d-49e3d9525716', 'c215f2c8-15eb-4f29-82e1-1e35e27318a3', 'c10347f7-2b27-406d-aef4-e1378f7f3218', '75276eb9-7198-4eeb-9bc7-84ceb3ca486e'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:44:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-a964be1e-2406-407d-a550-e63767bb6d69 tempest-GroupSnapshotsTest-122027651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:44:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-a964be1e-2406-407d-a550-e63767bb6d69 tempest-GroupSnapshotsTest-122027651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:44:54 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-a964be1e-2406-407d-a550-e63767bb6d69 tempest-GroupSnapshotsTest-122027651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:44:54 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-a964be1e-2406-407d-a550-e63767bb6d69 tempest-GroupSnapshotsTest-122027651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:44:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-a964be1e-2406-407d-a550-e63767bb6d69 tempest-GroupSnapshotsTest-122027651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:44:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a964be1e-2406-407d-a550-e63767bb6d69 tempest-GroupSnapshotsTest-122027651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:44:54 devstack sudo[96389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:44:54 devstack sudo[96389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:44:55 devstack sudo[96389]: pam_unix(sudo:session): session closed for user root Sep 25 11:44:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a964be1e-2406-407d-a550-e63767bb6d69 tempest-GroupSnapshotsTest-122027651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.435s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:44:55 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-a964be1e-2406-407d-a550-e63767bb6d69 tempest-GroupSnapshotsTest-122027651 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:44:55 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-a964be1e-2406-407d-a550-e63767bb6d69 tempest-GroupSnapshotsTest-122027651 None] Delete group completed successfully. Sep 25 11:45:04 devstack cinder-volume[86984]: DEBUG dbcounter [-] [86984] Writing DB stats cinder:SELECT=42,cinder:UPDATE=51,cinder:INSERT=13,cinder:DELETE=2 {{(pid=86984) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:45:04 devstack cinder-volume[86984]: DEBUG dbcounter [-] [86984] Writing DB stats cinder:DELETE=3,cinder:SELECT=81,cinder:UPDATE=70,cinder:INSERT=14 {{(pid=86984) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:45:06 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e7e1482-c7c6-4726-aeda-c3ff181363bd tempest-SnapshotsActionsTest-1803776119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:45:06 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3e7e1482-c7c6-4726-aeda-c3ff181363bd tempest-SnapshotsActionsTest-1803776119 None] Flow 'volume_create_manager' (c068a62a-33cd-4a33-aa4d-c92eda39c50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:45:06 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3e7e1482-c7c6-4726-aeda-c3ff181363bd tempest-SnapshotsActionsTest-1803776119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (296a157d-5600-4a78-abd7-c9f6ca88f946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:45:06 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3e7e1482-c7c6-4726-aeda-c3ff181363bd tempest-SnapshotsActionsTest-1803776119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (296a157d-5600-4a78-abd7-c9f6ca88f946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:45:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-58234020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2e3eb39-980e-4e9e-8cb9-13355ff763c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69db0794e63c458fa69a382ec88dcf02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:45:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:45:06Z,use_quota=True,user_id='9a8badf8ba4448628ec967eb168c7d51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:45:06 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3e7e1482-c7c6-4726-aeda-c3ff181363bd tempest-SnapshotsActionsTest-1803776119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cad499d-68e3-455b-a00d-b1415a1d38de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:45:06 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3e7e1482-c7c6-4726-aeda-c3ff181363bd tempest-SnapshotsActionsTest-1803776119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cad499d-68e3-455b-a00d-b1415a1d38de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:45:06 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3e7e1482-c7c6-4726-aeda-c3ff181363bd tempest-SnapshotsActionsTest-1803776119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6e47127-4456-472e-8cef-943c19871501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:45:06 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3e7e1482-c7c6-4726-aeda-c3ff181363bd tempest-SnapshotsActionsTest-1803776119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6e47127-4456-472e-8cef-943c19871501) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2e3eb39-980e-4e9e-8cb9-13355ff763c9', 'volume_name': 'volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:45:06 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3e7e1482-c7c6-4726-aeda-c3ff181363bd tempest-SnapshotsActionsTest-1803776119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69649a31-5d85-4fd3-a1b4-e9be97d82297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:45:06 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3e7e1482-c7c6-4726-aeda-c3ff181363bd tempest-SnapshotsActionsTest-1803776119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69649a31-5d85-4fd3-a1b4-e9be97d82297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:45:06 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3e7e1482-c7c6-4726-aeda-c3ff181363bd tempest-SnapshotsActionsTest-1803776119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f18d237-7b98-46d9-82b3-a40a408e3ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:45:06 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-3e7e1482-c7c6-4726-aeda-c3ff181363bd tempest-SnapshotsActionsTest-1803776119 None] Volume a2e3eb39-980e-4e9e-8cb9-13355ff763c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9', 'volume_size': 1} Sep 25 11:45:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3e7e1482-c7c6-4726-aeda-c3ff181363bd tempest-SnapshotsActionsTest-1803776119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:45:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3e7e1482-c7c6-4726-aeda-c3ff181363bd tempest-SnapshotsActionsTest-1803776119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:45:06 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3e7e1482-c7c6-4726-aeda-c3ff181363bd tempest-SnapshotsActionsTest-1803776119 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:45:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-58234020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2e3eb39-980e-4e9e-8cb9-13355ff763c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69db0794e63c458fa69a382ec88dcf02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:45:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:45:06Z,use_quota=True,user_id='9a8badf8ba4448628ec967eb168c7d51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:45:06 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-3e7e1482-c7c6-4726-aeda-c3ff181363bd tempest-SnapshotsActionsTest-1803776119 None] Creating volume a2e3eb39-980e-4e9e-8cb9-13355ff763c9 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:45:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3e7e1482-c7c6-4726-aeda-c3ff181363bd tempest-SnapshotsActionsTest-1803776119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:45:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3e7e1482-c7c6-4726-aeda-c3ff181363bd tempest-SnapshotsActionsTest-1803776119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:45:06 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3e7e1482-c7c6-4726-aeda-c3ff181363bd tempest-SnapshotsActionsTest-1803776119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:45:06 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3e7e1482-c7c6-4726-aeda-c3ff181363bd tempest-SnapshotsActionsTest-1803776119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:45:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3e7e1482-c7c6-4726-aeda-c3ff181363bd tempest-SnapshotsActionsTest-1803776119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:45:06 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3e7e1482-c7c6-4726-aeda-c3ff181363bd tempest-SnapshotsActionsTest-1803776119 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:45:06 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-3e7e1482-c7c6-4726-aeda-c3ff181363bd tempest-SnapshotsActionsTest-1803776119 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:45:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3e7e1482-c7c6-4726-aeda-c3ff181363bd tempest-SnapshotsActionsTest-1803776119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:06 devstack sudo[96491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9 1073741824 Sep 25 11:45:06 devstack sudo[96491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:07 devstack sudo[96491]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3e7e1482-c7c6-4726-aeda-c3ff181363bd tempest-SnapshotsActionsTest-1803776119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9 1073741824" returned: 0 in 0.773s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3e7e1482-c7c6-4726-aeda-c3ff181363bd tempest-SnapshotsActionsTest-1803776119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:07 devstack sudo[96497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9 Sep 25 11:45:07 devstack sudo[96497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:07 devstack sudo[96497]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3e7e1482-c7c6-4726-aeda-c3ff181363bd tempest-SnapshotsActionsTest-1803776119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9" returned: 0 in 0.383s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:07 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3e7e1482-c7c6-4726-aeda-c3ff181363bd tempest-SnapshotsActionsTest-1803776119 None] <== create_volume: return (1257ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:45:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3e7e1482-c7c6-4726-aeda-c3ff181363bd tempest-SnapshotsActionsTest-1803776119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.261s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:45:07 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3e7e1482-c7c6-4726-aeda-c3ff181363bd tempest-SnapshotsActionsTest-1803776119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f18d237-7b98-46d9-82b3-a40a408e3ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:45:07 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3e7e1482-c7c6-4726-aeda-c3ff181363bd tempest-SnapshotsActionsTest-1803776119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ea4e7ca-002b-4056-b50b-6cb20815d7c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:45:07 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-3e7e1482-c7c6-4726-aeda-c3ff181363bd tempest-SnapshotsActionsTest-1803776119 None] Volume volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9 (a2e3eb39-980e-4e9e-8cb9-13355ff763c9): created successfully Sep 25 11:45:07 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3e7e1482-c7c6-4726-aeda-c3ff181363bd tempest-SnapshotsActionsTest-1803776119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ea4e7ca-002b-4056-b50b-6cb20815d7c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:45:07 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3e7e1482-c7c6-4726-aeda-c3ff181363bd tempest-SnapshotsActionsTest-1803776119 None] Flow 'volume_create_manager' (c068a62a-33cd-4a33-aa4d-c92eda39c50b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:45:07 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-3e7e1482-c7c6-4726-aeda-c3ff181363bd tempest-SnapshotsActionsTest-1803776119 None] Created volume successfully. Sep 25 11:45:08 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-21c0bd6a-5b16-4ec5-bcd0-bc8c4bb26035 tempest-GroupsV320Test-325961955 None] Group tempest-GroupsV320Test-Group-269797354: creating Sep 25 11:45:08 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-21c0bd6a-5b16-4ec5-bcd0-bc8c4bb26035 tempest-GroupsV320Test-325961955 None] Group tempest-GroupsV320Test-Group-269797354: created successfully Sep 25 11:45:08 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-21c0bd6a-5b16-4ec5-bcd0-bc8c4bb26035 tempest-GroupsV320Test-325961955 None] Create group completed successfully. Sep 25 11:45:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d305baee-d445-4604-85e4-ef78dad15104 tempest-SnapshotsActionsTest-1803776119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:45:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d305baee-d445-4604-85e4-ef78dad15104 tempest-SnapshotsActionsTest-1803776119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:45:08 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-d305baee-d445-4604-85e4-ef78dad15104 tempest-SnapshotsActionsTest-1803776119 None] Creating offline snapshot 869bc753-e264-43e0-b081-073291d4cb34 of volume a2e3eb39-980e-4e9e-8cb9-13355ff763c9 {{(pid=86984) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:45:08 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd88d912-5c7e-408d-9808-4210c30f60c6]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:45:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d305baee-d445-4604-85e4-ef78dad15104 tempest-SnapshotsActionsTest-1803776119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:09 devstack sudo[96501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9 Sep 25 11:45:09 devstack sudo[96501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:09 devstack sudo[96501]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d305baee-d445-4604-85e4-ef78dad15104 tempest-SnapshotsActionsTest-1803776119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9" returned: 0 in 0.517s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d305baee-d445-4604-85e4-ef78dad15104 tempest-SnapshotsActionsTest-1803776119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.869bc753-e264-43e0-b081-073291d4cb34 1G {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:09 devstack sudo[96506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.869bc753-e264-43e0-b081-073291d4cb34 1G Sep 25 11:45:09 devstack sudo[96506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:10 devstack sudo[96506]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d305baee-d445-4604-85e4-ef78dad15104 tempest-SnapshotsActionsTest-1803776119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.869bc753-e264-43e0-b081-073291d4cb34 1G" returned: 0 in 0.719s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d305baee-d445-4604-85e4-ef78dad15104 tempest-SnapshotsActionsTest-1803776119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.869bc753-e264-43e0-b081-073291d4cb34 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:10 devstack sudo[96512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.869bc753-e264-43e0-b081-073291d4cb34 Sep 25 11:45:10 devstack sudo[96512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:10 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-f5ee11bc-4cb1-42d0-a1d3-2666af36151d tempest-GroupsV320Test-325961955 None] Created reservations ['c58d6e38-a960-4560-b43d-5ae4a4dce9d2'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:45:10 devstack sudo[96512]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d305baee-d445-4604-85e4-ef78dad15104 tempest-SnapshotsActionsTest-1803776119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.869bc753-e264-43e0-b081-073291d4cb34" returned: 0 in 0.458s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:10 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-d305baee-d445-4604-85e4-ef78dad15104 tempest-SnapshotsActionsTest-1803776119 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.869bc753-e264-43e0-b081-073291d4cb34 is being set with open permissions: ugo+rw Sep 25 11:45:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d305baee-d445-4604-85e4-ef78dad15104 tempest-SnapshotsActionsTest-1803776119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.869bc753-e264-43e0-b081-073291d4cb34 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:10 devstack sudo[96517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.869bc753-e264-43e0-b081-073291d4cb34 Sep 25 11:45:10 devstack sudo[96517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f5ee11bc-4cb1-42d0-a1d3-2666af36151d tempest-GroupsV320Test-325961955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:45:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f5ee11bc-4cb1-42d0-a1d3-2666af36151d tempest-GroupsV320Test-325961955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:45:10 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-f5ee11bc-4cb1-42d0-a1d3-2666af36151d tempest-GroupsV320Test-325961955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:45:10 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-f5ee11bc-4cb1-42d0-a1d3-2666af36151d tempest-GroupsV320Test-325961955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:45:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f5ee11bc-4cb1-42d0-a1d3-2666af36151d tempest-GroupsV320Test-325961955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:45:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f5ee11bc-4cb1-42d0-a1d3-2666af36151d tempest-GroupsV320Test-325961955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:10 devstack sudo[96519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:45:10 devstack sudo[96519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:10 devstack sudo[96517]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d305baee-d445-4604-85e4-ef78dad15104 tempest-SnapshotsActionsTest-1803776119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.869bc753-e264-43e0-b081-073291d4cb34" returned: 0 in 0.318s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:11 devstack sudo[96519]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f5ee11bc-4cb1-42d0-a1d3-2666af36151d tempest-GroupsV320Test-325961955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.285s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:11 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-f5ee11bc-4cb1-42d0-a1d3-2666af36151d tempest-GroupsV320Test-325961955 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:45:11 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-f5ee11bc-4cb1-42d0-a1d3-2666af36151d tempest-GroupsV320Test-325961955 None] Delete group completed successfully. Sep 25 11:45:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d305baee-d445-4604-85e4-ef78dad15104 tempest-SnapshotsActionsTest-1803776119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:11 devstack sudo[96523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.info Sep 25 11:45:11 devstack sudo[96523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:11 devstack sudo[96523]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d305baee-d445-4604-85e4-ef78dad15104 tempest-SnapshotsActionsTest-1803776119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.info" returned: 0 in 0.292s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:11 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-d305baee-d445-4604-85e4-ef78dad15104 tempest-SnapshotsActionsTest-1803776119 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.info is being set with open permissions: ugo+rw Sep 25 11:45:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d305baee-d445-4604-85e4-ef78dad15104 tempest-SnapshotsActionsTest-1803776119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:11 devstack sudo[96526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.info Sep 25 11:45:11 devstack sudo[96526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:11 devstack sudo[96526]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d305baee-d445-4604-85e4-ef78dad15104 tempest-SnapshotsActionsTest-1803776119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.info" returned: 0 in 0.350s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d305baee-d445-4604-85e4-ef78dad15104 tempest-SnapshotsActionsTest-1803776119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.789s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:45:11 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-d305baee-d445-4604-85e4-ef78dad15104 tempest-SnapshotsActionsTest-1803776119 None] Create snapshot completed successfully Sep 25 11:45:12 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-34df64a8-7de1-4c09-8085-346e420abae6 tempest-SnapshotsActionsTest-1803776119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:45:12 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-34df64a8-7de1-4c09-8085-346e420abae6 tempest-SnapshotsActionsTest-1803776119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:45:13 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-34df64a8-7de1-4c09-8085-346e420abae6 tempest-SnapshotsActionsTest-1803776119 None] Creating offline snapshot 9d2e09c0-cfab-46a1-b48a-38a9e71ae0b5 of volume a2e3eb39-980e-4e9e-8cb9-13355ff763c9 {{(pid=86984) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:45:13 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[741f5e17-80c2-444d-bd69-b474ea288361]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:45:13 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-34df64a8-7de1-4c09-8085-346e420abae6 tempest-SnapshotsActionsTest-1803776119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.869bc753-e264-43e0-b081-073291d4cb34 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:13 devstack sudo[96532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.869bc753-e264-43e0-b081-073291d4cb34 Sep 25 11:45:13 devstack sudo[96532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:13 devstack sudo[96532]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:13 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-34df64a8-7de1-4c09-8085-346e420abae6 tempest-SnapshotsActionsTest-1803776119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.869bc753-e264-43e0-b081-073291d4cb34" returned: 0 in 0.506s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:13 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-34df64a8-7de1-4c09-8085-346e420abae6 tempest-SnapshotsActionsTest-1803776119 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86984) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:45:13 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-34df64a8-7de1-4c09-8085-346e420abae6 tempest-SnapshotsActionsTest-1803776119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.869bc753-e264-43e0-b081-073291d4cb34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.9d2e09c0-cfab-46a1-b48a-38a9e71ae0b5 1G {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:13 devstack sudo[96537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.869bc753-e264-43e0-b081-073291d4cb34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.9d2e09c0-cfab-46a1-b48a-38a9e71ae0b5 1G Sep 25 11:45:13 devstack sudo[96537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:13 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d695dfd-e2d9-40fd-bf88-4ee9298d6932 tempest-AttachVolumeTestJSON-1176057342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:45:13 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8d695dfd-e2d9-40fd-bf88-4ee9298d6932 tempest-AttachVolumeTestJSON-1176057342 None] Flow 'volume_create_manager' (f5c0f7fc-9dfb-4d09-8419-9abc182345c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:45:13 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8d695dfd-e2d9-40fd-bf88-4ee9298d6932 tempest-AttachVolumeTestJSON-1176057342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80cab1c6-81ba-4e70-94d5-358404f5230e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:45:13 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8d695dfd-e2d9-40fd-bf88-4ee9298d6932 tempest-AttachVolumeTestJSON-1176057342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80cab1c6-81ba-4e70-94d5-358404f5230e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:45:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-183042042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=714adf2f-8eef-4812-aa55-c2178d3c4ce0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecac587be34044a8859419c305c8dcd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:45:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:45:14Z,use_quota=True,user_id='890369c91616454eb42aaa7ecb37c74e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:45:13 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8d695dfd-e2d9-40fd-bf88-4ee9298d6932 tempest-AttachVolumeTestJSON-1176057342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05df9b87-22e2-4782-9ea5-200ca0007272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:45:13 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8d695dfd-e2d9-40fd-bf88-4ee9298d6932 tempest-AttachVolumeTestJSON-1176057342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05df9b87-22e2-4782-9ea5-200ca0007272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:45:13 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8d695dfd-e2d9-40fd-bf88-4ee9298d6932 tempest-AttachVolumeTestJSON-1176057342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe0efd6d-434b-46dc-92fb-9d0e6f0af259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:45:13 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8d695dfd-e2d9-40fd-bf88-4ee9298d6932 tempest-AttachVolumeTestJSON-1176057342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe0efd6d-434b-46dc-92fb-9d0e6f0af259) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '714adf2f-8eef-4812-aa55-c2178d3c4ce0', 'volume_name': 'volume-714adf2f-8eef-4812-aa55-c2178d3c4ce0', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:45:13 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8d695dfd-e2d9-40fd-bf88-4ee9298d6932 tempest-AttachVolumeTestJSON-1176057342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0723a250-c954-401d-a0bf-427faa873ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:45:13 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8d695dfd-e2d9-40fd-bf88-4ee9298d6932 tempest-AttachVolumeTestJSON-1176057342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0723a250-c954-401d-a0bf-427faa873ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:45:13 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8d695dfd-e2d9-40fd-bf88-4ee9298d6932 tempest-AttachVolumeTestJSON-1176057342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25d66410-9055-4a38-a088-bfd8d58fef1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:45:13 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-8d695dfd-e2d9-40fd-bf88-4ee9298d6932 tempest-AttachVolumeTestJSON-1176057342 None] Volume 714adf2f-8eef-4812-aa55-c2178d3c4ce0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-714adf2f-8eef-4812-aa55-c2178d3c4ce0', 'volume_size': 1} Sep 25 11:45:13 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-8d695dfd-e2d9-40fd-bf88-4ee9298d6932 tempest-AttachVolumeTestJSON-1176057342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:45:14 devstack sudo[96537]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:14 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-34df64a8-7de1-4c09-8085-346e420abae6 tempest-SnapshotsActionsTest-1803776119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.869bc753-e264-43e0-b081-073291d4cb34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.9d2e09c0-cfab-46a1-b48a-38a9e71ae0b5 1G" returned: 0 in 0.776s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:14 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-34df64a8-7de1-4c09-8085-346e420abae6 tempest-SnapshotsActionsTest-1803776119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.869bc753-e264-43e0-b081-073291d4cb34 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.9d2e09c0-cfab-46a1-b48a-38a9e71ae0b5 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:14 devstack sudo[96544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.869bc753-e264-43e0-b081-073291d4cb34 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.9d2e09c0-cfab-46a1-b48a-38a9e71ae0b5 Sep 25 11:45:14 devstack sudo[96544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:14 devstack sudo[96544]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:14 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-34df64a8-7de1-4c09-8085-346e420abae6 tempest-SnapshotsActionsTest-1803776119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.869bc753-e264-43e0-b081-073291d4cb34 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.9d2e09c0-cfab-46a1-b48a-38a9e71ae0b5" returned: 0 in 0.552s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:14 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-34df64a8-7de1-4c09-8085-346e420abae6 tempest-SnapshotsActionsTest-1803776119 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.9d2e09c0-cfab-46a1-b48a-38a9e71ae0b5 is being set with open permissions: ugo+rw Sep 25 11:45:14 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-34df64a8-7de1-4c09-8085-346e420abae6 tempest-SnapshotsActionsTest-1803776119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.9d2e09c0-cfab-46a1-b48a-38a9e71ae0b5 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:14 devstack sudo[96550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.9d2e09c0-cfab-46a1-b48a-38a9e71ae0b5 Sep 25 11:45:14 devstack sudo[96550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:15 devstack sudo[96550]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:15 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-34df64a8-7de1-4c09-8085-346e420abae6 tempest-SnapshotsActionsTest-1803776119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.9d2e09c0-cfab-46a1-b48a-38a9e71ae0b5" returned: 0 in 0.411s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:15 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-34df64a8-7de1-4c09-8085-346e420abae6 tempest-SnapshotsActionsTest-1803776119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.418s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:45:15 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-8d695dfd-e2d9-40fd-bf88-4ee9298d6932 tempest-AttachVolumeTestJSON-1176057342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.476s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:45:15 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-8d695dfd-e2d9-40fd-bf88-4ee9298d6932 tempest-AttachVolumeTestJSON-1176057342 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:45:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-183042042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=714adf2f-8eef-4812-aa55-c2178d3c4ce0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecac587be34044a8859419c305c8dcd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:45:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:45:14Z,use_quota=True,user_id='890369c91616454eb42aaa7ecb37c74e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:45:15 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-8d695dfd-e2d9-40fd-bf88-4ee9298d6932 tempest-AttachVolumeTestJSON-1176057342 None] Creating volume 714adf2f-8eef-4812-aa55-c2178d3c4ce0 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:45:15 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-8d695dfd-e2d9-40fd-bf88-4ee9298d6932 tempest-AttachVolumeTestJSON-1176057342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:45:15 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-8d695dfd-e2d9-40fd-bf88-4ee9298d6932 tempest-AttachVolumeTestJSON-1176057342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:45:15 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-8d695dfd-e2d9-40fd-bf88-4ee9298d6932 tempest-AttachVolumeTestJSON-1176057342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:45:15 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-8d695dfd-e2d9-40fd-bf88-4ee9298d6932 tempest-AttachVolumeTestJSON-1176057342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:45:15 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-8d695dfd-e2d9-40fd-bf88-4ee9298d6932 tempest-AttachVolumeTestJSON-1176057342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:45:15 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-8d695dfd-e2d9-40fd-bf88-4ee9298d6932 tempest-AttachVolumeTestJSON-1176057342 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:45:15 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-8d695dfd-e2d9-40fd-bf88-4ee9298d6932 tempest-AttachVolumeTestJSON-1176057342 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:45:15 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8d695dfd-e2d9-40fd-bf88-4ee9298d6932 tempest-AttachVolumeTestJSON-1176057342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-714adf2f-8eef-4812-aa55-c2178d3c4ce0 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:15 devstack sudo[96557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-714adf2f-8eef-4812-aa55-c2178d3c4ce0 1073741824 Sep 25 11:45:15 devstack sudo[96557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:15 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-34df64a8-7de1-4c09-8085-346e420abae6 tempest-SnapshotsActionsTest-1803776119 None] Create snapshot completed successfully Sep 25 11:45:16 devstack sudo[96557]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:16 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8d695dfd-e2d9-40fd-bf88-4ee9298d6932 tempest-AttachVolumeTestJSON-1176057342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-714adf2f-8eef-4812-aa55-c2178d3c4ce0 1073741824" returned: 0 in 0.745s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:16 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8d695dfd-e2d9-40fd-bf88-4ee9298d6932 tempest-AttachVolumeTestJSON-1176057342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-714adf2f-8eef-4812-aa55-c2178d3c4ce0 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:16 devstack sudo[96572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-714adf2f-8eef-4812-aa55-c2178d3c4ce0 Sep 25 11:45:16 devstack sudo[96572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:16 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ab4d7542-3a90-4c38-9321-44331668c6bd tempest-SnapshotsActionsTest-988724043 None] Acquiring lock "cinder-9d2e09c0-cfab-46a1-b48a-38a9e71ae0b5-delete_snapshot" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:45:16 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ab4d7542-3a90-4c38-9321-44331668c6bd tempest-SnapshotsActionsTest-988724043 None] Lock "cinder-9d2e09c0-cfab-46a1-b48a-38a9e71ae0b5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:45:16 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ab4d7542-3a90-4c38-9321-44331668c6bd tempest-SnapshotsActionsTest-988724043 None] Acquiring lock "cinder-quobyte-a2e3eb39-980e-4e9e-8cb9-13355ff763c9" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:45:16 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ab4d7542-3a90-4c38-9321-44331668c6bd tempest-SnapshotsActionsTest-988724043 None] Lock "cinder-quobyte-a2e3eb39-980e-4e9e-8cb9-13355ff763c9" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:45:16 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ab4d7542-3a90-4c38-9321-44331668c6bd tempest-SnapshotsActionsTest-988724043 None] Acquiring lock "cinder-quobyte-9d2e09c0-cfab-46a1-b48a-38a9e71ae0b5" by "_delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:45:16 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ab4d7542-3a90-4c38-9321-44331668c6bd tempest-SnapshotsActionsTest-988724043 None] Lock "cinder-quobyte-9d2e09c0-cfab-46a1-b48a-38a9e71ae0b5" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:45:16 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-ab4d7542-3a90-4c38-9321-44331668c6bd tempest-SnapshotsActionsTest-988724043 None] Deleting offline snapshot 9d2e09c0-cfab-46a1-b48a-38a9e71ae0b5 of volume a2e3eb39-980e-4e9e-8cb9-13355ff763c9 {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:45:16 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-ab4d7542-3a90-4c38-9321-44331668c6bd tempest-SnapshotsActionsTest-988724043 None] snapshot_file for this snap is: volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.9d2e09c0-cfab-46a1-b48a-38a9e71ae0b5 {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:45:16 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[40bf3b1a-ae18-44c9-bcc1-0601e39f19c5]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:45:16 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ab4d7542-3a90-4c38-9321-44331668c6bd tempest-SnapshotsActionsTest-988724043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.9d2e09c0-cfab-46a1-b48a-38a9e71ae0b5 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:16 devstack sudo[96572]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:16 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8d695dfd-e2d9-40fd-bf88-4ee9298d6932 tempest-AttachVolumeTestJSON-1176057342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-714adf2f-8eef-4812-aa55-c2178d3c4ce0" returned: 0 in 0.483s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:16 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-8d695dfd-e2d9-40fd-bf88-4ee9298d6932 tempest-AttachVolumeTestJSON-1176057342 None] <== create_volume: return (1298ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:45:16 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-8d695dfd-e2d9-40fd-bf88-4ee9298d6932 tempest-AttachVolumeTestJSON-1176057342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.304s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:45:16 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8d695dfd-e2d9-40fd-bf88-4ee9298d6932 tempest-AttachVolumeTestJSON-1176057342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25d66410-9055-4a38-a088-bfd8d58fef1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-714adf2f-8eef-4812-aa55-c2178d3c4ce0', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:45:16 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8d695dfd-e2d9-40fd-bf88-4ee9298d6932 tempest-AttachVolumeTestJSON-1176057342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93bf6912-29d0-4dcf-93ce-18b86e9d66f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:45:16 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-8d695dfd-e2d9-40fd-bf88-4ee9298d6932 tempest-AttachVolumeTestJSON-1176057342 None] Volume volume-714adf2f-8eef-4812-aa55-c2178d3c4ce0 (714adf2f-8eef-4812-aa55-c2178d3c4ce0): created successfully Sep 25 11:45:16 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8d695dfd-e2d9-40fd-bf88-4ee9298d6932 tempest-AttachVolumeTestJSON-1176057342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93bf6912-29d0-4dcf-93ce-18b86e9d66f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:45:16 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8d695dfd-e2d9-40fd-bf88-4ee9298d6932 tempest-AttachVolumeTestJSON-1176057342 None] Flow 'volume_create_manager' (f5c0f7fc-9dfb-4d09-8419-9abc182345c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:45:16 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-8d695dfd-e2d9-40fd-bf88-4ee9298d6932 tempest-AttachVolumeTestJSON-1176057342 None] Created volume successfully. Sep 25 11:45:16 devstack sudo[96575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.9d2e09c0-cfab-46a1-b48a-38a9e71ae0b5 Sep 25 11:45:16 devstack sudo[96575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:17 devstack sudo[96575]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:17 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ab4d7542-3a90-4c38-9321-44331668c6bd tempest-SnapshotsActionsTest-988724043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.9d2e09c0-cfab-46a1-b48a-38a9e71ae0b5" returned: 0 in 0.654s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:17 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-ab4d7542-3a90-4c38-9321-44331668c6bd tempest-SnapshotsActionsTest-988724043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86984) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:45:17 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d4db36-07c1-4f94-b716-56f22a8a7bc2]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:45:17 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ab4d7542-3a90-4c38-9321-44331668c6bd tempest-SnapshotsActionsTest-988724043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.869bc753-e264-43e0-b081-073291d4cb34 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:17 devstack sudo[96583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.869bc753-e264-43e0-b081-073291d4cb34 Sep 25 11:45:17 devstack sudo[96583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:17 devstack sudo[96583]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:17 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ab4d7542-3a90-4c38-9321-44331668c6bd tempest-SnapshotsActionsTest-988724043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.869bc753-e264-43e0-b081-073291d4cb34" returned: 0 in 0.543s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:17 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-ab4d7542-3a90-4c38-9321-44331668c6bd tempest-SnapshotsActionsTest-988724043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86984) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:45:17 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ab4d7542-3a90-4c38-9321-44331668c6bd tempest-SnapshotsActionsTest-988724043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.9d2e09c0-cfab-46a1-b48a-38a9e71ae0b5 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:17 devstack sudo[96589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.9d2e09c0-cfab-46a1-b48a-38a9e71ae0b5 Sep 25 11:45:17 devstack sudo[96589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:18 devstack sudo[96589]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-17cd14a0-fbbd-43d7-8449-d37a1e7f6160 req-89e2f074-2f36-4a82-b619-a40edcd1cd33 tempest-AttachVolumeTestJSON-1176057342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:45:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-17cd14a0-fbbd-43d7-8449-d37a1e7f6160 req-89e2f074-2f36-4a82-b619-a40edcd1cd33 tempest-AttachVolumeTestJSON-1176057342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:45:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ab4d7542-3a90-4c38-9321-44331668c6bd tempest-SnapshotsActionsTest-988724043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.9d2e09c0-cfab-46a1-b48a-38a9e71ae0b5" returned: 0 in 0.656s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ab4d7542-3a90-4c38-9321-44331668c6bd tempest-SnapshotsActionsTest-988724043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.9d2e09c0-cfab-46a1-b48a-38a9e71ae0b5 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-17cd14a0-fbbd-43d7-8449-d37a1e7f6160 req-89e2f074-2f36-4a82-b619-a40edcd1cd33 tempest-AttachVolumeTestJSON-1176057342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.043s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:45:18 devstack sudo[96603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.9d2e09c0-cfab-46a1-b48a-38a9e71ae0b5 Sep 25 11:45:18 devstack sudo[96603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:18 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [req-17cd14a0-fbbd-43d7-8449-d37a1e7f6160 req-89e2f074-2f36-4a82-b619-a40edcd1cd33 tempest-AttachVolumeTestJSON-1176057342 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba', 'name': 'volume-714adf2f-8eef-4812-aa55-c2178d3c4ce0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5f733ed9-3f6f-4ae9-94d5-a801cf9b2aeb', 'enforce_multipath': True} {{(pid=86984) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 11:45:18 devstack cinder-volume[86984]: INFO cinder.volume.manager [req-17cd14a0-fbbd-43d7-8449-d37a1e7f6160 req-89e2f074-2f36-4a82-b619-a40edcd1cd33 tempest-AttachVolumeTestJSON-1176057342 None] attachment_update completed successfully. Sep 25 11:45:19 devstack sudo[96603]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:19 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ab4d7542-3a90-4c38-9321-44331668c6bd tempest-SnapshotsActionsTest-988724043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.9d2e09c0-cfab-46a1-b48a-38a9e71ae0b5" returned: 0 in 0.456s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:19 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ab4d7542-3a90-4c38-9321-44331668c6bd tempest-SnapshotsActionsTest-988724043 None] Lock "cinder-quobyte-9d2e09c0-cfab-46a1-b48a-38a9e71ae0b5" released by "_delete_snapshot" :: held 2.537s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:45:19 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ab4d7542-3a90-4c38-9321-44331668c6bd tempest-SnapshotsActionsTest-988724043 None] Lock "cinder-quobyte-a2e3eb39-980e-4e9e-8cb9-13355ff763c9" released by "delete_snapshot" :: held 2.590s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:45:19 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-ab4d7542-3a90-4c38-9321-44331668c6bd tempest-SnapshotsActionsTest-988724043 None] Created reservations ['bce0f6fc-623e-4ef0-825d-252dd756c446', '57c71d50-f910-4ca7-95e7-6b573c78dcb7', '958eb8ee-c980-4b46-89ad-982269290e56', '6a8d94a6-2a24-4d8b-bf37-e4f38013b0cd'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:45:19 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-ab4d7542-3a90-4c38-9321-44331668c6bd tempest-SnapshotsActionsTest-988724043 None] Delete snapshot completed successfully. Sep 25 11:45:19 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ab4d7542-3a90-4c38-9321-44331668c6bd tempest-SnapshotsActionsTest-988724043 None] Lock "cinder-9d2e09c0-cfab-46a1-b48a-38a9e71ae0b5-delete_snapshot" released by "delete_snapshot" :: held 2.812s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:45:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-8eae5031-f7cb-4d0d-9d75-e94e32dd3d8b tempest-SnapshotsActionsTest-1803776119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:45:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-8eae5031-f7cb-4d0d-9d75-e94e32dd3d8b tempest-SnapshotsActionsTest-1803776119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:45:20 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-8eae5031-f7cb-4d0d-9d75-e94e32dd3d8b tempest-SnapshotsActionsTest-1803776119 None] Creating offline snapshot 65f6d35f-679f-4006-9371-c6e726a6a5ff of volume a2e3eb39-980e-4e9e-8cb9-13355ff763c9 {{(pid=86984) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:45:20 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[276db020-5c3d-47c8-8a7b-72aa0655ad03]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:45:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8eae5031-f7cb-4d0d-9d75-e94e32dd3d8b tempest-SnapshotsActionsTest-1803776119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.869bc753-e264-43e0-b081-073291d4cb34 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:20 devstack sudo[96611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.869bc753-e264-43e0-b081-073291d4cb34 Sep 25 11:45:20 devstack sudo[96611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:20 devstack sudo[96611]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8eae5031-f7cb-4d0d-9d75-e94e32dd3d8b tempest-SnapshotsActionsTest-1803776119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.869bc753-e264-43e0-b081-073291d4cb34" returned: 0 in 0.488s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:20 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-8eae5031-f7cb-4d0d-9d75-e94e32dd3d8b tempest-SnapshotsActionsTest-1803776119 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86984) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:45:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8eae5031-f7cb-4d0d-9d75-e94e32dd3d8b tempest-SnapshotsActionsTest-1803776119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.869bc753-e264-43e0-b081-073291d4cb34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.65f6d35f-679f-4006-9371-c6e726a6a5ff 1G {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:20 devstack sudo[96617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.869bc753-e264-43e0-b081-073291d4cb34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.65f6d35f-679f-4006-9371-c6e726a6a5ff 1G Sep 25 11:45:20 devstack sudo[96617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:21 devstack sudo[96617]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:21 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8eae5031-f7cb-4d0d-9d75-e94e32dd3d8b tempest-SnapshotsActionsTest-1803776119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.869bc753-e264-43e0-b081-073291d4cb34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.65f6d35f-679f-4006-9371-c6e726a6a5ff 1G" returned: 0 in 0.652s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:21 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8eae5031-f7cb-4d0d-9d75-e94e32dd3d8b tempest-SnapshotsActionsTest-1803776119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.869bc753-e264-43e0-b081-073291d4cb34 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.65f6d35f-679f-4006-9371-c6e726a6a5ff {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:21 devstack sudo[96623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.869bc753-e264-43e0-b081-073291d4cb34 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.65f6d35f-679f-4006-9371-c6e726a6a5ff Sep 25 11:45:21 devstack sudo[96623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:21 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-3103d950-c55f-4906-80af-2d8247928a8c tempest-AttachVolumeTestJSON-1176057342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:45:21 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3103d950-c55f-4906-80af-2d8247928a8c tempest-AttachVolumeTestJSON-1176057342 None] Flow 'volume_create_manager' (dcf17094-95a6-4235-8a88-92431d4f1dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:45:21 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3103d950-c55f-4906-80af-2d8247928a8c tempest-AttachVolumeTestJSON-1176057342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7160d706-1489-4364-bb38-60ccdfec1e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:45:21 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3103d950-c55f-4906-80af-2d8247928a8c tempest-AttachVolumeTestJSON-1176057342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7160d706-1489-4364-bb38-60ccdfec1e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:45:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-895678865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=976e9aac-60a3-4dc4-8976-0d6db6d84352,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecac587be34044a8859419c305c8dcd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:45:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:45:22Z,use_quota=True,user_id='890369c91616454eb42aaa7ecb37c74e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:45:21 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3103d950-c55f-4906-80af-2d8247928a8c tempest-AttachVolumeTestJSON-1176057342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87816101-f9c7-4431-a730-69d9e1815c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:45:21 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3103d950-c55f-4906-80af-2d8247928a8c tempest-AttachVolumeTestJSON-1176057342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87816101-f9c7-4431-a730-69d9e1815c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:45:21 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3103d950-c55f-4906-80af-2d8247928a8c tempest-AttachVolumeTestJSON-1176057342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (718e0b46-ccba-4b09-bab0-0dd019107f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:45:21 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3103d950-c55f-4906-80af-2d8247928a8c tempest-AttachVolumeTestJSON-1176057342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (718e0b46-ccba-4b09-bab0-0dd019107f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '976e9aac-60a3-4dc4-8976-0d6db6d84352', 'volume_name': 'volume-976e9aac-60a3-4dc4-8976-0d6db6d84352', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:45:21 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3103d950-c55f-4906-80af-2d8247928a8c tempest-AttachVolumeTestJSON-1176057342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53385536-895f-4c94-8c09-bb5faa3360e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:45:21 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3103d950-c55f-4906-80af-2d8247928a8c tempest-AttachVolumeTestJSON-1176057342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53385536-895f-4c94-8c09-bb5faa3360e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:45:21 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3103d950-c55f-4906-80af-2d8247928a8c tempest-AttachVolumeTestJSON-1176057342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e15c0aa-9434-4c73-882f-c3e822a8c856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:45:21 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-3103d950-c55f-4906-80af-2d8247928a8c tempest-AttachVolumeTestJSON-1176057342 None] Volume 976e9aac-60a3-4dc4-8976-0d6db6d84352: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-976e9aac-60a3-4dc4-8976-0d6db6d84352', 'volume_size': 1} Sep 25 11:45:21 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3103d950-c55f-4906-80af-2d8247928a8c tempest-AttachVolumeTestJSON-1176057342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:45:21 devstack sudo[96623]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:21 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8eae5031-f7cb-4d0d-9d75-e94e32dd3d8b tempest-SnapshotsActionsTest-1803776119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.869bc753-e264-43e0-b081-073291d4cb34 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.65f6d35f-679f-4006-9371-c6e726a6a5ff" returned: 0 in 0.350s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:21 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-8eae5031-f7cb-4d0d-9d75-e94e32dd3d8b tempest-SnapshotsActionsTest-1803776119 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.65f6d35f-679f-4006-9371-c6e726a6a5ff is being set with open permissions: ugo+rw Sep 25 11:45:21 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8eae5031-f7cb-4d0d-9d75-e94e32dd3d8b tempest-SnapshotsActionsTest-1803776119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.65f6d35f-679f-4006-9371-c6e726a6a5ff {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:21 devstack sudo[96629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.65f6d35f-679f-4006-9371-c6e726a6a5ff Sep 25 11:45:21 devstack sudo[96629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:21 devstack sudo[96629]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:21 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8eae5031-f7cb-4d0d-9d75-e94e32dd3d8b tempest-SnapshotsActionsTest-1803776119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.65f6d35f-679f-4006-9371-c6e726a6a5ff" returned: 0 in 0.294s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:22 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-8eae5031-f7cb-4d0d-9d75-e94e32dd3d8b tempest-SnapshotsActionsTest-1803776119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.912s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:45:22 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3103d950-c55f-4906-80af-2d8247928a8c tempest-AttachVolumeTestJSON-1176057342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.349s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:45:22 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3103d950-c55f-4906-80af-2d8247928a8c tempest-AttachVolumeTestJSON-1176057342 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:45:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-895678865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=976e9aac-60a3-4dc4-8976-0d6db6d84352,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecac587be34044a8859419c305c8dcd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:45:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:45:22Z,use_quota=True,user_id='890369c91616454eb42aaa7ecb37c74e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:45:22 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-3103d950-c55f-4906-80af-2d8247928a8c tempest-AttachVolumeTestJSON-1176057342 None] Creating volume 976e9aac-60a3-4dc4-8976-0d6db6d84352 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:45:22 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3103d950-c55f-4906-80af-2d8247928a8c tempest-AttachVolumeTestJSON-1176057342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:45:22 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3103d950-c55f-4906-80af-2d8247928a8c tempest-AttachVolumeTestJSON-1176057342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:45:22 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3103d950-c55f-4906-80af-2d8247928a8c tempest-AttachVolumeTestJSON-1176057342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:45:22 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3103d950-c55f-4906-80af-2d8247928a8c tempest-AttachVolumeTestJSON-1176057342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:45:22 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3103d950-c55f-4906-80af-2d8247928a8c tempest-AttachVolumeTestJSON-1176057342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:45:22 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3103d950-c55f-4906-80af-2d8247928a8c tempest-AttachVolumeTestJSON-1176057342 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:45:22 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-3103d950-c55f-4906-80af-2d8247928a8c tempest-AttachVolumeTestJSON-1176057342 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:45:22 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3103d950-c55f-4906-80af-2d8247928a8c tempest-AttachVolumeTestJSON-1176057342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-976e9aac-60a3-4dc4-8976-0d6db6d84352 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:22 devstack sudo[96634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-976e9aac-60a3-4dc4-8976-0d6db6d84352 1073741824 Sep 25 11:45:22 devstack sudo[96634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:22 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-8eae5031-f7cb-4d0d-9d75-e94e32dd3d8b tempest-SnapshotsActionsTest-1803776119 None] Create snapshot completed successfully Sep 25 11:45:22 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-b51e57b0-0957-4a53-aafc-f1213542c71e tempest-SnapshotsActionsTest-988724043 None] Acquiring lock "cinder-65f6d35f-679f-4006-9371-c6e726a6a5ff-delete_snapshot" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:45:22 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-b51e57b0-0957-4a53-aafc-f1213542c71e tempest-SnapshotsActionsTest-988724043 None] Lock "cinder-65f6d35f-679f-4006-9371-c6e726a6a5ff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:45:22 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-b51e57b0-0957-4a53-aafc-f1213542c71e tempest-SnapshotsActionsTest-988724043 None] Acquiring lock "cinder-quobyte-a2e3eb39-980e-4e9e-8cb9-13355ff763c9" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:45:22 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-b51e57b0-0957-4a53-aafc-f1213542c71e tempest-SnapshotsActionsTest-988724043 None] Lock "cinder-quobyte-a2e3eb39-980e-4e9e-8cb9-13355ff763c9" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:45:22 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-b51e57b0-0957-4a53-aafc-f1213542c71e tempest-SnapshotsActionsTest-988724043 None] Acquiring lock "cinder-quobyte-65f6d35f-679f-4006-9371-c6e726a6a5ff" by "_delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:45:22 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-b51e57b0-0957-4a53-aafc-f1213542c71e tempest-SnapshotsActionsTest-988724043 None] Lock "cinder-quobyte-65f6d35f-679f-4006-9371-c6e726a6a5ff" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:45:22 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-b51e57b0-0957-4a53-aafc-f1213542c71e tempest-SnapshotsActionsTest-988724043 None] Deleting offline snapshot 65f6d35f-679f-4006-9371-c6e726a6a5ff of volume a2e3eb39-980e-4e9e-8cb9-13355ff763c9 {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:45:22 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-b51e57b0-0957-4a53-aafc-f1213542c71e tempest-SnapshotsActionsTest-988724043 None] snapshot_file for this snap is: volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.65f6d35f-679f-4006-9371-c6e726a6a5ff {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:45:22 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d5b591-4596-4097-900b-9481a64e9454]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:45:22 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-b51e57b0-0957-4a53-aafc-f1213542c71e tempest-SnapshotsActionsTest-988724043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.65f6d35f-679f-4006-9371-c6e726a6a5ff {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:22 devstack sudo[96634]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:22 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3103d950-c55f-4906-80af-2d8247928a8c tempest-AttachVolumeTestJSON-1176057342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-976e9aac-60a3-4dc4-8976-0d6db6d84352 1073741824" returned: 0 in 0.730s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:22 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3103d950-c55f-4906-80af-2d8247928a8c tempest-AttachVolumeTestJSON-1176057342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-976e9aac-60a3-4dc4-8976-0d6db6d84352 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:22 devstack sudo[96640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.65f6d35f-679f-4006-9371-c6e726a6a5ff Sep 25 11:45:22 devstack sudo[96640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:22 devstack sudo[96642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-976e9aac-60a3-4dc4-8976-0d6db6d84352 Sep 25 11:45:22 devstack sudo[96642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:23 devstack sudo[96642]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3103d950-c55f-4906-80af-2d8247928a8c tempest-AttachVolumeTestJSON-1176057342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-976e9aac-60a3-4dc4-8976-0d6db6d84352" returned: 0 in 0.510s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:23 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3103d950-c55f-4906-80af-2d8247928a8c tempest-AttachVolumeTestJSON-1176057342 None] <== create_volume: return (1306ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:45:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3103d950-c55f-4906-80af-2d8247928a8c tempest-AttachVolumeTestJSON-1176057342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.313s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:45:23 devstack sudo[96640]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:23 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3103d950-c55f-4906-80af-2d8247928a8c tempest-AttachVolumeTestJSON-1176057342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e15c0aa-9434-4c73-882f-c3e822a8c856) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-976e9aac-60a3-4dc4-8976-0d6db6d84352', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:45:23 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3103d950-c55f-4906-80af-2d8247928a8c tempest-AttachVolumeTestJSON-1176057342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84935a2d-c66b-4446-9d96-d69e850aebe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:45:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-b51e57b0-0957-4a53-aafc-f1213542c71e tempest-SnapshotsActionsTest-988724043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.65f6d35f-679f-4006-9371-c6e726a6a5ff" returned: 0 in 0.781s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:23 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-b51e57b0-0957-4a53-aafc-f1213542c71e tempest-SnapshotsActionsTest-988724043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86984) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:45:23 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-3103d950-c55f-4906-80af-2d8247928a8c tempest-AttachVolumeTestJSON-1176057342 None] Volume volume-976e9aac-60a3-4dc4-8976-0d6db6d84352 (976e9aac-60a3-4dc4-8976-0d6db6d84352): created successfully Sep 25 11:45:23 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3103d950-c55f-4906-80af-2d8247928a8c tempest-AttachVolumeTestJSON-1176057342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84935a2d-c66b-4446-9d96-d69e850aebe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:45:23 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3103d950-c55f-4906-80af-2d8247928a8c tempest-AttachVolumeTestJSON-1176057342 None] Flow 'volume_create_manager' (dcf17094-95a6-4235-8a88-92431d4f1dce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:45:23 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad5a594-2ae1-42c6-a7ef-f08e33b7b92a]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:45:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-b51e57b0-0957-4a53-aafc-f1213542c71e tempest-SnapshotsActionsTest-988724043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.869bc753-e264-43e0-b081-073291d4cb34 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:23 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-3103d950-c55f-4906-80af-2d8247928a8c tempest-AttachVolumeTestJSON-1176057342 None] Created volume successfully. Sep 25 11:45:23 devstack sudo[96654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.869bc753-e264-43e0-b081-073291d4cb34 Sep 25 11:45:23 devstack sudo[96654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:24 devstack sudo[96654]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:24 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-b51e57b0-0957-4a53-aafc-f1213542c71e tempest-SnapshotsActionsTest-988724043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.869bc753-e264-43e0-b081-073291d4cb34" returned: 0 in 0.867s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:24 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-b51e57b0-0957-4a53-aafc-f1213542c71e tempest-SnapshotsActionsTest-988724043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86984) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:45:24 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-b51e57b0-0957-4a53-aafc-f1213542c71e tempest-SnapshotsActionsTest-988724043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.65f6d35f-679f-4006-9371-c6e726a6a5ff {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:24 devstack sudo[96682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.65f6d35f-679f-4006-9371-c6e726a6a5ff Sep 25 11:45:24 devstack sudo[96682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:25 devstack sudo[96682]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:25 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-b51e57b0-0957-4a53-aafc-f1213542c71e tempest-SnapshotsActionsTest-988724043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.65f6d35f-679f-4006-9371-c6e726a6a5ff" returned: 0 in 0.641s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:25 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-b51e57b0-0957-4a53-aafc-f1213542c71e tempest-SnapshotsActionsTest-988724043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.65f6d35f-679f-4006-9371-c6e726a6a5ff {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:25 devstack sudo[96691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.65f6d35f-679f-4006-9371-c6e726a6a5ff Sep 25 11:45:25 devstack sudo[96691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:25 devstack sudo[96691]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:25 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-b51e57b0-0957-4a53-aafc-f1213542c71e tempest-SnapshotsActionsTest-988724043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.65f6d35f-679f-4006-9371-c6e726a6a5ff" returned: 0 in 0.363s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:25 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-b51e57b0-0957-4a53-aafc-f1213542c71e tempest-SnapshotsActionsTest-988724043 None] Lock "cinder-quobyte-65f6d35f-679f-4006-9371-c6e726a6a5ff" released by "_delete_snapshot" :: held 2.854s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:45:25 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-b51e57b0-0957-4a53-aafc-f1213542c71e tempest-SnapshotsActionsTest-988724043 None] Lock "cinder-quobyte-a2e3eb39-980e-4e9e-8cb9-13355ff763c9" released by "delete_snapshot" :: held 2.894s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:45:25 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-b51e57b0-0957-4a53-aafc-f1213542c71e tempest-SnapshotsActionsTest-988724043 None] Created reservations ['08dd56b1-84d8-4393-8dbb-25789e9063c2', 'dfd9a0ae-1148-494d-b863-db4e74779997', '1ef8f8a9-23ce-417c-9ba8-be2f9e5cb27f', '6a0b6b37-0e2c-4ea9-b1f4-d2b084a901e5'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:45:25 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-b51e57b0-0957-4a53-aafc-f1213542c71e tempest-SnapshotsActionsTest-988724043 None] Delete snapshot completed successfully. Sep 25 11:45:25 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-b51e57b0-0957-4a53-aafc-f1213542c71e tempest-SnapshotsActionsTest-988724043 None] Lock "cinder-65f6d35f-679f-4006-9371-c6e726a6a5ff-delete_snapshot" released by "delete_snapshot" :: held 3.161s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:45:26 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-3e900d85-9175-4013-a18a-39455f565e5e req-dc93c6db-9ad7-4971-9600-749d64308929 tempest-AttachVolumeTestJSON-1176057342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:45:26 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-3e900d85-9175-4013-a18a-39455f565e5e req-dc93c6db-9ad7-4971-9600-749d64308929 tempest-AttachVolumeTestJSON-1176057342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:45:26 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-3e900d85-9175-4013-a18a-39455f565e5e req-dc93c6db-9ad7-4971-9600-749d64308929 tempest-AttachVolumeTestJSON-1176057342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:45:26 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [req-3e900d85-9175-4013-a18a-39455f565e5e req-dc93c6db-9ad7-4971-9600-749d64308929 tempest-AttachVolumeTestJSON-1176057342 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba', 'name': 'volume-976e9aac-60a3-4dc4-8976-0d6db6d84352', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a2a49ac6-f6b8-4eda-b9fb-ce2306127e41', 'enforce_multipath': True} {{(pid=86984) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 11:45:26 devstack cinder-volume[86984]: INFO cinder.volume.manager [req-3e900d85-9175-4013-a18a-39455f565e5e req-dc93c6db-9ad7-4971-9600-749d64308929 tempest-AttachVolumeTestJSON-1176057342 None] attachment_update completed successfully. Sep 25 11:45:26 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-092ad6ac-2354-41e8-adf9-e7c5463bb32d tempest-SnapshotsActionsTest-1803776119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:45:26 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-092ad6ac-2354-41e8-adf9-e7c5463bb32d tempest-SnapshotsActionsTest-1803776119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:45:26 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-092ad6ac-2354-41e8-adf9-e7c5463bb32d tempest-SnapshotsActionsTest-1803776119 None] Creating offline snapshot c9614b82-9180-4269-8fcd-73afe4d87ad4 of volume a2e3eb39-980e-4e9e-8cb9-13355ff763c9 {{(pid=86984) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:45:26 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e49af8e-07ef-497f-ab54-9e8ad15f84a5]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:45:26 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-092ad6ac-2354-41e8-adf9-e7c5463bb32d tempest-SnapshotsActionsTest-1803776119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.869bc753-e264-43e0-b081-073291d4cb34 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:26 devstack cinder-volume[86984]: INFO cinder.volume.manager [req-3307cbbf-3d9f-44f3-bb39-cbde29b87da7 req-ad44716f-2600-43cc-882d-28b7cde75c09 tempest-ServerActionsTestOtherA-778028304 None] Terminate volume connection completed successfully. Sep 25 11:45:26 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [req-3307cbbf-3d9f-44f3-bb39-cbde29b87da7 req-ad44716f-2600-43cc-882d-28b7cde75c09 tempest-ServerActionsTestOtherA-778028304 None] Deleting attachment 88ffa181-dec4-4787-a3b0-49b286261f17. {{(pid=86984) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 11:45:26 devstack sudo[96708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.869bc753-e264-43e0-b081-073291d4cb34 Sep 25 11:45:26 devstack sudo[96708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:27 devstack cinder-volume[86984]: DEBUG cinder.coordination [req-3307cbbf-3d9f-44f3-bb39-cbde29b87da7 req-320c320c-5e03-4342-bb5f-879458c54bbd tempest-ServerActionsTestOtherA-778028304 None] Acquiring lock "cinder-344bc46e-74be-455c-898f-6aae2435500d-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:45:27 devstack cinder-volume[86984]: DEBUG cinder.coordination [req-3307cbbf-3d9f-44f3-bb39-cbde29b87da7 req-320c320c-5e03-4342-bb5f-879458c54bbd tempest-ServerActionsTestOtherA-778028304 None] Lock "cinder-344bc46e-74be-455c-898f-6aae2435500d-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:45:27 devstack cinder-volume[86984]: DEBUG cinder.coordination [req-3307cbbf-3d9f-44f3-bb39-cbde29b87da7 req-320c320c-5e03-4342-bb5f-879458c54bbd tempest-ServerActionsTestOtherA-778028304 None] Acquiring lock "cinder-quobyte-344bc46e-74be-455c-898f-6aae2435500d" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:45:27 devstack cinder-volume[86984]: DEBUG cinder.coordination [req-3307cbbf-3d9f-44f3-bb39-cbde29b87da7 req-320c320c-5e03-4342-bb5f-879458c54bbd tempest-ServerActionsTestOtherA-778028304 None] Lock "cinder-quobyte-344bc46e-74be-455c-898f-6aae2435500d" acquired by "delete_volume" :: waited 0.069s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:45:27 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f0b523-ece3-439f-aa21-6ccd9801b07a]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:45:27 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [req-3307cbbf-3d9f-44f3-bb39-cbde29b87da7 req-320c320c-5e03-4342-bb5f-879458c54bbd tempest-ServerActionsTestOtherA-778028304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-344bc46e-74be-455c-898f-6aae2435500d {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:27 devstack sudo[96708]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:27 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-092ad6ac-2354-41e8-adf9-e7c5463bb32d tempest-SnapshotsActionsTest-1803776119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.869bc753-e264-43e0-b081-073291d4cb34" returned: 0 in 0.900s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:27 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-092ad6ac-2354-41e8-adf9-e7c5463bb32d tempest-SnapshotsActionsTest-1803776119 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86984) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:45:27 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-092ad6ac-2354-41e8-adf9-e7c5463bb32d tempest-SnapshotsActionsTest-1803776119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.869bc753-e264-43e0-b081-073291d4cb34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.c9614b82-9180-4269-8fcd-73afe4d87ad4 1G {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:27 devstack sudo[96716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-344bc46e-74be-455c-898f-6aae2435500d Sep 25 11:45:27 devstack sudo[96716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:27 devstack sudo[96718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.869bc753-e264-43e0-b081-073291d4cb34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.c9614b82-9180-4269-8fcd-73afe4d87ad4 1G Sep 25 11:45:27 devstack sudo[96718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:28 devstack sudo[96716]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:28 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [req-3307cbbf-3d9f-44f3-bb39-cbde29b87da7 req-320c320c-5e03-4342-bb5f-879458c54bbd tempest-ServerActionsTestOtherA-778028304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-344bc46e-74be-455c-898f-6aae2435500d" returned: 0 in 0.640s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:28 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [req-3307cbbf-3d9f-44f3-bb39-cbde29b87da7 req-320c320c-5e03-4342-bb5f-879458c54bbd tempest-ServerActionsTestOtherA-778028304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-344bc46e-74be-455c-898f-6aae2435500d {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:28 devstack sudo[96725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-344bc46e-74be-455c-898f-6aae2435500d Sep 25 11:45:28 devstack sudo[96725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:28 devstack sudo[96725]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:28 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [req-3307cbbf-3d9f-44f3-bb39-cbde29b87da7 req-320c320c-5e03-4342-bb5f-879458c54bbd tempest-ServerActionsTestOtherA-778028304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-344bc46e-74be-455c-898f-6aae2435500d" returned: 0 in 0.459s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:28 devstack cinder-volume[86984]: DEBUG cinder.coordination [req-3307cbbf-3d9f-44f3-bb39-cbde29b87da7 req-320c320c-5e03-4342-bb5f-879458c54bbd tempest-ServerActionsTestOtherA-778028304 None] Lock "cinder-quobyte-344bc46e-74be-455c-898f-6aae2435500d" released by "delete_volume" :: held 1.228s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:45:28 devstack sudo[96718]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:28 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-092ad6ac-2354-41e8-adf9-e7c5463bb32d tempest-SnapshotsActionsTest-1803776119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.869bc753-e264-43e0-b081-073291d4cb34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.c9614b82-9180-4269-8fcd-73afe4d87ad4 1G" returned: 0 in 0.989s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:28 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-092ad6ac-2354-41e8-adf9-e7c5463bb32d tempest-SnapshotsActionsTest-1803776119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.869bc753-e264-43e0-b081-073291d4cb34 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.c9614b82-9180-4269-8fcd-73afe4d87ad4 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:28 devstack sudo[96732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.869bc753-e264-43e0-b081-073291d4cb34 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.c9614b82-9180-4269-8fcd-73afe4d87ad4 Sep 25 11:45:28 devstack sudo[96732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:28 devstack cinder-volume[86984]: DEBUG cinder.quota [req-3307cbbf-3d9f-44f3-bb39-cbde29b87da7 req-320c320c-5e03-4342-bb5f-879458c54bbd tempest-ServerActionsTestOtherA-778028304 None] Created reservations ['febaa2fd-d91b-4c8e-ba08-086874a636f9', '2f5c5dba-e997-4d5b-ab0a-0484314c4775', 'c9510f90-0906-4aee-9ba8-7a0dcd49e529', 'a76d000b-862e-427a-842c-6940024e2e52'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:45:28 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-3307cbbf-3d9f-44f3-bb39-cbde29b87da7 req-320c320c-5e03-4342-bb5f-879458c54bbd tempest-ServerActionsTestOtherA-778028304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:45:28 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-3307cbbf-3d9f-44f3-bb39-cbde29b87da7 req-320c320c-5e03-4342-bb5f-879458c54bbd tempest-ServerActionsTestOtherA-778028304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:45:28 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [req-3307cbbf-3d9f-44f3-bb39-cbde29b87da7 req-320c320c-5e03-4342-bb5f-879458c54bbd tempest-ServerActionsTestOtherA-778028304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:45:28 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [req-3307cbbf-3d9f-44f3-bb39-cbde29b87da7 req-320c320c-5e03-4342-bb5f-879458c54bbd tempest-ServerActionsTestOtherA-778028304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:45:28 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-3307cbbf-3d9f-44f3-bb39-cbde29b87da7 req-320c320c-5e03-4342-bb5f-879458c54bbd tempest-ServerActionsTestOtherA-778028304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:45:28 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [req-3307cbbf-3d9f-44f3-bb39-cbde29b87da7 req-320c320c-5e03-4342-bb5f-879458c54bbd tempest-ServerActionsTestOtherA-778028304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:28 devstack sudo[96736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:45:28 devstack sudo[96736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:28 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-092ad6ac-2354-41e8-adf9-e7c5463bb32d tempest-SnapshotsActionsTest-1803776119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.869bc753-e264-43e0-b081-073291d4cb34 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.c9614b82-9180-4269-8fcd-73afe4d87ad4" returned: 0 in 0.428s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:28 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-092ad6ac-2354-41e8-adf9-e7c5463bb32d tempest-SnapshotsActionsTest-1803776119 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.c9614b82-9180-4269-8fcd-73afe4d87ad4 is being set with open permissions: ugo+rw Sep 25 11:45:28 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-092ad6ac-2354-41e8-adf9-e7c5463bb32d tempest-SnapshotsActionsTest-1803776119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.c9614b82-9180-4269-8fcd-73afe4d87ad4 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:28 devstack sudo[96732]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:29 devstack sudo[96739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.c9614b82-9180-4269-8fcd-73afe4d87ad4 Sep 25 11:45:29 devstack sudo[96739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:29 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-45dc25ec-cc35-49f7-8362-4ddc567b41fe tempest-ServerActionsTestOtherA-778028304 None] Acquiring lock "cinder-2c7fe0de-db71-4bca-bbb7-1a149b8f4ffa-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:45:29 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-45dc25ec-cc35-49f7-8362-4ddc567b41fe tempest-ServerActionsTestOtherA-778028304 None] Lock "cinder-2c7fe0de-db71-4bca-bbb7-1a149b8f4ffa-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:45:29 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-45dc25ec-cc35-49f7-8362-4ddc567b41fe tempest-ServerActionsTestOtherA-778028304 None] Acquiring lock "cinder-quobyte-2c7fe0de-db71-4bca-bbb7-1a149b8f4ffa" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:45:29 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-45dc25ec-cc35-49f7-8362-4ddc567b41fe tempest-ServerActionsTestOtherA-778028304 None] Lock "cinder-quobyte-2c7fe0de-db71-4bca-bbb7-1a149b8f4ffa" acquired by "delete_volume" :: waited 0.030s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:45:29 devstack sudo[96736]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:29 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [req-3307cbbf-3d9f-44f3-bb39-cbde29b87da7 req-320c320c-5e03-4342-bb5f-879458c54bbd tempest-ServerActionsTestOtherA-778028304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.680s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:29 devstack cinder-volume[86984]: DEBUG cinder.manager [req-3307cbbf-3d9f-44f3-bb39-cbde29b87da7 req-320c320c-5e03-4342-bb5f-879458c54bbd tempest-ServerActionsTestOtherA-778028304 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:45:29 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[162832f2-66d5-46ba-a96d-133c9470b3bd]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:45:29 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-45dc25ec-cc35-49f7-8362-4ddc567b41fe tempest-ServerActionsTestOtherA-778028304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2c7fe0de-db71-4bca-bbb7-1a149b8f4ffa {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:29 devstack sudo[96739]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:29 devstack cinder-volume[86984]: INFO cinder.volume.manager [req-3307cbbf-3d9f-44f3-bb39-cbde29b87da7 req-320c320c-5e03-4342-bb5f-879458c54bbd tempest-ServerActionsTestOtherA-778028304 None] Deleted volume successfully. Sep 25 11:45:29 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-092ad6ac-2354-41e8-adf9-e7c5463bb32d tempest-SnapshotsActionsTest-1803776119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.c9614b82-9180-4269-8fcd-73afe4d87ad4" returned: 0 in 0.557s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:29 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-092ad6ac-2354-41e8-adf9-e7c5463bb32d tempest-SnapshotsActionsTest-1803776119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.072s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:45:29 devstack cinder-volume[86984]: DEBUG cinder.coordination [req-3307cbbf-3d9f-44f3-bb39-cbde29b87da7 req-320c320c-5e03-4342-bb5f-879458c54bbd tempest-ServerActionsTestOtherA-778028304 None] Lock "cinder-344bc46e-74be-455c-898f-6aae2435500d-delete_volume" released by "delete_volume" :: held 2.492s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:45:29 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-092ad6ac-2354-41e8-adf9-e7c5463bb32d tempest-SnapshotsActionsTest-1803776119 None] Create snapshot completed successfully Sep 25 11:45:29 devstack sudo[96743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2c7fe0de-db71-4bca-bbb7-1a149b8f4ffa Sep 25 11:45:29 devstack sudo[96743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:29 devstack cinder-volume[86984]: INFO cinder.volume.manager [req-0bdf4e99-20f6-41da-a192-9285b4a2c161 req-dc0f9167-0030-4378-a455-0c4af5a1189a tempest-AttachVolumeTestJSON-1176057342 None] Terminate volume connection completed successfully. Sep 25 11:45:29 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [req-0bdf4e99-20f6-41da-a192-9285b4a2c161 req-dc0f9167-0030-4378-a455-0c4af5a1189a tempest-AttachVolumeTestJSON-1176057342 None] Deleting attachment 5f733ed9-3f6f-4ae9-94d5-a801cf9b2aeb. {{(pid=86984) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 11:45:29 devstack sudo[96743]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:29 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-45dc25ec-cc35-49f7-8362-4ddc567b41fe tempest-ServerActionsTestOtherA-778028304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2c7fe0de-db71-4bca-bbb7-1a149b8f4ffa" returned: 0 in 0.495s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:29 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-45dc25ec-cc35-49f7-8362-4ddc567b41fe tempest-ServerActionsTestOtherA-778028304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2c7fe0de-db71-4bca-bbb7-1a149b8f4ffa {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:30 devstack sudo[96753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2c7fe0de-db71-4bca-bbb7-1a149b8f4ffa Sep 25 11:45:30 devstack sudo[96753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:30 devstack sudo[96753]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:30 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-45dc25ec-cc35-49f7-8362-4ddc567b41fe tempest-ServerActionsTestOtherA-778028304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2c7fe0de-db71-4bca-bbb7-1a149b8f4ffa" returned: 0 in 0.341s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:30 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-45dc25ec-cc35-49f7-8362-4ddc567b41fe tempest-ServerActionsTestOtherA-778028304 None] Lock "cinder-quobyte-2c7fe0de-db71-4bca-bbb7-1a149b8f4ffa" released by "delete_volume" :: held 0.943s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:45:30 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-45dc25ec-cc35-49f7-8362-4ddc567b41fe tempest-ServerActionsTestOtherA-778028304 None] Created reservations ['5a73d051-c5c8-4d24-9d1f-ca4426d5c326', 'fb73bbdc-d8a3-4f12-ab4c-6b52ab8e9888', 'cf2817ee-c77d-4e31-9831-b51ecb06afe2', '6848f14b-eef4-458a-b440-f5d9ca28d021'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:45:30 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-45dc25ec-cc35-49f7-8362-4ddc567b41fe tempest-ServerActionsTestOtherA-778028304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:45:30 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-45dc25ec-cc35-49f7-8362-4ddc567b41fe tempest-ServerActionsTestOtherA-778028304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:45:30 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-45dc25ec-cc35-49f7-8362-4ddc567b41fe tempest-ServerActionsTestOtherA-778028304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:45:30 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-45dc25ec-cc35-49f7-8362-4ddc567b41fe tempest-ServerActionsTestOtherA-778028304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:45:30 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-45dc25ec-cc35-49f7-8362-4ddc567b41fe tempest-ServerActionsTestOtherA-778028304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:45:30 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-45dc25ec-cc35-49f7-8362-4ddc567b41fe tempest-ServerActionsTestOtherA-778028304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:30 devstack sudo[96758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:45:30 devstack sudo[96758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:30 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-c73c598d-4d17-4ff8-ad41-92d7c5d55a4c tempest-SnapshotsActionsTest-988724043 None] Acquiring lock "cinder-c9614b82-9180-4269-8fcd-73afe4d87ad4-delete_snapshot" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:45:31 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-c73c598d-4d17-4ff8-ad41-92d7c5d55a4c tempest-SnapshotsActionsTest-988724043 None] Lock "cinder-c9614b82-9180-4269-8fcd-73afe4d87ad4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:45:31 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-c73c598d-4d17-4ff8-ad41-92d7c5d55a4c tempest-SnapshotsActionsTest-988724043 None] Acquiring lock "cinder-quobyte-a2e3eb39-980e-4e9e-8cb9-13355ff763c9" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:45:31 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-c73c598d-4d17-4ff8-ad41-92d7c5d55a4c tempest-SnapshotsActionsTest-988724043 None] Lock "cinder-quobyte-a2e3eb39-980e-4e9e-8cb9-13355ff763c9" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:45:31 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-c73c598d-4d17-4ff8-ad41-92d7c5d55a4c tempest-SnapshotsActionsTest-988724043 None] Acquiring lock "cinder-quobyte-c9614b82-9180-4269-8fcd-73afe4d87ad4" by "_delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:45:31 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-c73c598d-4d17-4ff8-ad41-92d7c5d55a4c tempest-SnapshotsActionsTest-988724043 None] Lock "cinder-quobyte-c9614b82-9180-4269-8fcd-73afe4d87ad4" acquired by "_delete_snapshot" :: waited 0.049s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:45:31 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-c73c598d-4d17-4ff8-ad41-92d7c5d55a4c tempest-SnapshotsActionsTest-988724043 None] Deleting offline snapshot c9614b82-9180-4269-8fcd-73afe4d87ad4 of volume a2e3eb39-980e-4e9e-8cb9-13355ff763c9 {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:45:31 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-c73c598d-4d17-4ff8-ad41-92d7c5d55a4c tempest-SnapshotsActionsTest-988724043 None] snapshot_file for this snap is: volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.c9614b82-9180-4269-8fcd-73afe4d87ad4 {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:45:31 devstack sudo[96758]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:31 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-45dc25ec-cc35-49f7-8362-4ddc567b41fe tempest-ServerActionsTestOtherA-778028304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.658s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:31 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-45dc25ec-cc35-49f7-8362-4ddc567b41fe tempest-ServerActionsTestOtherA-778028304 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:45:31 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-45dc25ec-cc35-49f7-8362-4ddc567b41fe tempest-ServerActionsTestOtherA-778028304 None] Deleted volume successfully. Sep 25 11:45:31 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[372b0947-d622-4f45-a354-3b905e1670c1]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:45:31 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-c73c598d-4d17-4ff8-ad41-92d7c5d55a4c tempest-SnapshotsActionsTest-988724043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.c9614b82-9180-4269-8fcd-73afe4d87ad4 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:31 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-45dc25ec-cc35-49f7-8362-4ddc567b41fe tempest-ServerActionsTestOtherA-778028304 None] Lock "cinder-2c7fe0de-db71-4bca-bbb7-1a149b8f4ffa-delete_volume" released by "delete_volume" :: held 2.095s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:45:31 devstack sudo[96766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.c9614b82-9180-4269-8fcd-73afe4d87ad4 Sep 25 11:45:31 devstack sudo[96766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:31 devstack sudo[96766]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:31 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-c73c598d-4d17-4ff8-ad41-92d7c5d55a4c tempest-SnapshotsActionsTest-988724043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.c9614b82-9180-4269-8fcd-73afe4d87ad4" returned: 0 in 0.713s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:31 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-c73c598d-4d17-4ff8-ad41-92d7c5d55a4c tempest-SnapshotsActionsTest-988724043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86984) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:45:32 devstack cinder-volume[86984]: INFO cinder.volume.manager [req-18987d85-50ea-45da-ba03-3a6ef87155fc req-01815d5e-071f-4079-92fa-ac0f3d8a7c2b tempest-AttachVolumeTestJSON-1176057342 None] Terminate volume connection completed successfully. Sep 25 11:45:32 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [req-18987d85-50ea-45da-ba03-3a6ef87155fc req-01815d5e-071f-4079-92fa-ac0f3d8a7c2b tempest-AttachVolumeTestJSON-1176057342 None] Deleting attachment a2a49ac6-f6b8-4eda-b9fb-ce2306127e41. {{(pid=86984) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 11:45:32 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda8fe72-a85a-4357-8a4e-9291aa98a601]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:45:32 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-c73c598d-4d17-4ff8-ad41-92d7c5d55a4c tempest-SnapshotsActionsTest-988724043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.869bc753-e264-43e0-b081-073291d4cb34 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:32 devstack sudo[96791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.869bc753-e264-43e0-b081-073291d4cb34 Sep 25 11:45:32 devstack sudo[96791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:32 devstack sudo[96791]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:32 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-c73c598d-4d17-4ff8-ad41-92d7c5d55a4c tempest-SnapshotsActionsTest-988724043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.869bc753-e264-43e0-b081-073291d4cb34" returned: 0 in 0.853s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:32 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-c73c598d-4d17-4ff8-ad41-92d7c5d55a4c tempest-SnapshotsActionsTest-988724043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86984) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:45:32 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-c73c598d-4d17-4ff8-ad41-92d7c5d55a4c tempest-SnapshotsActionsTest-988724043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.c9614b82-9180-4269-8fcd-73afe4d87ad4 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:33 devstack sudo[96803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.c9614b82-9180-4269-8fcd-73afe4d87ad4 Sep 25 11:45:33 devstack sudo[96803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:33 devstack sudo[96803]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:33 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-c73c598d-4d17-4ff8-ad41-92d7c5d55a4c tempest-SnapshotsActionsTest-988724043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.c9614b82-9180-4269-8fcd-73afe4d87ad4" returned: 0 in 0.711s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:33 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-c73c598d-4d17-4ff8-ad41-92d7c5d55a4c tempest-SnapshotsActionsTest-988724043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.c9614b82-9180-4269-8fcd-73afe4d87ad4 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:33 devstack sudo[96809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.c9614b82-9180-4269-8fcd-73afe4d87ad4 Sep 25 11:45:33 devstack sudo[96809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:34 devstack sudo[96809]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:34 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-c73c598d-4d17-4ff8-ad41-92d7c5d55a4c tempest-SnapshotsActionsTest-988724043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.c9614b82-9180-4269-8fcd-73afe4d87ad4" returned: 0 in 0.595s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:34 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-c73c598d-4d17-4ff8-ad41-92d7c5d55a4c tempest-SnapshotsActionsTest-988724043 None] Lock "cinder-quobyte-c9614b82-9180-4269-8fcd-73afe4d87ad4" released by "_delete_snapshot" :: held 3.264s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:45:34 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-c73c598d-4d17-4ff8-ad41-92d7c5d55a4c tempest-SnapshotsActionsTest-988724043 None] Lock "cinder-quobyte-a2e3eb39-980e-4e9e-8cb9-13355ff763c9" released by "delete_snapshot" :: held 3.336s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:45:34 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-c73c598d-4d17-4ff8-ad41-92d7c5d55a4c tempest-SnapshotsActionsTest-988724043 None] Created reservations ['bd514e51-dd39-4be5-9d5d-d04798984dc9', '76ade304-88f2-49bf-ab84-69d627303dfc', '8669cc89-2a2b-4680-bb62-8924e2452112', 'f7ad2de0-1dc8-458f-9ed2-1959ace243ee'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:45:34 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-c73c598d-4d17-4ff8-ad41-92d7c5d55a4c tempest-SnapshotsActionsTest-988724043 None] Delete snapshot completed successfully. Sep 25 11:45:34 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-c73c598d-4d17-4ff8-ad41-92d7c5d55a4c tempest-SnapshotsActionsTest-988724043 None] Lock "cinder-c9614b82-9180-4269-8fcd-73afe4d87ad4-delete_snapshot" released by "delete_snapshot" :: held 3.666s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:45:36 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f64f1a17-c6da-4e96-95e2-339245dd0104 tempest-SnapshotsActionsTest-1803776119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:45:36 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f64f1a17-c6da-4e96-95e2-339245dd0104 tempest-SnapshotsActionsTest-1803776119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:45:36 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-f64f1a17-c6da-4e96-95e2-339245dd0104 tempest-SnapshotsActionsTest-1803776119 None] Creating offline snapshot 370b181c-fb53-4048-9c6e-05d82a3d0ec0 of volume a2e3eb39-980e-4e9e-8cb9-13355ff763c9 {{(pid=86984) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:45:36 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87c5125-8ca2-4405-bf74-7fdd0fef724a]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:45:36 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f64f1a17-c6da-4e96-95e2-339245dd0104 tempest-SnapshotsActionsTest-1803776119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.869bc753-e264-43e0-b081-073291d4cb34 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:36 devstack sudo[96837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.869bc753-e264-43e0-b081-073291d4cb34 Sep 25 11:45:36 devstack sudo[96837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:36 devstack sudo[96837]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:36 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f64f1a17-c6da-4e96-95e2-339245dd0104 tempest-SnapshotsActionsTest-1803776119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.869bc753-e264-43e0-b081-073291d4cb34" returned: 0 in 0.709s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:36 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-f64f1a17-c6da-4e96-95e2-339245dd0104 tempest-SnapshotsActionsTest-1803776119 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86984) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:45:36 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f64f1a17-c6da-4e96-95e2-339245dd0104 tempest-SnapshotsActionsTest-1803776119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.869bc753-e264-43e0-b081-073291d4cb34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.370b181c-fb53-4048-9c6e-05d82a3d0ec0 1G {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:36 devstack sudo[96845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.869bc753-e264-43e0-b081-073291d4cb34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.370b181c-fb53-4048-9c6e-05d82a3d0ec0 1G Sep 25 11:45:36 devstack sudo[96845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:37 devstack sudo[96845]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:37 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f64f1a17-c6da-4e96-95e2-339245dd0104 tempest-SnapshotsActionsTest-1803776119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.869bc753-e264-43e0-b081-073291d4cb34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.370b181c-fb53-4048-9c6e-05d82a3d0ec0 1G" returned: 0 in 0.858s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:37 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f64f1a17-c6da-4e96-95e2-339245dd0104 tempest-SnapshotsActionsTest-1803776119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.869bc753-e264-43e0-b081-073291d4cb34 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.370b181c-fb53-4048-9c6e-05d82a3d0ec0 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:37 devstack sudo[96852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.869bc753-e264-43e0-b081-073291d4cb34 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.370b181c-fb53-4048-9c6e-05d82a3d0ec0 Sep 25 11:45:37 devstack sudo[96852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:38 devstack sudo[96852]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f64f1a17-c6da-4e96-95e2-339245dd0104 tempest-SnapshotsActionsTest-1803776119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.869bc753-e264-43e0-b081-073291d4cb34 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.370b181c-fb53-4048-9c6e-05d82a3d0ec0" returned: 0 in 0.459s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:38 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-f64f1a17-c6da-4e96-95e2-339245dd0104 tempest-SnapshotsActionsTest-1803776119 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.370b181c-fb53-4048-9c6e-05d82a3d0ec0 is being set with open permissions: ugo+rw Sep 25 11:45:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f64f1a17-c6da-4e96-95e2-339245dd0104 tempest-SnapshotsActionsTest-1803776119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.370b181c-fb53-4048-9c6e-05d82a3d0ec0 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:38 devstack sudo[96857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.370b181c-fb53-4048-9c6e-05d82a3d0ec0 Sep 25 11:45:38 devstack sudo[96857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:38 devstack cinder-volume[86984]: DEBUG oslo_service.periodic_task [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:45:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:45:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:45:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:45:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:45:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:45:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:38 devstack sudo[96867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:45:38 devstack sudo[96857]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:38 devstack sudo[96867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f64f1a17-c6da-4e96-95e2-339245dd0104 tempest-SnapshotsActionsTest-1803776119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.370b181c-fb53-4048-9c6e-05d82a3d0ec0" returned: 0 in 0.545s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f64f1a17-c6da-4e96-95e2-339245dd0104 tempest-SnapshotsActionsTest-1803776119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.758s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:45:38 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-f64f1a17-c6da-4e96-95e2-339245dd0104 tempest-SnapshotsActionsTest-1803776119 None] Create snapshot completed successfully Sep 25 11:45:39 devstack sudo[96867]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.467s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:39 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:45:39 devstack cinder-volume[86984]: DEBUG oslo_service.periodic_task [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running periodic task VolumeManager._thread_info {{(pid=86984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:45:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] thread count: 28 {{(pid=86984) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 11:45:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] thread info: [<_MainThread(MainThread, started 132046492332160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86984) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 11:45:39 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e0e5fce2-f668-4170-808a-5dfde12ff2a5 tempest-AttachVolumeTestJSON-1176057342 None] Acquiring lock "cinder-976e9aac-60a3-4dc4-8976-0d6db6d84352-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:45:39 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e0e5fce2-f668-4170-808a-5dfde12ff2a5 tempest-AttachVolumeTestJSON-1176057342 None] Lock "cinder-976e9aac-60a3-4dc4-8976-0d6db6d84352-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:45:39 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e0e5fce2-f668-4170-808a-5dfde12ff2a5 tempest-AttachVolumeTestJSON-1176057342 None] Acquiring lock "cinder-quobyte-976e9aac-60a3-4dc4-8976-0d6db6d84352" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:45:39 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f9741965-d8a1-4094-88f4-973d91afe9a2 tempest-SnapshotsActionsTest-988724043 None] Acquiring lock "cinder-370b181c-fb53-4048-9c6e-05d82a3d0ec0-delete_snapshot" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:45:39 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e0e5fce2-f668-4170-808a-5dfde12ff2a5 tempest-AttachVolumeTestJSON-1176057342 None] Lock "cinder-quobyte-976e9aac-60a3-4dc4-8976-0d6db6d84352" acquired by "delete_volume" :: waited 0.030s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:45:39 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f9741965-d8a1-4094-88f4-973d91afe9a2 tempest-SnapshotsActionsTest-988724043 None] Lock "cinder-370b181c-fb53-4048-9c6e-05d82a3d0ec0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.059s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:45:39 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f9741965-d8a1-4094-88f4-973d91afe9a2 tempest-SnapshotsActionsTest-988724043 None] Acquiring lock "cinder-quobyte-a2e3eb39-980e-4e9e-8cb9-13355ff763c9" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:45:39 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[71dd521e-a6fc-4ebe-a84c-a46d0fe5606b]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:45:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e0e5fce2-f668-4170-808a-5dfde12ff2a5 tempest-AttachVolumeTestJSON-1176057342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-976e9aac-60a3-4dc4-8976-0d6db6d84352 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:39 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f9741965-d8a1-4094-88f4-973d91afe9a2 tempest-SnapshotsActionsTest-988724043 None] Lock "cinder-quobyte-a2e3eb39-980e-4e9e-8cb9-13355ff763c9" acquired by "delete_snapshot" :: waited 0.067s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:45:39 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f9741965-d8a1-4094-88f4-973d91afe9a2 tempest-SnapshotsActionsTest-988724043 None] Acquiring lock "cinder-quobyte-370b181c-fb53-4048-9c6e-05d82a3d0ec0" by "_delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:45:39 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f9741965-d8a1-4094-88f4-973d91afe9a2 tempest-SnapshotsActionsTest-988724043 None] Lock "cinder-quobyte-370b181c-fb53-4048-9c6e-05d82a3d0ec0" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:45:39 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-f9741965-d8a1-4094-88f4-973d91afe9a2 tempest-SnapshotsActionsTest-988724043 None] Deleting offline snapshot 370b181c-fb53-4048-9c6e-05d82a3d0ec0 of volume a2e3eb39-980e-4e9e-8cb9-13355ff763c9 {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:45:39 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-f9741965-d8a1-4094-88f4-973d91afe9a2 tempest-SnapshotsActionsTest-988724043 None] snapshot_file for this snap is: volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.370b181c-fb53-4048-9c6e-05d82a3d0ec0 {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:45:39 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd30f29f-77ce-476f-b6bb-3988759f7714]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:45:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f9741965-d8a1-4094-88f4-973d91afe9a2 tempest-SnapshotsActionsTest-988724043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.370b181c-fb53-4048-9c6e-05d82a3d0ec0 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:39 devstack sudo[96870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-976e9aac-60a3-4dc4-8976-0d6db6d84352 Sep 25 11:45:39 devstack sudo[96870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:39 devstack sudo[96871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.370b181c-fb53-4048-9c6e-05d82a3d0ec0 Sep 25 11:45:39 devstack sudo[96871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:40 devstack sudo[96870]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:40 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e0e5fce2-f668-4170-808a-5dfde12ff2a5 tempest-AttachVolumeTestJSON-1176057342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-976e9aac-60a3-4dc4-8976-0d6db6d84352" returned: 0 in 0.576s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:40 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e0e5fce2-f668-4170-808a-5dfde12ff2a5 tempest-AttachVolumeTestJSON-1176057342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-976e9aac-60a3-4dc4-8976-0d6db6d84352 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:40 devstack sudo[96880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-976e9aac-60a3-4dc4-8976-0d6db6d84352 Sep 25 11:45:40 devstack sudo[96880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:40 devstack sudo[96871]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:40 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f9741965-d8a1-4094-88f4-973d91afe9a2 tempest-SnapshotsActionsTest-988724043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.370b181c-fb53-4048-9c6e-05d82a3d0ec0" returned: 0 in 0.524s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:40 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-f9741965-d8a1-4094-88f4-973d91afe9a2 tempest-SnapshotsActionsTest-988724043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86984) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:45:40 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24f3eb6-dfed-42e1-9909-23d7f057a505]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:45:40 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f9741965-d8a1-4094-88f4-973d91afe9a2 tempest-SnapshotsActionsTest-988724043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.869bc753-e264-43e0-b081-073291d4cb34 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:40 devstack sudo[96882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.869bc753-e264-43e0-b081-073291d4cb34 Sep 25 11:45:40 devstack sudo[96882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:40 devstack sudo[96880]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:40 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e0e5fce2-f668-4170-808a-5dfde12ff2a5 tempest-AttachVolumeTestJSON-1176057342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-976e9aac-60a3-4dc4-8976-0d6db6d84352" returned: 0 in 0.338s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:40 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e0e5fce2-f668-4170-808a-5dfde12ff2a5 tempest-AttachVolumeTestJSON-1176057342 None] Lock "cinder-quobyte-976e9aac-60a3-4dc4-8976-0d6db6d84352" released by "delete_volume" :: held 1.043s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:45:40 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-e0e5fce2-f668-4170-808a-5dfde12ff2a5 tempest-AttachVolumeTestJSON-1176057342 None] Created reservations ['586fd561-d3dc-432e-b2b3-5c4cc01e1bab', '05836f21-f45b-4848-97b4-48ff580b562a', '7667169b-8168-49c0-9bfa-a490c8eb2527', '01f1f6ed-15af-4a30-b6fd-27912a5a46fd'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:45:40 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-e0e5fce2-f668-4170-808a-5dfde12ff2a5 tempest-AttachVolumeTestJSON-1176057342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:45:40 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-e0e5fce2-f668-4170-808a-5dfde12ff2a5 tempest-AttachVolumeTestJSON-1176057342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:45:40 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-e0e5fce2-f668-4170-808a-5dfde12ff2a5 tempest-AttachVolumeTestJSON-1176057342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:45:40 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-e0e5fce2-f668-4170-808a-5dfde12ff2a5 tempest-AttachVolumeTestJSON-1176057342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:45:40 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-e0e5fce2-f668-4170-808a-5dfde12ff2a5 tempest-AttachVolumeTestJSON-1176057342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:45:40 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e0e5fce2-f668-4170-808a-5dfde12ff2a5 tempest-AttachVolumeTestJSON-1176057342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:40 devstack sudo[96882]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:40 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f9741965-d8a1-4094-88f4-973d91afe9a2 tempest-SnapshotsActionsTest-988724043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.869bc753-e264-43e0-b081-073291d4cb34" returned: 0 in 0.554s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:40 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-f9741965-d8a1-4094-88f4-973d91afe9a2 tempest-SnapshotsActionsTest-988724043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86984) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:45:40 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f9741965-d8a1-4094-88f4-973d91afe9a2 tempest-SnapshotsActionsTest-988724043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.370b181c-fb53-4048-9c6e-05d82a3d0ec0 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:40 devstack sudo[96889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:45:40 devstack sudo[96889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:40 devstack sudo[96890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.370b181c-fb53-4048-9c6e-05d82a3d0ec0 Sep 25 11:45:40 devstack sudo[96890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:41 devstack sudo[96889]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e0e5fce2-f668-4170-808a-5dfde12ff2a5 tempest-AttachVolumeTestJSON-1176057342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.443s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:41 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-e0e5fce2-f668-4170-808a-5dfde12ff2a5 tempest-AttachVolumeTestJSON-1176057342 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:45:41 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-e0e5fce2-f668-4170-808a-5dfde12ff2a5 tempest-AttachVolumeTestJSON-1176057342 None] Deleted volume successfully. Sep 25 11:45:41 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e0e5fce2-f668-4170-808a-5dfde12ff2a5 tempest-AttachVolumeTestJSON-1176057342 None] Lock "cinder-976e9aac-60a3-4dc4-8976-0d6db6d84352-delete_volume" released by "delete_volume" :: held 1.912s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:45:41 devstack sudo[96890]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f9741965-d8a1-4094-88f4-973d91afe9a2 tempest-SnapshotsActionsTest-988724043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.370b181c-fb53-4048-9c6e-05d82a3d0ec0" returned: 0 in 0.650s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f9741965-d8a1-4094-88f4-973d91afe9a2 tempest-SnapshotsActionsTest-988724043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.370b181c-fb53-4048-9c6e-05d82a3d0ec0 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:41 devstack sudo[96898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.370b181c-fb53-4048-9c6e-05d82a3d0ec0 Sep 25 11:45:41 devstack sudo[96898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:41 devstack sudo[96898]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f9741965-d8a1-4094-88f4-973d91afe9a2 tempest-SnapshotsActionsTest-988724043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.370b181c-fb53-4048-9c6e-05d82a3d0ec0" returned: 0 in 0.404s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:42 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f01e8595-bf6f-4f4d-8916-b978d85ca40d tempest-AttachVolumeTestJSON-1176057342 None] Acquiring lock "cinder-714adf2f-8eef-4812-aa55-c2178d3c4ce0-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:45:42 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f9741965-d8a1-4094-88f4-973d91afe9a2 tempest-SnapshotsActionsTest-988724043 None] Lock "cinder-quobyte-370b181c-fb53-4048-9c6e-05d82a3d0ec0" released by "_delete_snapshot" :: held 2.370s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:45:42 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f01e8595-bf6f-4f4d-8916-b978d85ca40d tempest-AttachVolumeTestJSON-1176057342 None] Lock "cinder-714adf2f-8eef-4812-aa55-c2178d3c4ce0-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:45:42 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f9741965-d8a1-4094-88f4-973d91afe9a2 tempest-SnapshotsActionsTest-988724043 None] Lock "cinder-quobyte-a2e3eb39-980e-4e9e-8cb9-13355ff763c9" released by "delete_snapshot" :: held 2.457s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:45:42 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f01e8595-bf6f-4f4d-8916-b978d85ca40d tempest-AttachVolumeTestJSON-1176057342 None] Acquiring lock "cinder-quobyte-714adf2f-8eef-4812-aa55-c2178d3c4ce0" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:45:42 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f01e8595-bf6f-4f4d-8916-b978d85ca40d tempest-AttachVolumeTestJSON-1176057342 None] Lock "cinder-quobyte-714adf2f-8eef-4812-aa55-c2178d3c4ce0" acquired by "delete_volume" :: waited 0.033s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:45:42 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca1ec8a5-7455-485e-900c-84ff994f5f91]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:45:42 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f01e8595-bf6f-4f4d-8916-b978d85ca40d tempest-AttachVolumeTestJSON-1176057342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-714adf2f-8eef-4812-aa55-c2178d3c4ce0 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:42 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-f9741965-d8a1-4094-88f4-973d91afe9a2 tempest-SnapshotsActionsTest-988724043 None] Created reservations ['1bb777ef-4f35-4e69-abfa-d9bcbd0069d3', '7e8347f9-899f-48f2-bc7f-ae125d998ddf', 'a4e8fc07-0d58-4714-9d29-0447ab77245b', '662fbc33-c43a-4ede-ac86-cc336a25e570'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:45:42 devstack sudo[96901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-714adf2f-8eef-4812-aa55-c2178d3c4ce0 Sep 25 11:45:42 devstack sudo[96901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:42 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-f9741965-d8a1-4094-88f4-973d91afe9a2 tempest-SnapshotsActionsTest-988724043 None] Delete snapshot completed successfully. Sep 25 11:45:42 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f9741965-d8a1-4094-88f4-973d91afe9a2 tempest-SnapshotsActionsTest-988724043 None] Lock "cinder-370b181c-fb53-4048-9c6e-05d82a3d0ec0-delete_snapshot" released by "delete_snapshot" :: held 2.909s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:45:42 devstack sudo[96901]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:42 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f01e8595-bf6f-4f4d-8916-b978d85ca40d tempest-AttachVolumeTestJSON-1176057342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-714adf2f-8eef-4812-aa55-c2178d3c4ce0" returned: 0 in 0.690s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:42 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f01e8595-bf6f-4f4d-8916-b978d85ca40d tempest-AttachVolumeTestJSON-1176057342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-714adf2f-8eef-4812-aa55-c2178d3c4ce0 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:42 devstack sudo[96941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-714adf2f-8eef-4812-aa55-c2178d3c4ce0 Sep 25 11:45:42 devstack sudo[96941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:43 devstack sudo[96941]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f01e8595-bf6f-4f4d-8916-b978d85ca40d tempest-AttachVolumeTestJSON-1176057342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-714adf2f-8eef-4812-aa55-c2178d3c4ce0" returned: 0 in 0.555s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:43 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f01e8595-bf6f-4f4d-8916-b978d85ca40d tempest-AttachVolumeTestJSON-1176057342 None] Lock "cinder-quobyte-714adf2f-8eef-4812-aa55-c2178d3c4ce0" released by "delete_volume" :: held 1.322s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:45:43 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-f01e8595-bf6f-4f4d-8916-b978d85ca40d tempest-AttachVolumeTestJSON-1176057342 None] Created reservations ['6e6e6db2-1013-406d-86f7-2e0df0fcf427', 'fc4dc062-b333-4294-b31f-f605a127987a', '39ec3491-bcaf-41df-bb58-8a60c0fbc996', '2fefb9bd-58bd-4213-94f9-d037d05b17f5'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:45:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f01e8595-bf6f-4f4d-8916-b978d85ca40d tempest-AttachVolumeTestJSON-1176057342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:45:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f01e8595-bf6f-4f4d-8916-b978d85ca40d tempest-AttachVolumeTestJSON-1176057342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:45:43 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-f01e8595-bf6f-4f4d-8916-b978d85ca40d tempest-AttachVolumeTestJSON-1176057342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:45:43 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-f01e8595-bf6f-4f4d-8916-b978d85ca40d tempest-AttachVolumeTestJSON-1176057342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:45:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f01e8595-bf6f-4f4d-8916-b978d85ca40d tempest-AttachVolumeTestJSON-1176057342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.045s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:45:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f01e8595-bf6f-4f4d-8916-b978d85ca40d tempest-AttachVolumeTestJSON-1176057342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:43 devstack sudo[96946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:45:43 devstack sudo[96946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:43 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-95d8cc2a-ed89-4c74-aeaa-e51004df4c62 tempest-SnapshotsActionsTest-1803776119 None] Acquiring lock "cinder-869bc753-e264-43e0-b081-073291d4cb34-delete_snapshot" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:45:43 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-95d8cc2a-ed89-4c74-aeaa-e51004df4c62 tempest-SnapshotsActionsTest-1803776119 None] Lock "cinder-869bc753-e264-43e0-b081-073291d4cb34-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:45:43 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-95d8cc2a-ed89-4c74-aeaa-e51004df4c62 tempest-SnapshotsActionsTest-1803776119 None] Acquiring lock "cinder-quobyte-a2e3eb39-980e-4e9e-8cb9-13355ff763c9" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:45:43 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-95d8cc2a-ed89-4c74-aeaa-e51004df4c62 tempest-SnapshotsActionsTest-1803776119 None] Lock "cinder-quobyte-a2e3eb39-980e-4e9e-8cb9-13355ff763c9" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:45:43 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-95d8cc2a-ed89-4c74-aeaa-e51004df4c62 tempest-SnapshotsActionsTest-1803776119 None] Acquiring lock "cinder-quobyte-869bc753-e264-43e0-b081-073291d4cb34" by "_delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:45:44 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-95d8cc2a-ed89-4c74-aeaa-e51004df4c62 tempest-SnapshotsActionsTest-1803776119 None] Lock "cinder-quobyte-869bc753-e264-43e0-b081-073291d4cb34" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:45:44 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-95d8cc2a-ed89-4c74-aeaa-e51004df4c62 tempest-SnapshotsActionsTest-1803776119 None] Deleting offline snapshot 869bc753-e264-43e0-b081-073291d4cb34 of volume a2e3eb39-980e-4e9e-8cb9-13355ff763c9 {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:45:44 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-95d8cc2a-ed89-4c74-aeaa-e51004df4c62 tempest-SnapshotsActionsTest-1803776119 None] snapshot_file for this snap is: volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.869bc753-e264-43e0-b081-073291d4cb34 {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:45:44 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[b129b1b5-19d9-41d2-9e9b-9d69eaf7104a]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:45:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-95d8cc2a-ed89-4c74-aeaa-e51004df4c62 tempest-SnapshotsActionsTest-1803776119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.869bc753-e264-43e0-b081-073291d4cb34 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:44 devstack sudo[96946]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f01e8595-bf6f-4f4d-8916-b978d85ca40d tempest-AttachVolumeTestJSON-1176057342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.541s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:44 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-f01e8595-bf6f-4f4d-8916-b978d85ca40d tempest-AttachVolumeTestJSON-1176057342 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:45:44 devstack sudo[96948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.869bc753-e264-43e0-b081-073291d4cb34 Sep 25 11:45:44 devstack sudo[96948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:44 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-f01e8595-bf6f-4f4d-8916-b978d85ca40d tempest-AttachVolumeTestJSON-1176057342 None] Deleted volume successfully. Sep 25 11:45:44 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f01e8595-bf6f-4f4d-8916-b978d85ca40d tempest-AttachVolumeTestJSON-1176057342 None] Lock "cinder-714adf2f-8eef-4812-aa55-c2178d3c4ce0-delete_volume" released by "delete_volume" :: held 2.345s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:45:44 devstack sudo[96948]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-95d8cc2a-ed89-4c74-aeaa-e51004df4c62 tempest-SnapshotsActionsTest-1803776119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.869bc753-e264-43e0-b081-073291d4cb34" returned: 0 in 0.583s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:44 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-95d8cc2a-ed89-4c74-aeaa-e51004df4c62 tempest-SnapshotsActionsTest-1803776119 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86984) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:45:44 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aee0a9f-209b-46e5-8c9f-076b054e2b96]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:45:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-95d8cc2a-ed89-4c74-aeaa-e51004df4c62 tempest-SnapshotsActionsTest-1803776119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:44 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-555f7c94-c20d-4faf-afdd-2d4aba80a7be tempest-AttachVolumeTestJSON-1176057342 None] Acquiring lock "cinder-7481f990-6a6c-479a-9e3a-dba39ea46687-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:45:44 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-555f7c94-c20d-4faf-afdd-2d4aba80a7be tempest-AttachVolumeTestJSON-1176057342 None] Lock "cinder-7481f990-6a6c-479a-9e3a-dba39ea46687-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:45:44 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-555f7c94-c20d-4faf-afdd-2d4aba80a7be tempest-AttachVolumeTestJSON-1176057342 None] Acquiring lock "cinder-quobyte-7481f990-6a6c-479a-9e3a-dba39ea46687" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:45:44 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-555f7c94-c20d-4faf-afdd-2d4aba80a7be tempest-AttachVolumeTestJSON-1176057342 None] Lock "cinder-quobyte-7481f990-6a6c-479a-9e3a-dba39ea46687" acquired by "delete_volume" :: waited 0.020s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:45:44 devstack sudo[96954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9 Sep 25 11:45:44 devstack sudo[96954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:45 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb28756-4ccc-4f49-83ee-a8ca38731941]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:45:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-555f7c94-c20d-4faf-afdd-2d4aba80a7be tempest-AttachVolumeTestJSON-1176057342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7481f990-6a6c-479a-9e3a-dba39ea46687 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:45 devstack sudo[96956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7481f990-6a6c-479a-9e3a-dba39ea46687 Sep 25 11:45:45 devstack sudo[96956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:45 devstack sudo[96954]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-95d8cc2a-ed89-4c74-aeaa-e51004df4c62 tempest-SnapshotsActionsTest-1803776119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9" returned: 0 in 0.640s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-95d8cc2a-ed89-4c74-aeaa-e51004df4c62 tempest-SnapshotsActionsTest-1803776119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.869bc753-e264-43e0-b081-073291d4cb34 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:45 devstack sudo[96963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.869bc753-e264-43e0-b081-073291d4cb34 Sep 25 11:45:45 devstack sudo[96963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:45 devstack sudo[96956]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-555f7c94-c20d-4faf-afdd-2d4aba80a7be tempest-AttachVolumeTestJSON-1176057342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7481f990-6a6c-479a-9e3a-dba39ea46687" returned: 0 in 0.605s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-555f7c94-c20d-4faf-afdd-2d4aba80a7be tempest-AttachVolumeTestJSON-1176057342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7481f990-6a6c-479a-9e3a-dba39ea46687 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:45 devstack sudo[96969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7481f990-6a6c-479a-9e3a-dba39ea46687 Sep 25 11:45:45 devstack sudo[96969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:45 devstack sudo[96963]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-95d8cc2a-ed89-4c74-aeaa-e51004df4c62 tempest-SnapshotsActionsTest-1803776119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.869bc753-e264-43e0-b081-073291d4cb34" returned: 0 in 0.491s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-95d8cc2a-ed89-4c74-aeaa-e51004df4c62 tempest-SnapshotsActionsTest-1803776119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.869bc753-e264-43e0-b081-073291d4cb34 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:45 devstack sudo[96975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.869bc753-e264-43e0-b081-073291d4cb34 Sep 25 11:45:45 devstack sudo[96975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:46 devstack sudo[96969]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-555f7c94-c20d-4faf-afdd-2d4aba80a7be tempest-AttachVolumeTestJSON-1176057342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7481f990-6a6c-479a-9e3a-dba39ea46687" returned: 0 in 0.524s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:46 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-555f7c94-c20d-4faf-afdd-2d4aba80a7be tempest-AttachVolumeTestJSON-1176057342 None] Lock "cinder-quobyte-7481f990-6a6c-479a-9e3a-dba39ea46687" released by "delete_volume" :: held 1.205s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:45:46 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-555f7c94-c20d-4faf-afdd-2d4aba80a7be tempest-AttachVolumeTestJSON-1176057342 None] Created reservations ['ea4a1cd4-996e-4139-b7ef-2f200fdfd688', '048f29fe-be1b-47ae-8c89-1ec7fd2876cc', '1a539f14-4f10-4757-8c8a-abcab111e28b', 'f9158af1-62e5-4402-bc1c-d9982275136d'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:45:46 devstack sudo[96975]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-95d8cc2a-ed89-4c74-aeaa-e51004df4c62 tempest-SnapshotsActionsTest-1803776119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9.869bc753-e264-43e0-b081-073291d4cb34" returned: 0 in 0.386s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:46 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-95d8cc2a-ed89-4c74-aeaa-e51004df4c62 tempest-SnapshotsActionsTest-1803776119 None] Lock "cinder-quobyte-869bc753-e264-43e0-b081-073291d4cb34" released by "_delete_snapshot" :: held 2.334s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:45:46 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-95d8cc2a-ed89-4c74-aeaa-e51004df4c62 tempest-SnapshotsActionsTest-1803776119 None] Lock "cinder-quobyte-a2e3eb39-980e-4e9e-8cb9-13355ff763c9" released by "delete_snapshot" :: held 2.394s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:45:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-555f7c94-c20d-4faf-afdd-2d4aba80a7be tempest-AttachVolumeTestJSON-1176057342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:45:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-555f7c94-c20d-4faf-afdd-2d4aba80a7be tempest-AttachVolumeTestJSON-1176057342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:45:46 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-555f7c94-c20d-4faf-afdd-2d4aba80a7be tempest-AttachVolumeTestJSON-1176057342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:45:46 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-555f7c94-c20d-4faf-afdd-2d4aba80a7be tempest-AttachVolumeTestJSON-1176057342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:45:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-555f7c94-c20d-4faf-afdd-2d4aba80a7be tempest-AttachVolumeTestJSON-1176057342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:45:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-555f7c94-c20d-4faf-afdd-2d4aba80a7be tempest-AttachVolumeTestJSON-1176057342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:46 devstack sudo[96979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:45:46 devstack sudo[96979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:46 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-95d8cc2a-ed89-4c74-aeaa-e51004df4c62 tempest-SnapshotsActionsTest-1803776119 None] Created reservations ['02066b63-e4c8-44ec-b6fb-7606f0cc1783', '819cb3d6-544e-4609-9c6f-e2241bd6b4f2', '929c1d9e-48bd-4f58-b881-90082d255ad0', '13c058d6-0aed-4e6d-8795-9a1640e5beec'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:45:46 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-95d8cc2a-ed89-4c74-aeaa-e51004df4c62 tempest-SnapshotsActionsTest-1803776119 None] Delete snapshot completed successfully. Sep 25 11:45:46 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-95d8cc2a-ed89-4c74-aeaa-e51004df4c62 tempest-SnapshotsActionsTest-1803776119 None] Lock "cinder-869bc753-e264-43e0-b081-073291d4cb34-delete_snapshot" released by "delete_snapshot" :: held 2.713s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:45:46 devstack sudo[96979]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-555f7c94-c20d-4faf-afdd-2d4aba80a7be tempest-AttachVolumeTestJSON-1176057342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.384s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:46 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-555f7c94-c20d-4faf-afdd-2d4aba80a7be tempest-AttachVolumeTestJSON-1176057342 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:45:46 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-555f7c94-c20d-4faf-afdd-2d4aba80a7be tempest-AttachVolumeTestJSON-1176057342 None] Deleted volume successfully. Sep 25 11:45:46 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-555f7c94-c20d-4faf-afdd-2d4aba80a7be tempest-AttachVolumeTestJSON-1176057342 None] Lock "cinder-7481f990-6a6c-479a-9e3a-dba39ea46687-delete_volume" released by "delete_volume" :: held 1.978s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:45:47 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-c9ca2ab9-6ef8-49b2-8d39-725eb9df0152 tempest-SnapshotsActionsTest-1803776119 None] Acquiring lock "cinder-a2e3eb39-980e-4e9e-8cb9-13355ff763c9-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:45:47 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-c9ca2ab9-6ef8-49b2-8d39-725eb9df0152 tempest-SnapshotsActionsTest-1803776119 None] Lock "cinder-a2e3eb39-980e-4e9e-8cb9-13355ff763c9-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:45:47 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-c9ca2ab9-6ef8-49b2-8d39-725eb9df0152 tempest-SnapshotsActionsTest-1803776119 None] Acquiring lock "cinder-quobyte-a2e3eb39-980e-4e9e-8cb9-13355ff763c9" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:45:47 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-c9ca2ab9-6ef8-49b2-8d39-725eb9df0152 tempest-SnapshotsActionsTest-1803776119 None] Lock "cinder-quobyte-a2e3eb39-980e-4e9e-8cb9-13355ff763c9" acquired by "delete_volume" :: waited 0.022s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:45:47 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb24fb95-2d0d-4950-8f3e-f9b279710a8b]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:45:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-c9ca2ab9-6ef8-49b2-8d39-725eb9df0152 tempest-SnapshotsActionsTest-1803776119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:47 devstack sudo[96982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9 Sep 25 11:45:47 devstack sudo[96982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:48 devstack sudo[96982]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-c9ca2ab9-6ef8-49b2-8d39-725eb9df0152 tempest-SnapshotsActionsTest-1803776119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9" returned: 0 in 0.536s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-c9ca2ab9-6ef8-49b2-8d39-725eb9df0152 tempest-SnapshotsActionsTest-1803776119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:48 devstack sudo[96987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9 Sep 25 11:45:48 devstack sudo[96987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:48 devstack sudo[96987]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-c9ca2ab9-6ef8-49b2-8d39-725eb9df0152 tempest-SnapshotsActionsTest-1803776119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a2e3eb39-980e-4e9e-8cb9-13355ff763c9" returned: 0 in 0.390s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:48 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-c9ca2ab9-6ef8-49b2-8d39-725eb9df0152 tempest-SnapshotsActionsTest-1803776119 None] Lock "cinder-quobyte-a2e3eb39-980e-4e9e-8cb9-13355ff763c9" released by "delete_volume" :: held 1.060s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:45:48 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-c9ca2ab9-6ef8-49b2-8d39-725eb9df0152 tempest-SnapshotsActionsTest-1803776119 None] Created reservations ['5f9f10ad-d3d6-4aed-b0d8-5edc6bc7fe1c', 'f56db231-5f9d-44ab-9290-9ee0252db4f2', '4079c8a5-20fb-4651-87b7-9c709618bf32', 'cafc0f7a-9ffc-46eb-b43c-4d5f35e630ad'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:45:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-c9ca2ab9-6ef8-49b2-8d39-725eb9df0152 tempest-SnapshotsActionsTest-1803776119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:45:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-c9ca2ab9-6ef8-49b2-8d39-725eb9df0152 tempest-SnapshotsActionsTest-1803776119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:45:48 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-c9ca2ab9-6ef8-49b2-8d39-725eb9df0152 tempest-SnapshotsActionsTest-1803776119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:45:48 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-c9ca2ab9-6ef8-49b2-8d39-725eb9df0152 tempest-SnapshotsActionsTest-1803776119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:45:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-c9ca2ab9-6ef8-49b2-8d39-725eb9df0152 tempest-SnapshotsActionsTest-1803776119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:45:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-c9ca2ab9-6ef8-49b2-8d39-725eb9df0152 tempest-SnapshotsActionsTest-1803776119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:48 devstack sudo[96990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:45:48 devstack sudo[96990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:49 devstack sudo[96990]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-c9ca2ab9-6ef8-49b2-8d39-725eb9df0152 tempest-SnapshotsActionsTest-1803776119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.422s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:49 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-c9ca2ab9-6ef8-49b2-8d39-725eb9df0152 tempest-SnapshotsActionsTest-1803776119 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:45:49 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-c9ca2ab9-6ef8-49b2-8d39-725eb9df0152 tempest-SnapshotsActionsTest-1803776119 None] Deleted volume successfully. Sep 25 11:45:49 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-c9ca2ab9-6ef8-49b2-8d39-725eb9df0152 tempest-SnapshotsActionsTest-1803776119 None] Lock "cinder-a2e3eb39-980e-4e9e-8cb9-13355ff763c9-delete_volume" released by "delete_volume" :: held 1.902s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:45:50 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-18179b84-f2f7-472b-b598-e90422eef9ea tempest-VolumeQuotasNegativeTestJSON-1388523107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:45:50 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-18179b84-f2f7-472b-b598-e90422eef9ea tempest-VolumeQuotasNegativeTestJSON-1388523107 None] Flow 'volume_create_manager' (97516a88-2673-49a7-8f8d-e7c13c37dfe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:45:50 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-18179b84-f2f7-472b-b598-e90422eef9ea tempest-VolumeQuotasNegativeTestJSON-1388523107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffe14abf-03bd-4920-9c4e-da181b778689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:45:50 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-18179b84-f2f7-472b-b598-e90422eef9ea tempest-VolumeQuotasNegativeTestJSON-1388523107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffe14abf-03bd-4920-9c4e-da181b778689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:45:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-200618510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaae8f56-90c2-408e-b878-56f709145763,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='764e9905d90b48edad8a69ddb184b854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:45:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:45:50Z,use_quota=True,user_id='1d48c7535f594a6dadeac6161f5b97a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:45:50 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-18179b84-f2f7-472b-b598-e90422eef9ea tempest-VolumeQuotasNegativeTestJSON-1388523107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5127d390-17e3-43c7-8ae8-1023f365fa20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:45:50 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-18179b84-f2f7-472b-b598-e90422eef9ea tempest-VolumeQuotasNegativeTestJSON-1388523107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5127d390-17e3-43c7-8ae8-1023f365fa20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:45:50 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-18179b84-f2f7-472b-b598-e90422eef9ea tempest-VolumeQuotasNegativeTestJSON-1388523107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08a8d5f6-b41e-4942-afe7-10e6059c7698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:45:50 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-18179b84-f2f7-472b-b598-e90422eef9ea tempest-VolumeQuotasNegativeTestJSON-1388523107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08a8d5f6-b41e-4942-afe7-10e6059c7698) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aaae8f56-90c2-408e-b878-56f709145763', 'volume_name': 'volume-aaae8f56-90c2-408e-b878-56f709145763', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:45:50 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-18179b84-f2f7-472b-b598-e90422eef9ea tempest-VolumeQuotasNegativeTestJSON-1388523107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc5eb2a0-3e5a-40bb-a54c-56fff4e9d296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:45:50 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-18179b84-f2f7-472b-b598-e90422eef9ea tempest-VolumeQuotasNegativeTestJSON-1388523107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc5eb2a0-3e5a-40bb-a54c-56fff4e9d296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:45:50 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-18179b84-f2f7-472b-b598-e90422eef9ea tempest-VolumeQuotasNegativeTestJSON-1388523107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a61b549e-468d-4b29-8dcb-76d753064a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:45:50 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-18179b84-f2f7-472b-b598-e90422eef9ea tempest-VolumeQuotasNegativeTestJSON-1388523107 None] Volume aaae8f56-90c2-408e-b878-56f709145763: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aaae8f56-90c2-408e-b878-56f709145763', 'volume_size': 1} Sep 25 11:45:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-18179b84-f2f7-472b-b598-e90422eef9ea tempest-VolumeQuotasNegativeTestJSON-1388523107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:45:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-18179b84-f2f7-472b-b598-e90422eef9ea tempest-VolumeQuotasNegativeTestJSON-1388523107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:45:50 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-18179b84-f2f7-472b-b598-e90422eef9ea tempest-VolumeQuotasNegativeTestJSON-1388523107 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:45:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-200618510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaae8f56-90c2-408e-b878-56f709145763,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='764e9905d90b48edad8a69ddb184b854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:45:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:45:50Z,use_quota=True,user_id='1d48c7535f594a6dadeac6161f5b97a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:45:50 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-18179b84-f2f7-472b-b598-e90422eef9ea tempest-VolumeQuotasNegativeTestJSON-1388523107 None] Creating volume aaae8f56-90c2-408e-b878-56f709145763 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:45:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-18179b84-f2f7-472b-b598-e90422eef9ea tempest-VolumeQuotasNegativeTestJSON-1388523107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:45:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-18179b84-f2f7-472b-b598-e90422eef9ea tempest-VolumeQuotasNegativeTestJSON-1388523107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:45:50 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-18179b84-f2f7-472b-b598-e90422eef9ea tempest-VolumeQuotasNegativeTestJSON-1388523107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:45:50 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-18179b84-f2f7-472b-b598-e90422eef9ea tempest-VolumeQuotasNegativeTestJSON-1388523107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:45:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-18179b84-f2f7-472b-b598-e90422eef9ea tempest-VolumeQuotasNegativeTestJSON-1388523107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:45:50 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-18179b84-f2f7-472b-b598-e90422eef9ea tempest-VolumeQuotasNegativeTestJSON-1388523107 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:45:50 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-18179b84-f2f7-472b-b598-e90422eef9ea tempest-VolumeQuotasNegativeTestJSON-1388523107 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:45:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-18179b84-f2f7-472b-b598-e90422eef9ea tempest-VolumeQuotasNegativeTestJSON-1388523107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aaae8f56-90c2-408e-b878-56f709145763 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:50 devstack sudo[96994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aaae8f56-90c2-408e-b878-56f709145763 1073741824 Sep 25 11:45:50 devstack sudo[96994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:51 devstack sudo[96994]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-18179b84-f2f7-472b-b598-e90422eef9ea tempest-VolumeQuotasNegativeTestJSON-1388523107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aaae8f56-90c2-408e-b878-56f709145763 1073741824" returned: 0 in 0.752s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-18179b84-f2f7-472b-b598-e90422eef9ea tempest-VolumeQuotasNegativeTestJSON-1388523107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aaae8f56-90c2-408e-b878-56f709145763 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:51 devstack sudo[97000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aaae8f56-90c2-408e-b878-56f709145763 Sep 25 11:45:51 devstack sudo[97000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:51 devstack sudo[97000]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-18179b84-f2f7-472b-b598-e90422eef9ea tempest-VolumeQuotasNegativeTestJSON-1388523107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aaae8f56-90c2-408e-b878-56f709145763" returned: 0 in 0.384s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:51 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-18179b84-f2f7-472b-b598-e90422eef9ea tempest-VolumeQuotasNegativeTestJSON-1388523107 None] <== create_volume: return (1215ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:45:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-18179b84-f2f7-472b-b598-e90422eef9ea tempest-VolumeQuotasNegativeTestJSON-1388523107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.218s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:45:51 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-18179b84-f2f7-472b-b598-e90422eef9ea tempest-VolumeQuotasNegativeTestJSON-1388523107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a61b549e-468d-4b29-8dcb-76d753064a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aaae8f56-90c2-408e-b878-56f709145763', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:45:51 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-18179b84-f2f7-472b-b598-e90422eef9ea tempest-VolumeQuotasNegativeTestJSON-1388523107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19cb861c-a658-4329-8839-a817e25ca8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:45:51 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-18179b84-f2f7-472b-b598-e90422eef9ea tempest-VolumeQuotasNegativeTestJSON-1388523107 None] Volume volume-aaae8f56-90c2-408e-b878-56f709145763 (aaae8f56-90c2-408e-b878-56f709145763): created successfully Sep 25 11:45:51 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-18179b84-f2f7-472b-b598-e90422eef9ea tempest-VolumeQuotasNegativeTestJSON-1388523107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19cb861c-a658-4329-8839-a817e25ca8bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:45:51 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-18179b84-f2f7-472b-b598-e90422eef9ea tempest-VolumeQuotasNegativeTestJSON-1388523107 None] Flow 'volume_create_manager' (97516a88-2673-49a7-8f8d-e7c13c37dfe8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:45:51 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-18179b84-f2f7-472b-b598-e90422eef9ea tempest-VolumeQuotasNegativeTestJSON-1388523107 None] Created volume successfully. Sep 25 11:45:54 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-45ca859a-a81a-4451-87c6-69017e9a19f4 tempest-VolumeQuotasNegativeTestJSON-1388523107 None] Acquiring lock "cinder-aaae8f56-90c2-408e-b878-56f709145763-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:45:54 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-45ca859a-a81a-4451-87c6-69017e9a19f4 tempest-VolumeQuotasNegativeTestJSON-1388523107 None] Lock "cinder-aaae8f56-90c2-408e-b878-56f709145763-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:45:54 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-45ca859a-a81a-4451-87c6-69017e9a19f4 tempest-VolumeQuotasNegativeTestJSON-1388523107 None] Acquiring lock "cinder-quobyte-aaae8f56-90c2-408e-b878-56f709145763" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:45:54 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-45ca859a-a81a-4451-87c6-69017e9a19f4 tempest-VolumeQuotasNegativeTestJSON-1388523107 None] Lock "cinder-quobyte-aaae8f56-90c2-408e-b878-56f709145763" acquired by "delete_volume" :: waited 0.034s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:45:54 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5bc77e8-d0bd-44d6-932f-c46ff54d50ae]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:45:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-45ca859a-a81a-4451-87c6-69017e9a19f4 tempest-VolumeQuotasNegativeTestJSON-1388523107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aaae8f56-90c2-408e-b878-56f709145763 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:54 devstack sudo[97004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aaae8f56-90c2-408e-b878-56f709145763 Sep 25 11:45:54 devstack sudo[97004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:55 devstack sudo[97004]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-45ca859a-a81a-4451-87c6-69017e9a19f4 tempest-VolumeQuotasNegativeTestJSON-1388523107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aaae8f56-90c2-408e-b878-56f709145763" returned: 0 in 0.735s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-45ca859a-a81a-4451-87c6-69017e9a19f4 tempest-VolumeQuotasNegativeTestJSON-1388523107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aaae8f56-90c2-408e-b878-56f709145763 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:55 devstack sudo[97009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aaae8f56-90c2-408e-b878-56f709145763 Sep 25 11:45:55 devstack sudo[97009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:55 devstack sudo[97009]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-45ca859a-a81a-4451-87c6-69017e9a19f4 tempest-VolumeQuotasNegativeTestJSON-1388523107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aaae8f56-90c2-408e-b878-56f709145763" returned: 0 in 0.448s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:55 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-45ca859a-a81a-4451-87c6-69017e9a19f4 tempest-VolumeQuotasNegativeTestJSON-1388523107 None] Lock "cinder-quobyte-aaae8f56-90c2-408e-b878-56f709145763" released by "delete_volume" :: held 1.271s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:45:55 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-45ca859a-a81a-4451-87c6-69017e9a19f4 tempest-VolumeQuotasNegativeTestJSON-1388523107 None] Created reservations ['22f31905-78bb-4484-8487-dd4263df3b1d', '8edc33b4-232f-49c8-b530-e5d515eddc72', 'dedc84c2-e44c-422e-9997-4738e69d1656', '5c5852ec-b6a4-4c9c-b3de-8b63c8543715'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:45:56 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-45ca859a-a81a-4451-87c6-69017e9a19f4 tempest-VolumeQuotasNegativeTestJSON-1388523107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:45:56 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-45ca859a-a81a-4451-87c6-69017e9a19f4 tempest-VolumeQuotasNegativeTestJSON-1388523107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:45:56 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-45ca859a-a81a-4451-87c6-69017e9a19f4 tempest-VolumeQuotasNegativeTestJSON-1388523107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:45:56 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-45ca859a-a81a-4451-87c6-69017e9a19f4 tempest-VolumeQuotasNegativeTestJSON-1388523107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:45:56 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-45ca859a-a81a-4451-87c6-69017e9a19f4 tempest-VolumeQuotasNegativeTestJSON-1388523107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:45:56 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-45ca859a-a81a-4451-87c6-69017e9a19f4 tempest-VolumeQuotasNegativeTestJSON-1388523107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:45:56 devstack sudo[97013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:45:56 devstack sudo[97013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:45:56 devstack sudo[97013]: pam_unix(sudo:session): session closed for user root Sep 25 11:45:56 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-45ca859a-a81a-4451-87c6-69017e9a19f4 tempest-VolumeQuotasNegativeTestJSON-1388523107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.384s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:45:56 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-45ca859a-a81a-4451-87c6-69017e9a19f4 tempest-VolumeQuotasNegativeTestJSON-1388523107 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:45:56 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-45ca859a-a81a-4451-87c6-69017e9a19f4 tempest-VolumeQuotasNegativeTestJSON-1388523107 None] Deleted volume successfully. Sep 25 11:45:56 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-45ca859a-a81a-4451-87c6-69017e9a19f4 tempest-VolumeQuotasNegativeTestJSON-1388523107 None] Lock "cinder-aaae8f56-90c2-408e-b878-56f709145763-delete_volume" released by "delete_volume" :: held 2.146s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:46:03 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [req-8e207f66-de61-4b02-94f6-993ab30ad2e3 req-19674394-26f3-4726-99b2-cc2d322c7e79 tempest-VolumesGetTestJSON-730736026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:46:03 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [req-8e207f66-de61-4b02-94f6-993ab30ad2e3 req-19674394-26f3-4726-99b2-cc2d322c7e79 tempest-VolumesGetTestJSON-730736026 None] Flow 'volume_create_manager' (b771f8f7-53d3-4be4-b60c-6144fce8d5bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:46:03 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [req-8e207f66-de61-4b02-94f6-993ab30ad2e3 req-19674394-26f3-4726-99b2-cc2d322c7e79 tempest-VolumesGetTestJSON-730736026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9eba1cad-6dd2-4214-92ea-489d7ef917dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:46:03 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [req-8e207f66-de61-4b02-94f6-993ab30ad2e3 req-19674394-26f3-4726-99b2-cc2d322c7e79 tempest-VolumesGetTestJSON-730736026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9eba1cad-6dd2-4214-92ea-489d7ef917dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:46:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1627668806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26e31d25-bb2c-4619-bd31-60999dcefbfa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f03e7beef39747b593991e64042c333f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:46:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:46:04Z,use_quota=True,user_id='d0ab232fdfc74db2a06c5921f5beb929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:46:03 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [req-8e207f66-de61-4b02-94f6-993ab30ad2e3 req-19674394-26f3-4726-99b2-cc2d322c7e79 tempest-VolumesGetTestJSON-730736026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0daafa30-5825-43a7-ab6e-dfa80665a94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:46:03 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [req-8e207f66-de61-4b02-94f6-993ab30ad2e3 req-19674394-26f3-4726-99b2-cc2d322c7e79 tempest-VolumesGetTestJSON-730736026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0daafa30-5825-43a7-ab6e-dfa80665a94e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:46:03 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [req-8e207f66-de61-4b02-94f6-993ab30ad2e3 req-19674394-26f3-4726-99b2-cc2d322c7e79 tempest-VolumesGetTestJSON-730736026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9a5150f-83b5-4f24-bedc-3191fd85e33b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:46:03 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [req-8e207f66-de61-4b02-94f6-993ab30ad2e3 req-19674394-26f3-4726-99b2-cc2d322c7e79 tempest-VolumesGetTestJSON-730736026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9a5150f-83b5-4f24-bedc-3191fd85e33b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26e31d25-bb2c-4619-bd31-60999dcefbfa', 'volume_name': 'volume-26e31d25-bb2c-4619-bd31-60999dcefbfa', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:46:03 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [req-8e207f66-de61-4b02-94f6-993ab30ad2e3 req-19674394-26f3-4726-99b2-cc2d322c7e79 tempest-VolumesGetTestJSON-730736026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4da3072-4311-4a67-bb93-6dcd7364d590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:46:03 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [req-8e207f66-de61-4b02-94f6-993ab30ad2e3 req-19674394-26f3-4726-99b2-cc2d322c7e79 tempest-VolumesGetTestJSON-730736026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4da3072-4311-4a67-bb93-6dcd7364d590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:46:03 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [req-8e207f66-de61-4b02-94f6-993ab30ad2e3 req-19674394-26f3-4726-99b2-cc2d322c7e79 tempest-VolumesGetTestJSON-730736026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e108bd6-c5e5-45d9-9bb3-57ecac34aa72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:46:03 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [req-8e207f66-de61-4b02-94f6-993ab30ad2e3 req-19674394-26f3-4726-99b2-cc2d322c7e79 tempest-VolumesGetTestJSON-730736026 None] Volume 26e31d25-bb2c-4619-bd31-60999dcefbfa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26e31d25-bb2c-4619-bd31-60999dcefbfa', 'volume_size': 1} Sep 25 11:46:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-8e207f66-de61-4b02-94f6-993ab30ad2e3 req-19674394-26f3-4726-99b2-cc2d322c7e79 tempest-VolumesGetTestJSON-730736026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:46:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-8e207f66-de61-4b02-94f6-993ab30ad2e3 req-19674394-26f3-4726-99b2-cc2d322c7e79 tempest-VolumesGetTestJSON-730736026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:46:03 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [req-8e207f66-de61-4b02-94f6-993ab30ad2e3 req-19674394-26f3-4726-99b2-cc2d322c7e79 tempest-VolumesGetTestJSON-730736026 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:46:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1627668806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26e31d25-bb2c-4619-bd31-60999dcefbfa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f03e7beef39747b593991e64042c333f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:46:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:46:04Z,use_quota=True,user_id='d0ab232fdfc74db2a06c5921f5beb929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:46:03 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [req-8e207f66-de61-4b02-94f6-993ab30ad2e3 req-19674394-26f3-4726-99b2-cc2d322c7e79 tempest-VolumesGetTestJSON-730736026 None] Creating volume 26e31d25-bb2c-4619-bd31-60999dcefbfa {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:46:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-8e207f66-de61-4b02-94f6-993ab30ad2e3 req-19674394-26f3-4726-99b2-cc2d322c7e79 tempest-VolumesGetTestJSON-730736026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:46:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-8e207f66-de61-4b02-94f6-993ab30ad2e3 req-19674394-26f3-4726-99b2-cc2d322c7e79 tempest-VolumesGetTestJSON-730736026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:46:03 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [req-8e207f66-de61-4b02-94f6-993ab30ad2e3 req-19674394-26f3-4726-99b2-cc2d322c7e79 tempest-VolumesGetTestJSON-730736026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:46:03 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [req-8e207f66-de61-4b02-94f6-993ab30ad2e3 req-19674394-26f3-4726-99b2-cc2d322c7e79 tempest-VolumesGetTestJSON-730736026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:46:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-8e207f66-de61-4b02-94f6-993ab30ad2e3 req-19674394-26f3-4726-99b2-cc2d322c7e79 tempest-VolumesGetTestJSON-730736026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:46:03 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [req-8e207f66-de61-4b02-94f6-993ab30ad2e3 req-19674394-26f3-4726-99b2-cc2d322c7e79 tempest-VolumesGetTestJSON-730736026 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:46:03 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [req-8e207f66-de61-4b02-94f6-993ab30ad2e3 req-19674394-26f3-4726-99b2-cc2d322c7e79 tempest-VolumesGetTestJSON-730736026 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:46:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [req-8e207f66-de61-4b02-94f6-993ab30ad2e3 req-19674394-26f3-4726-99b2-cc2d322c7e79 tempest-VolumesGetTestJSON-730736026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-26e31d25-bb2c-4619-bd31-60999dcefbfa 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:04 devstack sudo[97017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-26e31d25-bb2c-4619-bd31-60999dcefbfa 1073741824 Sep 25 11:46:04 devstack sudo[97017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:04 devstack sudo[97017]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:04 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [req-8e207f66-de61-4b02-94f6-993ab30ad2e3 req-19674394-26f3-4726-99b2-cc2d322c7e79 tempest-VolumesGetTestJSON-730736026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-26e31d25-bb2c-4619-bd31-60999dcefbfa 1073741824" returned: 0 in 0.741s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:04 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [req-8e207f66-de61-4b02-94f6-993ab30ad2e3 req-19674394-26f3-4726-99b2-cc2d322c7e79 tempest-VolumesGetTestJSON-730736026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-26e31d25-bb2c-4619-bd31-60999dcefbfa {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:04 devstack sudo[97023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-26e31d25-bb2c-4619-bd31-60999dcefbfa Sep 25 11:46:04 devstack sudo[97023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:05 devstack sudo[97023]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [req-8e207f66-de61-4b02-94f6-993ab30ad2e3 req-19674394-26f3-4726-99b2-cc2d322c7e79 tempest-VolumesGetTestJSON-730736026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-26e31d25-bb2c-4619-bd31-60999dcefbfa" returned: 0 in 0.399s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:05 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [req-8e207f66-de61-4b02-94f6-993ab30ad2e3 req-19674394-26f3-4726-99b2-cc2d322c7e79 tempest-VolumesGetTestJSON-730736026 None] <== create_volume: return (1219ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:46:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-8e207f66-de61-4b02-94f6-993ab30ad2e3 req-19674394-26f3-4726-99b2-cc2d322c7e79 tempest-VolumesGetTestJSON-730736026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.222s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:46:05 devstack cinder-volume[86984]: DEBUG dbcounter [-] [86984] Writing DB stats cinder:SELECT=108,cinder:UPDATE=109,cinder:DELETE=10,cinder:INSERT=24 {{(pid=86984) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:46:05 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [req-8e207f66-de61-4b02-94f6-993ab30ad2e3 req-19674394-26f3-4726-99b2-cc2d322c7e79 tempest-VolumesGetTestJSON-730736026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e108bd6-c5e5-45d9-9bb3-57ecac34aa72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26e31d25-bb2c-4619-bd31-60999dcefbfa', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:46:05 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [req-8e207f66-de61-4b02-94f6-993ab30ad2e3 req-19674394-26f3-4726-99b2-cc2d322c7e79 tempest-VolumesGetTestJSON-730736026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a651445e-35ea-490e-af28-40d401e176ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:46:05 devstack cinder-volume[86984]: DEBUG dbcounter [-] [86984] Writing DB stats cinder:UPDATE=111,cinder:SELECT=101,cinder:INSERT=31,cinder:DELETE=6 {{(pid=86984) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:46:05 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [req-8e207f66-de61-4b02-94f6-993ab30ad2e3 req-19674394-26f3-4726-99b2-cc2d322c7e79 tempest-VolumesGetTestJSON-730736026 None] Volume volume-26e31d25-bb2c-4619-bd31-60999dcefbfa (26e31d25-bb2c-4619-bd31-60999dcefbfa): created successfully Sep 25 11:46:05 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [req-8e207f66-de61-4b02-94f6-993ab30ad2e3 req-19674394-26f3-4726-99b2-cc2d322c7e79 tempest-VolumesGetTestJSON-730736026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a651445e-35ea-490e-af28-40d401e176ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:46:05 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [req-8e207f66-de61-4b02-94f6-993ab30ad2e3 req-19674394-26f3-4726-99b2-cc2d322c7e79 tempest-VolumesGetTestJSON-730736026 None] Flow 'volume_create_manager' (b771f8f7-53d3-4be4-b60c-6144fce8d5bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:46:05 devstack cinder-volume[86984]: INFO cinder.volume.manager [req-8e207f66-de61-4b02-94f6-993ab30ad2e3 req-19674394-26f3-4726-99b2-cc2d322c7e79 tempest-VolumesGetTestJSON-730736026 None] Created volume successfully. Sep 25 11:46:06 devstack cinder-volume[86984]: DEBUG cinder.coordination [req-f7a1b174-b54d-45cf-a086-4626387577fe req-de47324f-f37b-42da-9145-3d7e90756191 tempest-VolumesGetTestJSON-730736026 None] Acquiring lock "cinder-26e31d25-bb2c-4619-bd31-60999dcefbfa-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:46:06 devstack cinder-volume[86984]: DEBUG cinder.coordination [req-f7a1b174-b54d-45cf-a086-4626387577fe req-de47324f-f37b-42da-9145-3d7e90756191 tempest-VolumesGetTestJSON-730736026 None] Lock "cinder-26e31d25-bb2c-4619-bd31-60999dcefbfa-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:46:06 devstack cinder-volume[86984]: DEBUG cinder.coordination [req-f7a1b174-b54d-45cf-a086-4626387577fe req-de47324f-f37b-42da-9145-3d7e90756191 tempest-VolumesGetTestJSON-730736026 None] Acquiring lock "cinder-quobyte-26e31d25-bb2c-4619-bd31-60999dcefbfa" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:46:06 devstack cinder-volume[86984]: DEBUG cinder.coordination [req-f7a1b174-b54d-45cf-a086-4626387577fe req-de47324f-f37b-42da-9145-3d7e90756191 tempest-VolumesGetTestJSON-730736026 None] Lock "cinder-quobyte-26e31d25-bb2c-4619-bd31-60999dcefbfa" acquired by "delete_volume" :: waited 0.029s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:46:06 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a72e80-6b79-4c4d-9182-b6a8d289ac81]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:46:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [req-f7a1b174-b54d-45cf-a086-4626387577fe req-de47324f-f37b-42da-9145-3d7e90756191 tempest-VolumesGetTestJSON-730736026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-26e31d25-bb2c-4619-bd31-60999dcefbfa {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:07 devstack sudo[97026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-26e31d25-bb2c-4619-bd31-60999dcefbfa Sep 25 11:46:07 devstack sudo[97026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:07 devstack sudo[97026]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [req-f7a1b174-b54d-45cf-a086-4626387577fe req-de47324f-f37b-42da-9145-3d7e90756191 tempest-VolumesGetTestJSON-730736026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-26e31d25-bb2c-4619-bd31-60999dcefbfa" returned: 0 in 0.609s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [req-f7a1b174-b54d-45cf-a086-4626387577fe req-de47324f-f37b-42da-9145-3d7e90756191 tempest-VolumesGetTestJSON-730736026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-26e31d25-bb2c-4619-bd31-60999dcefbfa {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:07 devstack sudo[97032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-26e31d25-bb2c-4619-bd31-60999dcefbfa Sep 25 11:46:07 devstack sudo[97032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:08 devstack sudo[97032]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [req-f7a1b174-b54d-45cf-a086-4626387577fe req-de47324f-f37b-42da-9145-3d7e90756191 tempest-VolumesGetTestJSON-730736026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-26e31d25-bb2c-4619-bd31-60999dcefbfa" returned: 0 in 0.463s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:08 devstack cinder-volume[86984]: DEBUG cinder.coordination [req-f7a1b174-b54d-45cf-a086-4626387577fe req-de47324f-f37b-42da-9145-3d7e90756191 tempest-VolumesGetTestJSON-730736026 None] Lock "cinder-quobyte-26e31d25-bb2c-4619-bd31-60999dcefbfa" released by "delete_volume" :: held 1.160s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:46:08 devstack cinder-volume[86984]: DEBUG cinder.quota [req-f7a1b174-b54d-45cf-a086-4626387577fe req-de47324f-f37b-42da-9145-3d7e90756191 tempest-VolumesGetTestJSON-730736026 None] Created reservations ['a121f84a-aa8c-4523-ac78-194fbc4c90de', 'bdbe32e9-5a34-44e1-947c-1941d4e6fe5b', '72da2386-4d75-4522-bae7-e2e4b5363c68', '4c23ea54-0f5f-458c-ad92-a3c5836c89e8'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:46:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-f7a1b174-b54d-45cf-a086-4626387577fe req-de47324f-f37b-42da-9145-3d7e90756191 tempest-VolumesGetTestJSON-730736026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:46:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-f7a1b174-b54d-45cf-a086-4626387577fe req-de47324f-f37b-42da-9145-3d7e90756191 tempest-VolumesGetTestJSON-730736026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:46:08 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [req-f7a1b174-b54d-45cf-a086-4626387577fe req-de47324f-f37b-42da-9145-3d7e90756191 tempest-VolumesGetTestJSON-730736026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:46:08 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [req-f7a1b174-b54d-45cf-a086-4626387577fe req-de47324f-f37b-42da-9145-3d7e90756191 tempest-VolumesGetTestJSON-730736026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:46:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-f7a1b174-b54d-45cf-a086-4626387577fe req-de47324f-f37b-42da-9145-3d7e90756191 tempest-VolumesGetTestJSON-730736026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:46:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [req-f7a1b174-b54d-45cf-a086-4626387577fe req-de47324f-f37b-42da-9145-3d7e90756191 tempest-VolumesGetTestJSON-730736026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:08 devstack sudo[97035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:46:08 devstack sudo[97035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:08 devstack sudo[97035]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [req-f7a1b174-b54d-45cf-a086-4626387577fe req-de47324f-f37b-42da-9145-3d7e90756191 tempest-VolumesGetTestJSON-730736026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.407s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:08 devstack cinder-volume[86984]: DEBUG cinder.manager [req-f7a1b174-b54d-45cf-a086-4626387577fe req-de47324f-f37b-42da-9145-3d7e90756191 tempest-VolumesGetTestJSON-730736026 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:46:08 devstack cinder-volume[86984]: INFO cinder.volume.manager [req-f7a1b174-b54d-45cf-a086-4626387577fe req-de47324f-f37b-42da-9145-3d7e90756191 tempest-VolumesGetTestJSON-730736026 None] Deleted volume successfully. Sep 25 11:46:08 devstack cinder-volume[86984]: DEBUG cinder.coordination [req-f7a1b174-b54d-45cf-a086-4626387577fe req-de47324f-f37b-42da-9145-3d7e90756191 tempest-VolumesGetTestJSON-730736026 None] Lock "cinder-26e31d25-bb2c-4619-bd31-60999dcefbfa-delete_volume" released by "delete_volume" :: held 1.970s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:46:10 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-2eafb118-b755-47b0-b50f-34582f2a5713 tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:46:10 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2eafb118-b755-47b0-b50f-34582f2a5713 tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] Flow 'volume_create_manager' (3dd64f5d-2de0-46c3-9515-4ccfbe1c26ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:46:10 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2eafb118-b755-47b0-b50f-34582f2a5713 tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf206954-3906-4a27-b61c-964712121933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:46:10 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2eafb118-b755-47b0-b50f-34582f2a5713 tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf206954-3906-4a27-b61c-964712121933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:46:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2044267720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9383603-1c86-4b4c-b43a-09d66fcf3950,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b64b63520f443b489ef62aa9d747dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:46:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:46:11Z,use_quota=True,user_id='e3b850a9fc574a42addc4c284da00cc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:46:10 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2eafb118-b755-47b0-b50f-34582f2a5713 tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88275ca1-9c2e-4892-9d17-f351b2414e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:46:10 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2eafb118-b755-47b0-b50f-34582f2a5713 tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88275ca1-9c2e-4892-9d17-f351b2414e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:46:10 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2eafb118-b755-47b0-b50f-34582f2a5713 tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a982763-ba81-4931-afde-92f8ae838dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:46:11 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2eafb118-b755-47b0-b50f-34582f2a5713 tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a982763-ba81-4931-afde-92f8ae838dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9383603-1c86-4b4c-b43a-09d66fcf3950', 'volume_name': 'volume-c9383603-1c86-4b4c-b43a-09d66fcf3950', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:46:11 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2eafb118-b755-47b0-b50f-34582f2a5713 tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53105ba9-107b-4618-b05d-322ecc4ee197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:46:11 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2eafb118-b755-47b0-b50f-34582f2a5713 tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53105ba9-107b-4618-b05d-322ecc4ee197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:46:11 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2eafb118-b755-47b0-b50f-34582f2a5713 tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1541b1e7-8fcc-4b5b-84b4-a6878f0db6b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:46:11 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-2eafb118-b755-47b0-b50f-34582f2a5713 tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] Volume c9383603-1c86-4b4c-b43a-09d66fcf3950: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9383603-1c86-4b4c-b43a-09d66fcf3950', 'volume_size': 1} Sep 25 11:46:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-2eafb118-b755-47b0-b50f-34582f2a5713 tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:46:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-2eafb118-b755-47b0-b50f-34582f2a5713 tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:46:11 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-2eafb118-b755-47b0-b50f-34582f2a5713 tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:46:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2044267720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9383603-1c86-4b4c-b43a-09d66fcf3950,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b64b63520f443b489ef62aa9d747dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:46:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:46:11Z,use_quota=True,user_id='e3b850a9fc574a42addc4c284da00cc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:46:11 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-2eafb118-b755-47b0-b50f-34582f2a5713 tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] Creating volume c9383603-1c86-4b4c-b43a-09d66fcf3950 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:46:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-2eafb118-b755-47b0-b50f-34582f2a5713 tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:46:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-2eafb118-b755-47b0-b50f-34582f2a5713 tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:46:11 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-2eafb118-b755-47b0-b50f-34582f2a5713 tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:46:11 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-2eafb118-b755-47b0-b50f-34582f2a5713 tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:46:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-2eafb118-b755-47b0-b50f-34582f2a5713 tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:46:11 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-2eafb118-b755-47b0-b50f-34582f2a5713 tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:46:11 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-2eafb118-b755-47b0-b50f-34582f2a5713 tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:46:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2eafb118-b755-47b0-b50f-34582f2a5713 tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c9383603-1c86-4b4c-b43a-09d66fcf3950 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:11 devstack sudo[97038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c9383603-1c86-4b4c-b43a-09d66fcf3950 1073741824 Sep 25 11:46:11 devstack sudo[97038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:11 devstack sudo[97038]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2eafb118-b755-47b0-b50f-34582f2a5713 tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c9383603-1c86-4b4c-b43a-09d66fcf3950 1073741824" returned: 0 in 0.721s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2eafb118-b755-47b0-b50f-34582f2a5713 tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c9383603-1c86-4b4c-b43a-09d66fcf3950 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:11 devstack sudo[97045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c9383603-1c86-4b4c-b43a-09d66fcf3950 Sep 25 11:46:11 devstack sudo[97045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:12 devstack sudo[97045]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:12 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2eafb118-b755-47b0-b50f-34582f2a5713 tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c9383603-1c86-4b4c-b43a-09d66fcf3950" returned: 0 in 0.499s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:12 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-2eafb118-b755-47b0-b50f-34582f2a5713 tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] <== create_volume: return (1297ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:46:12 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-2eafb118-b755-47b0-b50f-34582f2a5713 tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.303s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:46:12 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2eafb118-b755-47b0-b50f-34582f2a5713 tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1541b1e7-8fcc-4b5b-84b4-a6878f0db6b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9383603-1c86-4b4c-b43a-09d66fcf3950', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:46:12 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2eafb118-b755-47b0-b50f-34582f2a5713 tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba4f811a-a448-4ea9-994b-9d5e27e279ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:46:12 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-2eafb118-b755-47b0-b50f-34582f2a5713 tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] Volume volume-c9383603-1c86-4b4c-b43a-09d66fcf3950 (c9383603-1c86-4b4c-b43a-09d66fcf3950): created successfully Sep 25 11:46:12 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2eafb118-b755-47b0-b50f-34582f2a5713 tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba4f811a-a448-4ea9-994b-9d5e27e279ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:46:12 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2eafb118-b755-47b0-b50f-34582f2a5713 tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] Flow 'volume_create_manager' (3dd64f5d-2de0-46c3-9515-4ccfbe1c26ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:46:12 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-2eafb118-b755-47b0-b50f-34582f2a5713 tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] Created volume successfully. Sep 25 11:46:13 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-ef1db65f-91c2-44f2-bec5-0685d3be179e tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:46:13 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-ef1db65f-91c2-44f2-bec5-0685d3be179e tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:46:13 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-ef1db65f-91c2-44f2-bec5-0685d3be179e tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] Creating offline snapshot 1d58300e-f8bc-4cdb-ac77-4bca7423fd9e of volume c9383603-1c86-4b4c-b43a-09d66fcf3950 {{(pid=86984) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:46:13 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[8913e1ac-3574-4f50-b9b7-970aba9f90b5]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:46:13 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ef1db65f-91c2-44f2-bec5-0685d3be179e tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c9383603-1c86-4b4c-b43a-09d66fcf3950 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:13 devstack sudo[97049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c9383603-1c86-4b4c-b43a-09d66fcf3950 Sep 25 11:46:13 devstack sudo[97049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:14 devstack sudo[97049]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:14 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ef1db65f-91c2-44f2-bec5-0685d3be179e tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c9383603-1c86-4b4c-b43a-09d66fcf3950" returned: 0 in 0.500s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:14 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ef1db65f-91c2-44f2-bec5-0685d3be179e tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c9383603-1c86-4b4c-b43a-09d66fcf3950,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c9383603-1c86-4b4c-b43a-09d66fcf3950.1d58300e-f8bc-4cdb-ac77-4bca7423fd9e 1G {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:14 devstack sudo[97054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c9383603-1c86-4b4c-b43a-09d66fcf3950,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c9383603-1c86-4b4c-b43a-09d66fcf3950.1d58300e-f8bc-4cdb-ac77-4bca7423fd9e 1G Sep 25 11:46:14 devstack sudo[97054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:14 devstack sudo[97054]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:14 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ef1db65f-91c2-44f2-bec5-0685d3be179e tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c9383603-1c86-4b4c-b43a-09d66fcf3950,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c9383603-1c86-4b4c-b43a-09d66fcf3950.1d58300e-f8bc-4cdb-ac77-4bca7423fd9e 1G" returned: 0 in 0.625s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:14 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ef1db65f-91c2-44f2-bec5-0685d3be179e tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9383603-1c86-4b4c-b43a-09d66fcf3950 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c9383603-1c86-4b4c-b43a-09d66fcf3950.1d58300e-f8bc-4cdb-ac77-4bca7423fd9e {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:14 devstack sudo[97061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9383603-1c86-4b4c-b43a-09d66fcf3950 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c9383603-1c86-4b4c-b43a-09d66fcf3950.1d58300e-f8bc-4cdb-ac77-4bca7423fd9e Sep 25 11:46:14 devstack sudo[97061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:15 devstack sudo[97061]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:15 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ef1db65f-91c2-44f2-bec5-0685d3be179e tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9383603-1c86-4b4c-b43a-09d66fcf3950 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c9383603-1c86-4b4c-b43a-09d66fcf3950.1d58300e-f8bc-4cdb-ac77-4bca7423fd9e" returned: 0 in 0.584s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:15 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-ef1db65f-91c2-44f2-bec5-0685d3be179e tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c9383603-1c86-4b4c-b43a-09d66fcf3950.1d58300e-f8bc-4cdb-ac77-4bca7423fd9e is being set with open permissions: ugo+rw Sep 25 11:46:15 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ef1db65f-91c2-44f2-bec5-0685d3be179e tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c9383603-1c86-4b4c-b43a-09d66fcf3950.1d58300e-f8bc-4cdb-ac77-4bca7423fd9e {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:15 devstack sudo[97068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c9383603-1c86-4b4c-b43a-09d66fcf3950.1d58300e-f8bc-4cdb-ac77-4bca7423fd9e Sep 25 11:46:15 devstack sudo[97068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:15 devstack sudo[97068]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:15 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ef1db65f-91c2-44f2-bec5-0685d3be179e tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c9383603-1c86-4b4c-b43a-09d66fcf3950.1d58300e-f8bc-4cdb-ac77-4bca7423fd9e" returned: 0 in 0.446s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:15 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ef1db65f-91c2-44f2-bec5-0685d3be179e tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c9383603-1c86-4b4c-b43a-09d66fcf3950.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:15 devstack sudo[97071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c9383603-1c86-4b4c-b43a-09d66fcf3950.info Sep 25 11:46:15 devstack sudo[97071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:16 devstack sudo[97071]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:16 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ef1db65f-91c2-44f2-bec5-0685d3be179e tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c9383603-1c86-4b4c-b43a-09d66fcf3950.info" returned: 0 in 0.446s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:16 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-ef1db65f-91c2-44f2-bec5-0685d3be179e tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c9383603-1c86-4b4c-b43a-09d66fcf3950.info is being set with open permissions: ugo+rw Sep 25 11:46:16 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ef1db65f-91c2-44f2-bec5-0685d3be179e tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c9383603-1c86-4b4c-b43a-09d66fcf3950.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:16 devstack sudo[97074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c9383603-1c86-4b4c-b43a-09d66fcf3950.info Sep 25 11:46:16 devstack sudo[97074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:16 devstack sudo[97074]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:16 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ef1db65f-91c2-44f2-bec5-0685d3be179e tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c9383603-1c86-4b4c-b43a-09d66fcf3950.info" returned: 0 in 0.547s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:16 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-ef1db65f-91c2-44f2-bec5-0685d3be179e tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.307s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:46:16 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-ef1db65f-91c2-44f2-bec5-0685d3be179e tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] Create snapshot completed successfully Sep 25 11:46:17 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-e762e727-360f-46f2-9819-50bd09a7ed75 tempest-VolumeRetypeWithoutMigrationTest-1618623951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:46:17 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e762e727-360f-46f2-9819-50bd09a7ed75 tempest-VolumeRetypeWithoutMigrationTest-1618623951 None] Flow 'volume_create_manager' (67d2f9e1-fc0d-497f-aeda-5a1ebf6731ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:46:17 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e762e727-360f-46f2-9819-50bd09a7ed75 tempest-VolumeRetypeWithoutMigrationTest-1618623951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92496e30-0e23-40db-8609-6e4393a5430b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:46:18 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e762e727-360f-46f2-9819-50bd09a7ed75 tempest-VolumeRetypeWithoutMigrationTest-1618623951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92496e30-0e23-40db-8609-6e4393a5430b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:46:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-417222267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a3bb58a-7b0f-45f1-bf7c-d3d463cf9264,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfa0a96879f94d4ba3c08310edf8f24f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:46:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:46:18Z,use_quota=True,user_id='193caeba6b6e475282e621be55bd884a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14053e19-0a41-4ade-b4d3-6495a0cf657f),volume_type_id=14053e19-0a41-4ade-b4d3-6495a0cf657f)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:46:18 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e762e727-360f-46f2-9819-50bd09a7ed75 tempest-VolumeRetypeWithoutMigrationTest-1618623951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a43749e2-b571-41be-9e3f-75e4ccf47306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:46:18 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e762e727-360f-46f2-9819-50bd09a7ed75 tempest-VolumeRetypeWithoutMigrationTest-1618623951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a43749e2-b571-41be-9e3f-75e4ccf47306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:46:18 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e762e727-360f-46f2-9819-50bd09a7ed75 tempest-VolumeRetypeWithoutMigrationTest-1618623951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a800d66f-1495-4d10-91ee-dd06b733d4b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:46:18 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e762e727-360f-46f2-9819-50bd09a7ed75 tempest-VolumeRetypeWithoutMigrationTest-1618623951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a800d66f-1495-4d10-91ee-dd06b733d4b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a3bb58a-7b0f-45f1-bf7c-d3d463cf9264', 'volume_name': 'volume-3a3bb58a-7b0f-45f1-bf7c-d3d463cf9264', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:46:18 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e762e727-360f-46f2-9819-50bd09a7ed75 tempest-VolumeRetypeWithoutMigrationTest-1618623951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40f5551e-df2b-44d2-8230-0cf9e79a7056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:46:18 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e762e727-360f-46f2-9819-50bd09a7ed75 tempest-VolumeRetypeWithoutMigrationTest-1618623951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40f5551e-df2b-44d2-8230-0cf9e79a7056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:46:18 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e762e727-360f-46f2-9819-50bd09a7ed75 tempest-VolumeRetypeWithoutMigrationTest-1618623951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3051e67-bb18-43e8-84c0-bf01f9d08278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:46:18 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-e762e727-360f-46f2-9819-50bd09a7ed75 tempest-VolumeRetypeWithoutMigrationTest-1618623951 None] Volume 3a3bb58a-7b0f-45f1-bf7c-d3d463cf9264: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a3bb58a-7b0f-45f1-bf7c-d3d463cf9264', 'volume_size': 1} Sep 25 11:46:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-e762e727-360f-46f2-9819-50bd09a7ed75 tempest-VolumeRetypeWithoutMigrationTest-1618623951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:46:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-e762e727-360f-46f2-9819-50bd09a7ed75 tempest-VolumeRetypeWithoutMigrationTest-1618623951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:46:18 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-e762e727-360f-46f2-9819-50bd09a7ed75 tempest-VolumeRetypeWithoutMigrationTest-1618623951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:46:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-417222267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a3bb58a-7b0f-45f1-bf7c-d3d463cf9264,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfa0a96879f94d4ba3c08310edf8f24f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:46:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:46:18Z,use_quota=True,user_id='193caeba6b6e475282e621be55bd884a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14053e19-0a41-4ade-b4d3-6495a0cf657f),volume_type_id=14053e19-0a41-4ade-b4d3-6495a0cf657f)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:46:18 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-e762e727-360f-46f2-9819-50bd09a7ed75 tempest-VolumeRetypeWithoutMigrationTest-1618623951 None] Creating volume 3a3bb58a-7b0f-45f1-bf7c-d3d463cf9264 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:46:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-e762e727-360f-46f2-9819-50bd09a7ed75 tempest-VolumeRetypeWithoutMigrationTest-1618623951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:46:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-e762e727-360f-46f2-9819-50bd09a7ed75 tempest-VolumeRetypeWithoutMigrationTest-1618623951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:46:18 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-e762e727-360f-46f2-9819-50bd09a7ed75 tempest-VolumeRetypeWithoutMigrationTest-1618623951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:46:18 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-e762e727-360f-46f2-9819-50bd09a7ed75 tempest-VolumeRetypeWithoutMigrationTest-1618623951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:46:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-e762e727-360f-46f2-9819-50bd09a7ed75 tempest-VolumeRetypeWithoutMigrationTest-1618623951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:46:18 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-e762e727-360f-46f2-9819-50bd09a7ed75 tempest-VolumeRetypeWithoutMigrationTest-1618623951 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:46:18 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-e762e727-360f-46f2-9819-50bd09a7ed75 tempest-VolumeRetypeWithoutMigrationTest-1618623951 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:46:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e762e727-360f-46f2-9819-50bd09a7ed75 tempest-VolumeRetypeWithoutMigrationTest-1618623951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-3a3bb58a-7b0f-45f1-bf7c-d3d463cf9264 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:18 devstack sudo[97077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-3a3bb58a-7b0f-45f1-bf7c-d3d463cf9264 1073741824 Sep 25 11:46:18 devstack sudo[97077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:18 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8290ed8b-6e77-40c4-9456-9b534ca8e47c tempest-BackendsCapabilitiesAdminTestsJSON-1761450131 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.4309730529785, 'free_capacity_gb': 1775.4309730529785, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86984) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 25 11:46:18 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6009a8f8-c7b1-4dae-9215-bd1af1b00519 tempest-BackendsCapabilitiesAdminTestsJSON-1761450131 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.4309730529785, 'free_capacity_gb': 1775.4309730529785, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86984) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 25 11:46:18 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-509648aa-5782-4085-add7-f86f668d293d tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] Acquiring lock "cinder-1d58300e-f8bc-4cdb-ac77-4bca7423fd9e-delete_snapshot" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:46:18 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-509648aa-5782-4085-add7-f86f668d293d tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] Lock "cinder-1d58300e-f8bc-4cdb-ac77-4bca7423fd9e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:46:18 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-509648aa-5782-4085-add7-f86f668d293d tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] Acquiring lock "cinder-quobyte-c9383603-1c86-4b4c-b43a-09d66fcf3950" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:46:18 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-509648aa-5782-4085-add7-f86f668d293d tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] Lock "cinder-quobyte-c9383603-1c86-4b4c-b43a-09d66fcf3950" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:46:18 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-509648aa-5782-4085-add7-f86f668d293d tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] Acquiring lock "cinder-quobyte-1d58300e-f8bc-4cdb-ac77-4bca7423fd9e" by "_delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:46:18 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-509648aa-5782-4085-add7-f86f668d293d tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] Lock "cinder-quobyte-1d58300e-f8bc-4cdb-ac77-4bca7423fd9e" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:46:18 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-509648aa-5782-4085-add7-f86f668d293d tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] Deleting offline snapshot 1d58300e-f8bc-4cdb-ac77-4bca7423fd9e of volume c9383603-1c86-4b4c-b43a-09d66fcf3950 {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:46:18 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-509648aa-5782-4085-add7-f86f668d293d tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] snapshot_file for this snap is: volume-c9383603-1c86-4b4c-b43a-09d66fcf3950.1d58300e-f8bc-4cdb-ac77-4bca7423fd9e {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:46:18 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[71eca530-5ef0-49ba-a1dd-3bcb7c22dbde]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:46:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-509648aa-5782-4085-add7-f86f668d293d tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c9383603-1c86-4b4c-b43a-09d66fcf3950.1d58300e-f8bc-4cdb-ac77-4bca7423fd9e {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:18 devstack sudo[97077]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e762e727-360f-46f2-9819-50bd09a7ed75 tempest-VolumeRetypeWithoutMigrationTest-1618623951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-3a3bb58a-7b0f-45f1-bf7c-d3d463cf9264 1073741824" returned: 0 in 0.761s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:18 devstack sudo[97083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c9383603-1c86-4b4c-b43a-09d66fcf3950.1d58300e-f8bc-4cdb-ac77-4bca7423fd9e Sep 25 11:46:18 devstack sudo[97083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e762e727-360f-46f2-9819-50bd09a7ed75 tempest-VolumeRetypeWithoutMigrationTest-1618623951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-3a3bb58a-7b0f-45f1-bf7c-d3d463cf9264 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:19 devstack sudo[97085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-3a3bb58a-7b0f-45f1-bf7c-d3d463cf9264 Sep 25 11:46:19 devstack sudo[97085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:19 devstack sudo[97083]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:19 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-509648aa-5782-4085-add7-f86f668d293d tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c9383603-1c86-4b4c-b43a-09d66fcf3950.1d58300e-f8bc-4cdb-ac77-4bca7423fd9e" returned: 0 in 0.683s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:19 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-509648aa-5782-4085-add7-f86f668d293d tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9383603-1c86-4b4c-b43a-09d66fcf3950(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86984) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:46:19 devstack sudo[97085]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:19 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e762e727-360f-46f2-9819-50bd09a7ed75 tempest-VolumeRetypeWithoutMigrationTest-1618623951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-3a3bb58a-7b0f-45f1-bf7c-d3d463cf9264" returned: 0 in 0.460s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:19 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-e762e727-360f-46f2-9819-50bd09a7ed75 tempest-VolumeRetypeWithoutMigrationTest-1618623951 None] <== create_volume: return (1327ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:46:19 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-e762e727-360f-46f2-9819-50bd09a7ed75 tempest-VolumeRetypeWithoutMigrationTest-1618623951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.333s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:46:19 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e762e727-360f-46f2-9819-50bd09a7ed75 tempest-VolumeRetypeWithoutMigrationTest-1618623951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3051e67-bb18-43e8-84c0-bf01f9d08278) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a3bb58a-7b0f-45f1-bf7c-d3d463cf9264', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:46:19 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e762e727-360f-46f2-9819-50bd09a7ed75 tempest-VolumeRetypeWithoutMigrationTest-1618623951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (913acb81-d73e-4992-83d1-43eef79addd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:46:19 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[879609dd-ce07-4994-a743-b1ba61391867]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:46:19 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-509648aa-5782-4085-add7-f86f668d293d tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c9383603-1c86-4b4c-b43a-09d66fcf3950 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:19 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-e762e727-360f-46f2-9819-50bd09a7ed75 tempest-VolumeRetypeWithoutMigrationTest-1618623951 None] Volume volume-3a3bb58a-7b0f-45f1-bf7c-d3d463cf9264 (3a3bb58a-7b0f-45f1-bf7c-d3d463cf9264): created successfully Sep 25 11:46:19 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e762e727-360f-46f2-9819-50bd09a7ed75 tempest-VolumeRetypeWithoutMigrationTest-1618623951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (913acb81-d73e-4992-83d1-43eef79addd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:46:19 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e762e727-360f-46f2-9819-50bd09a7ed75 tempest-VolumeRetypeWithoutMigrationTest-1618623951 None] Flow 'volume_create_manager' (67d2f9e1-fc0d-497f-aeda-5a1ebf6731ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:46:19 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-e762e727-360f-46f2-9819-50bd09a7ed75 tempest-VolumeRetypeWithoutMigrationTest-1618623951 None] Created volume successfully. Sep 25 11:46:19 devstack sudo[97091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c9383603-1c86-4b4c-b43a-09d66fcf3950 Sep 25 11:46:19 devstack sudo[97091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:20 devstack sudo[97091]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-509648aa-5782-4085-add7-f86f668d293d tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c9383603-1c86-4b4c-b43a-09d66fcf3950" returned: 0 in 0.617s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-509648aa-5782-4085-add7-f86f668d293d tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c9383603-1c86-4b4c-b43a-09d66fcf3950.1d58300e-f8bc-4cdb-ac77-4bca7423fd9e {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:20 devstack sudo[97096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c9383603-1c86-4b4c-b43a-09d66fcf3950.1d58300e-f8bc-4cdb-ac77-4bca7423fd9e Sep 25 11:46:20 devstack sudo[97096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-53a9890a-0f6d-4144-bd1b-efce198ff1ed tempest-VolumeRetypeWithoutMigrationTest-1618623951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:46:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-53a9890a-0f6d-4144-bd1b-efce198ff1ed tempest-VolumeRetypeWithoutMigrationTest-1618623951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:46:20 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-53a9890a-0f6d-4144-bd1b-efce198ff1ed tempest-VolumeRetypeWithoutMigrationTest-1618623951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:46:20 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-53a9890a-0f6d-4144-bd1b-efce198ff1ed tempest-VolumeRetypeWithoutMigrationTest-1618623951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:46:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-53a9890a-0f6d-4144-bd1b-efce198ff1ed tempest-VolumeRetypeWithoutMigrationTest-1618623951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:46:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-53a9890a-0f6d-4144-bd1b-efce198ff1ed tempest-VolumeRetypeWithoutMigrationTest-1618623951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:20 devstack sudo[97102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:46:20 devstack sudo[97102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:20 devstack sudo[97096]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-509648aa-5782-4085-add7-f86f668d293d tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c9383603-1c86-4b4c-b43a-09d66fcf3950.1d58300e-f8bc-4cdb-ac77-4bca7423fd9e" returned: 0 in 0.710s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-509648aa-5782-4085-add7-f86f668d293d tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c9383603-1c86-4b4c-b43a-09d66fcf3950.1d58300e-f8bc-4cdb-ac77-4bca7423fd9e {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:20 devstack sudo[97104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c9383603-1c86-4b4c-b43a-09d66fcf3950.1d58300e-f8bc-4cdb-ac77-4bca7423fd9e Sep 25 11:46:20 devstack sudo[97104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:21 devstack sudo[97102]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:21 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-53a9890a-0f6d-4144-bd1b-efce198ff1ed tempest-VolumeRetypeWithoutMigrationTest-1618623951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.427s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:21 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-53a9890a-0f6d-4144-bd1b-efce198ff1ed tempest-VolumeRetypeWithoutMigrationTest-1618623951 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:46:21 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-53a9890a-0f6d-4144-bd1b-efce198ff1ed tempest-VolumeRetypeWithoutMigrationTest-1618623951 None] Retype volume completed successfully. Sep 25 11:46:21 devstack sudo[97104]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:21 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-509648aa-5782-4085-add7-f86f668d293d tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c9383603-1c86-4b4c-b43a-09d66fcf3950.1d58300e-f8bc-4cdb-ac77-4bca7423fd9e" returned: 0 in 0.608s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:21 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-509648aa-5782-4085-add7-f86f668d293d tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] Lock "cinder-quobyte-1d58300e-f8bc-4cdb-ac77-4bca7423fd9e" released by "_delete_snapshot" :: held 2.836s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:46:21 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-509648aa-5782-4085-add7-f86f668d293d tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] Lock "cinder-quobyte-c9383603-1c86-4b4c-b43a-09d66fcf3950" released by "delete_snapshot" :: held 2.879s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:46:21 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-509648aa-5782-4085-add7-f86f668d293d tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] Created reservations ['3270cd2d-dab1-406b-bc31-9ee3b1e14ced', 'c705d763-d31b-411c-b3c3-e80a84501a5b', '0bf49616-a24e-4665-a99c-8af036f6699b', 'a5aca46e-733b-4385-8575-eca1431df8a7'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:46:21 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-509648aa-5782-4085-add7-f86f668d293d tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] Delete snapshot completed successfully. Sep 25 11:46:21 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-509648aa-5782-4085-add7-f86f668d293d tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] Lock "cinder-1d58300e-f8bc-4cdb-ac77-4bca7423fd9e-delete_snapshot" released by "delete_snapshot" :: held 3.190s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:46:22 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e5b51e4f-cac2-49de-a589-1b1a130651b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] Acquiring lock "cinder-c9383603-1c86-4b4c-b43a-09d66fcf3950-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:46:22 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e5b51e4f-cac2-49de-a589-1b1a130651b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] Lock "cinder-c9383603-1c86-4b4c-b43a-09d66fcf3950-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:46:22 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e5b51e4f-cac2-49de-a589-1b1a130651b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] Acquiring lock "cinder-quobyte-c9383603-1c86-4b4c-b43a-09d66fcf3950" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:46:22 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e5b51e4f-cac2-49de-a589-1b1a130651b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] Lock "cinder-quobyte-c9383603-1c86-4b4c-b43a-09d66fcf3950" acquired by "delete_volume" :: waited 0.030s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:46:22 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-62ae901d-27b8-4bd0-a4d8-a35d4d9285b7 tempest-VolumeRetypeWithoutMigrationTest-1618623951 None] Acquiring lock "cinder-3a3bb58a-7b0f-45f1-bf7c-d3d463cf9264-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:46:22 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-62ae901d-27b8-4bd0-a4d8-a35d4d9285b7 tempest-VolumeRetypeWithoutMigrationTest-1618623951 None] Lock "cinder-3a3bb58a-7b0f-45f1-bf7c-d3d463cf9264-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:46:22 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc88c87d-3463-4a7c-ab05-35ed23c12ee2]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:46:22 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e5b51e4f-cac2-49de-a589-1b1a130651b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c9383603-1c86-4b4c-b43a-09d66fcf3950 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:22 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-62ae901d-27b8-4bd0-a4d8-a35d4d9285b7 tempest-VolumeRetypeWithoutMigrationTest-1618623951 None] Acquiring lock "cinder-quobyte-3a3bb58a-7b0f-45f1-bf7c-d3d463cf9264" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:46:22 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-62ae901d-27b8-4bd0-a4d8-a35d4d9285b7 tempest-VolumeRetypeWithoutMigrationTest-1618623951 None] Lock "cinder-quobyte-3a3bb58a-7b0f-45f1-bf7c-d3d463cf9264" acquired by "delete_volume" :: waited 0.020s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:46:22 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[d03f40a5-8c50-4674-9fe2-98f1907fc0d4]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:46:22 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-62ae901d-27b8-4bd0-a4d8-a35d4d9285b7 tempest-VolumeRetypeWithoutMigrationTest-1618623951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-3a3bb58a-7b0f-45f1-bf7c-d3d463cf9264 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:22 devstack sudo[97108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c9383603-1c86-4b4c-b43a-09d66fcf3950 Sep 25 11:46:22 devstack sudo[97108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:22 devstack sudo[97109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-3a3bb58a-7b0f-45f1-bf7c-d3d463cf9264 Sep 25 11:46:22 devstack sudo[97109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:23 devstack sudo[97108]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e5b51e4f-cac2-49de-a589-1b1a130651b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c9383603-1c86-4b4c-b43a-09d66fcf3950" returned: 0 in 0.703s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e5b51e4f-cac2-49de-a589-1b1a130651b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c9383603-1c86-4b4c-b43a-09d66fcf3950 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:23 devstack sudo[97119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c9383603-1c86-4b4c-b43a-09d66fcf3950 Sep 25 11:46:23 devstack sudo[97119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:23 devstack sudo[97109]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-62ae901d-27b8-4bd0-a4d8-a35d4d9285b7 tempest-VolumeRetypeWithoutMigrationTest-1618623951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-3a3bb58a-7b0f-45f1-bf7c-d3d463cf9264" returned: 0 in 0.642s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-62ae901d-27b8-4bd0-a4d8-a35d4d9285b7 tempest-VolumeRetypeWithoutMigrationTest-1618623951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-3a3bb58a-7b0f-45f1-bf7c-d3d463cf9264 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:23 devstack sudo[97122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-3a3bb58a-7b0f-45f1-bf7c-d3d463cf9264 Sep 25 11:46:23 devstack sudo[97122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:23 devstack sudo[97119]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e5b51e4f-cac2-49de-a589-1b1a130651b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c9383603-1c86-4b4c-b43a-09d66fcf3950" returned: 0 in 0.532s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:23 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e5b51e4f-cac2-49de-a589-1b1a130651b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] Lock "cinder-quobyte-c9383603-1c86-4b4c-b43a-09d66fcf3950" released by "delete_volume" :: held 1.397s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:46:23 devstack sudo[97122]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-62ae901d-27b8-4bd0-a4d8-a35d4d9285b7 tempest-VolumeRetypeWithoutMigrationTest-1618623951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-3a3bb58a-7b0f-45f1-bf7c-d3d463cf9264" returned: 0 in 0.495s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:23 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-62ae901d-27b8-4bd0-a4d8-a35d4d9285b7 tempest-VolumeRetypeWithoutMigrationTest-1618623951 None] Lock "cinder-quobyte-3a3bb58a-7b0f-45f1-bf7c-d3d463cf9264" released by "delete_volume" :: held 1.219s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:46:23 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-e5b51e4f-cac2-49de-a589-1b1a130651b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] Created reservations ['5499282f-f16f-4032-8f7c-3c64b94c7932', 'db99b5e1-d3bd-462e-a7a6-0374d09c8770', '03d1c4dd-c768-4147-93b0-c88c953e1d4a', '22d04a59-7f19-4721-ad3b-71adbcb4c0ad'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:46:23 devstack cinder-volume[86984]: WARNING cinder.quota [None req-62ae901d-27b8-4bd0-a4d8-a35d4d9285b7 tempest-VolumeRetypeWithoutMigrationTest-1618623951 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 25 11:46:23 devstack cinder-volume[86984]: WARNING cinder.quota [None req-62ae901d-27b8-4bd0-a4d8-a35d4d9285b7 tempest-VolumeRetypeWithoutMigrationTest-1618623951 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 25 11:46:23 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-62ae901d-27b8-4bd0-a4d8-a35d4d9285b7 tempest-VolumeRetypeWithoutMigrationTest-1618623951 None] Created reservations ['4910d03f-fafd-48c8-96d3-b21cb59f26ee', '0cd9aeac-b9b9-4fea-8762-414e987cb343', '63496dc3-8afb-4c24-ba29-b051f5830783', '5a4169be-5c90-4287-84cb-9c4c9813b79f'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:46:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-e5b51e4f-cac2-49de-a589-1b1a130651b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:46:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-e5b51e4f-cac2-49de-a589-1b1a130651b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:46:23 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-e5b51e4f-cac2-49de-a589-1b1a130651b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:46:23 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-e5b51e4f-cac2-49de-a589-1b1a130651b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:46:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-e5b51e4f-cac2-49de-a589-1b1a130651b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:46:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e5b51e4f-cac2-49de-a589-1b1a130651b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:23 devstack sudo[97126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:46:23 devstack sudo[97126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-62ae901d-27b8-4bd0-a4d8-a35d4d9285b7 tempest-VolumeRetypeWithoutMigrationTest-1618623951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:46:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-62ae901d-27b8-4bd0-a4d8-a35d4d9285b7 tempest-VolumeRetypeWithoutMigrationTest-1618623951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:46:23 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-62ae901d-27b8-4bd0-a4d8-a35d4d9285b7 tempest-VolumeRetypeWithoutMigrationTest-1618623951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:46:23 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-62ae901d-27b8-4bd0-a4d8-a35d4d9285b7 tempest-VolumeRetypeWithoutMigrationTest-1618623951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:46:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-62ae901d-27b8-4bd0-a4d8-a35d4d9285b7 tempest-VolumeRetypeWithoutMigrationTest-1618623951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:46:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-62ae901d-27b8-4bd0-a4d8-a35d4d9285b7 tempest-VolumeRetypeWithoutMigrationTest-1618623951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:23 devstack sudo[97128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:46:23 devstack sudo[97128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:24 devstack sudo[97126]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:24 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e5b51e4f-cac2-49de-a589-1b1a130651b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.345s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:24 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-e5b51e4f-cac2-49de-a589-1b1a130651b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:46:24 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-e5b51e4f-cac2-49de-a589-1b1a130651b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] Deleted volume successfully. Sep 25 11:46:24 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e5b51e4f-cac2-49de-a589-1b1a130651b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1878811161 None] Lock "cinder-c9383603-1c86-4b4c-b43a-09d66fcf3950-delete_volume" released by "delete_volume" :: held 2.194s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:46:24 devstack sudo[97128]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:24 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-62ae901d-27b8-4bd0-a4d8-a35d4d9285b7 tempest-VolumeRetypeWithoutMigrationTest-1618623951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.414s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:24 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-62ae901d-27b8-4bd0-a4d8-a35d4d9285b7 tempest-VolumeRetypeWithoutMigrationTest-1618623951 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:46:24 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-62ae901d-27b8-4bd0-a4d8-a35d4d9285b7 tempest-VolumeRetypeWithoutMigrationTest-1618623951 None] Deleted volume successfully. Sep 25 11:46:24 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-62ae901d-27b8-4bd0-a4d8-a35d4d9285b7 tempest-VolumeRetypeWithoutMigrationTest-1618623951 None] Lock "cinder-3a3bb58a-7b0f-45f1-bf7c-d3d463cf9264-delete_volume" released by "delete_volume" :: held 2.111s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:46:31 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-ccb7ace8-2f80-41ff-bdb4-fcb6594f655b tempest-GroupSnapshotsV319Test-1123895286 None] Group tempest-GroupSnapshotsV319Test-Group-227189741: creating Sep 25 11:46:31 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-ccb7ace8-2f80-41ff-bdb4-fcb6594f655b tempest-GroupSnapshotsV319Test-1123895286 None] Group tempest-GroupSnapshotsV319Test-Group-227189741: created successfully Sep 25 11:46:31 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-ccb7ace8-2f80-41ff-bdb4-fcb6594f655b tempest-GroupSnapshotsV319Test-1123895286 None] Create group completed successfully. Sep 25 11:46:32 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbbe6efd-ce58-478f-aa10-6cca535d85a0 tempest-VolumesServicesTestJSON-1612499121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:46:32 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-dbbe6efd-ce58-478f-aa10-6cca535d85a0 tempest-VolumesServicesTestJSON-1612499121 None] Flow 'volume_create_manager' (7c3d2bf9-fd45-4ed4-87d0-ecb540c77e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:46:32 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-dbbe6efd-ce58-478f-aa10-6cca535d85a0 tempest-VolumesServicesTestJSON-1612499121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b54ddd4f-535b-4109-a628-f0e916ad07ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:46:32 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-dbbe6efd-ce58-478f-aa10-6cca535d85a0 tempest-VolumesServicesTestJSON-1612499121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b54ddd4f-535b-4109-a628-f0e916ad07ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:46:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1192837342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bded3cf-0811-4340-969e-542dff23d6e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10bc40dff5bf41da95c453a460f429b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:46:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:46:33Z,use_quota=True,user_id='5fd0bbd8d6f342b49921f234cb50b905',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:46:32 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-dbbe6efd-ce58-478f-aa10-6cca535d85a0 tempest-VolumesServicesTestJSON-1612499121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50e3138e-3ebb-48ab-b7f7-6f982d75091a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:46:32 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-dbbe6efd-ce58-478f-aa10-6cca535d85a0 tempest-VolumesServicesTestJSON-1612499121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50e3138e-3ebb-48ab-b7f7-6f982d75091a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:46:32 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-dbbe6efd-ce58-478f-aa10-6cca535d85a0 tempest-VolumesServicesTestJSON-1612499121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c06efa94-bd45-4469-8a65-0947d53d4906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:46:32 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-dbbe6efd-ce58-478f-aa10-6cca535d85a0 tempest-VolumesServicesTestJSON-1612499121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c06efa94-bd45-4469-8a65-0947d53d4906) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bded3cf-0811-4340-969e-542dff23d6e5', 'volume_name': 'volume-8bded3cf-0811-4340-969e-542dff23d6e5', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:46:32 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-dbbe6efd-ce58-478f-aa10-6cca535d85a0 tempest-VolumesServicesTestJSON-1612499121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (050a6051-cc1c-4c2a-a513-f3217ee63f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:46:32 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-dbbe6efd-ce58-478f-aa10-6cca535d85a0 tempest-VolumesServicesTestJSON-1612499121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (050a6051-cc1c-4c2a-a513-f3217ee63f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:46:32 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-dbbe6efd-ce58-478f-aa10-6cca535d85a0 tempest-VolumesServicesTestJSON-1612499121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c8a0ba6-e85c-441d-8201-f9641683440b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:46:32 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-dbbe6efd-ce58-478f-aa10-6cca535d85a0 tempest-VolumesServicesTestJSON-1612499121 None] Volume 8bded3cf-0811-4340-969e-542dff23d6e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bded3cf-0811-4340-969e-542dff23d6e5', 'volume_size': 1} Sep 25 11:46:32 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-dbbe6efd-ce58-478f-aa10-6cca535d85a0 tempest-VolumesServicesTestJSON-1612499121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:46:32 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-dbbe6efd-ce58-478f-aa10-6cca535d85a0 tempest-VolumesServicesTestJSON-1612499121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:46:32 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-dbbe6efd-ce58-478f-aa10-6cca535d85a0 tempest-VolumesServicesTestJSON-1612499121 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:46:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1192837342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bded3cf-0811-4340-969e-542dff23d6e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10bc40dff5bf41da95c453a460f429b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:46:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:46:33Z,use_quota=True,user_id='5fd0bbd8d6f342b49921f234cb50b905',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:46:32 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-dbbe6efd-ce58-478f-aa10-6cca535d85a0 tempest-VolumesServicesTestJSON-1612499121 None] Creating volume 8bded3cf-0811-4340-969e-542dff23d6e5 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:46:32 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-dbbe6efd-ce58-478f-aa10-6cca535d85a0 tempest-VolumesServicesTestJSON-1612499121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:46:32 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-dbbe6efd-ce58-478f-aa10-6cca535d85a0 tempest-VolumesServicesTestJSON-1612499121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:46:32 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-dbbe6efd-ce58-478f-aa10-6cca535d85a0 tempest-VolumesServicesTestJSON-1612499121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:46:32 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-dbbe6efd-ce58-478f-aa10-6cca535d85a0 tempest-VolumesServicesTestJSON-1612499121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:46:32 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-dbbe6efd-ce58-478f-aa10-6cca535d85a0 tempest-VolumesServicesTestJSON-1612499121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:46:32 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-dbbe6efd-ce58-478f-aa10-6cca535d85a0 tempest-VolumesServicesTestJSON-1612499121 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:46:32 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-dbbe6efd-ce58-478f-aa10-6cca535d85a0 tempest-VolumesServicesTestJSON-1612499121 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:46:32 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-dbbe6efd-ce58-478f-aa10-6cca535d85a0 tempest-VolumesServicesTestJSON-1612499121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8bded3cf-0811-4340-969e-542dff23d6e5 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:32 devstack sudo[97136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8bded3cf-0811-4340-969e-542dff23d6e5 1073741824 Sep 25 11:46:32 devstack sudo[97136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:33 devstack sudo[97136]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:33 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-dbbe6efd-ce58-478f-aa10-6cca535d85a0 tempest-VolumesServicesTestJSON-1612499121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8bded3cf-0811-4340-969e-542dff23d6e5 1073741824" returned: 0 in 0.751s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:33 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-dbbe6efd-ce58-478f-aa10-6cca535d85a0 tempest-VolumesServicesTestJSON-1612499121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8bded3cf-0811-4340-969e-542dff23d6e5 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:33 devstack sudo[97142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8bded3cf-0811-4340-969e-542dff23d6e5 Sep 25 11:46:33 devstack sudo[97142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:34 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d0bf70d-0ee1-498b-b9f2-8e80c2ef0603 tempest-GroupSnapshotsV319Test-1123895286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:46:34 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7d0bf70d-0ee1-498b-b9f2-8e80c2ef0603 tempest-GroupSnapshotsV319Test-1123895286 None] Flow 'volume_create_manager' (dcf9a99f-6e95-4d07-a940-5951422355a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:46:34 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7d0bf70d-0ee1-498b-b9f2-8e80c2ef0603 tempest-GroupSnapshotsV319Test-1123895286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd74cf5b-7f82-435b-9d05-7f249afd89b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:46:34 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7d0bf70d-0ee1-498b-b9f2-8e80c2ef0603 tempest-GroupSnapshotsV319Test-1123895286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd74cf5b-7f82-435b-9d05-7f249afd89b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:46:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-288450215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5b1cc246-b039-426e-be2b-c85398e76d41,host='devstack@QuobyteHD#QuobyteHD',id=69f28264-6eac-4c7e-a7b8-d573859b0b9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17ecf8891f904c2bb1eccc5ab69f1334',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:46:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:46:34Z,use_quota=True,user_id='39c16a8f28a44dc780d9db3e257690f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(260013ab-679a-489a-96c2-b30fc2c3b705),volume_type_id=260013ab-679a-489a-96c2-b30fc2c3b705)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:46:34 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7d0bf70d-0ee1-498b-b9f2-8e80c2ef0603 tempest-GroupSnapshotsV319Test-1123895286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (537d440b-3a92-4b8a-bd15-3ab9b3b03596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:46:34 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7d0bf70d-0ee1-498b-b9f2-8e80c2ef0603 tempest-GroupSnapshotsV319Test-1123895286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (537d440b-3a92-4b8a-bd15-3ab9b3b03596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:46:34 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7d0bf70d-0ee1-498b-b9f2-8e80c2ef0603 tempest-GroupSnapshotsV319Test-1123895286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f562a150-2f19-4f97-9227-8a4a94806140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:46:34 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7d0bf70d-0ee1-498b-b9f2-8e80c2ef0603 tempest-GroupSnapshotsV319Test-1123895286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f562a150-2f19-4f97-9227-8a4a94806140) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69f28264-6eac-4c7e-a7b8-d573859b0b9d', 'volume_name': 'volume-69f28264-6eac-4c7e-a7b8-d573859b0b9d', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:46:34 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7d0bf70d-0ee1-498b-b9f2-8e80c2ef0603 tempest-GroupSnapshotsV319Test-1123895286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b5270e0-b81e-497a-b4a6-c3fdcce7a0b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:46:34 devstack sudo[97142]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:34 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7d0bf70d-0ee1-498b-b9f2-8e80c2ef0603 tempest-GroupSnapshotsV319Test-1123895286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b5270e0-b81e-497a-b4a6-c3fdcce7a0b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:46:34 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7d0bf70d-0ee1-498b-b9f2-8e80c2ef0603 tempest-GroupSnapshotsV319Test-1123895286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90bfb150-5833-4e15-b026-80d6ba47fb6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:46:34 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-7d0bf70d-0ee1-498b-b9f2-8e80c2ef0603 tempest-GroupSnapshotsV319Test-1123895286 None] Volume 69f28264-6eac-4c7e-a7b8-d573859b0b9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69f28264-6eac-4c7e-a7b8-d573859b0b9d', 'volume_size': 1} Sep 25 11:46:34 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-7d0bf70d-0ee1-498b-b9f2-8e80c2ef0603 tempest-GroupSnapshotsV319Test-1123895286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:46:34 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-dbbe6efd-ce58-478f-aa10-6cca535d85a0 tempest-VolumesServicesTestJSON-1612499121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8bded3cf-0811-4340-969e-542dff23d6e5" returned: 0 in 0.471s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:34 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-dbbe6efd-ce58-478f-aa10-6cca535d85a0 tempest-VolumesServicesTestJSON-1612499121 None] <== create_volume: return (1334ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:46:34 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-dbbe6efd-ce58-478f-aa10-6cca535d85a0 tempest-VolumesServicesTestJSON-1612499121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.342s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:46:34 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-7d0bf70d-0ee1-498b-b9f2-8e80c2ef0603 tempest-GroupSnapshotsV319Test-1123895286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.013s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:46:34 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-7d0bf70d-0ee1-498b-b9f2-8e80c2ef0603 tempest-GroupSnapshotsV319Test-1123895286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5b1cc246-b039-426e-be2b-c85398e76d41,created_at=2026-09-25T09:46:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-288450215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5b1cc246-b039-426e-be2b-c85398e76d41,host='devstack@QuobyteHD#QuobyteHD',id=69f28264-6eac-4c7e-a7b8-d573859b0b9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17ecf8891f904c2bb1eccc5ab69f1334',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:46:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:46:34Z,use_quota=True,user_id='39c16a8f28a44dc780d9db3e257690f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(260013ab-679a-489a-96c2-b30fc2c3b705),volume_type_id=260013ab-679a-489a-96c2-b30fc2c3b705)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:46:34 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-7d0bf70d-0ee1-498b-b9f2-8e80c2ef0603 tempest-GroupSnapshotsV319Test-1123895286 None] Creating volume 69f28264-6eac-4c7e-a7b8-d573859b0b9d {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:46:34 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-7d0bf70d-0ee1-498b-b9f2-8e80c2ef0603 tempest-GroupSnapshotsV319Test-1123895286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:46:34 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-7d0bf70d-0ee1-498b-b9f2-8e80c2ef0603 tempest-GroupSnapshotsV319Test-1123895286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:46:34 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-7d0bf70d-0ee1-498b-b9f2-8e80c2ef0603 tempest-GroupSnapshotsV319Test-1123895286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:46:34 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-7d0bf70d-0ee1-498b-b9f2-8e80c2ef0603 tempest-GroupSnapshotsV319Test-1123895286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:46:34 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-7d0bf70d-0ee1-498b-b9f2-8e80c2ef0603 tempest-GroupSnapshotsV319Test-1123895286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:46:34 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-7d0bf70d-0ee1-498b-b9f2-8e80c2ef0603 tempest-GroupSnapshotsV319Test-1123895286 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:46:34 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-7d0bf70d-0ee1-498b-b9f2-8e80c2ef0603 tempest-GroupSnapshotsV319Test-1123895286 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:46:34 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7d0bf70d-0ee1-498b-b9f2-8e80c2ef0603 tempest-GroupSnapshotsV319Test-1123895286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-69f28264-6eac-4c7e-a7b8-d573859b0b9d 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:34 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-dbbe6efd-ce58-478f-aa10-6cca535d85a0 tempest-VolumesServicesTestJSON-1612499121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c8a0ba6-e85c-441d-8201-f9641683440b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bded3cf-0811-4340-969e-542dff23d6e5', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:46:34 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-dbbe6efd-ce58-478f-aa10-6cca535d85a0 tempest-VolumesServicesTestJSON-1612499121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fed884dd-eaa0-4881-b5f9-bdeb0929ec42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:46:34 devstack sudo[97145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-69f28264-6eac-4c7e-a7b8-d573859b0b9d 1073741824 Sep 25 11:46:34 devstack sudo[97145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:34 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-dbbe6efd-ce58-478f-aa10-6cca535d85a0 tempest-VolumesServicesTestJSON-1612499121 None] Volume volume-8bded3cf-0811-4340-969e-542dff23d6e5 (8bded3cf-0811-4340-969e-542dff23d6e5): created successfully Sep 25 11:46:34 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-dbbe6efd-ce58-478f-aa10-6cca535d85a0 tempest-VolumesServicesTestJSON-1612499121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fed884dd-eaa0-4881-b5f9-bdeb0929ec42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:46:34 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-dbbe6efd-ce58-478f-aa10-6cca535d85a0 tempest-VolumesServicesTestJSON-1612499121 None] Flow 'volume_create_manager' (7c3d2bf9-fd45-4ed4-87d0-ecb540c77e12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:46:34 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-dbbe6efd-ce58-478f-aa10-6cca535d85a0 tempest-VolumesServicesTestJSON-1612499121 None] Created volume successfully. Sep 25 11:46:34 devstack sudo[97145]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:34 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7d0bf70d-0ee1-498b-b9f2-8e80c2ef0603 tempest-GroupSnapshotsV319Test-1123895286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-69f28264-6eac-4c7e-a7b8-d573859b0b9d 1073741824" returned: 0 in 0.676s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:34 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7d0bf70d-0ee1-498b-b9f2-8e80c2ef0603 tempest-GroupSnapshotsV319Test-1123895286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-69f28264-6eac-4c7e-a7b8-d573859b0b9d {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:35 devstack sudo[97152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-69f28264-6eac-4c7e-a7b8-d573859b0b9d Sep 25 11:46:35 devstack sudo[97152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:35 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-89bfe1b4-0995-49d0-8558-aa1c07b03216 tempest-VolumesServicesTestJSON-1612499121 None] Acquiring lock "cinder-8bded3cf-0811-4340-969e-542dff23d6e5-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:46:35 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-89bfe1b4-0995-49d0-8558-aa1c07b03216 tempest-VolumesServicesTestJSON-1612499121 None] Lock "cinder-8bded3cf-0811-4340-969e-542dff23d6e5-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:46:35 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-89bfe1b4-0995-49d0-8558-aa1c07b03216 tempest-VolumesServicesTestJSON-1612499121 None] Acquiring lock "cinder-quobyte-8bded3cf-0811-4340-969e-542dff23d6e5" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:46:35 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-89bfe1b4-0995-49d0-8558-aa1c07b03216 tempest-VolumesServicesTestJSON-1612499121 None] Lock "cinder-quobyte-8bded3cf-0811-4340-969e-542dff23d6e5" acquired by "delete_volume" :: waited 0.024s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:46:35 devstack sudo[97152]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:35 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7d0bf70d-0ee1-498b-b9f2-8e80c2ef0603 tempest-GroupSnapshotsV319Test-1123895286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-69f28264-6eac-4c7e-a7b8-d573859b0b9d" returned: 0 in 0.498s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:35 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-7d0bf70d-0ee1-498b-b9f2-8e80c2ef0603 tempest-GroupSnapshotsV319Test-1123895286 None] <== create_volume: return (1248ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:46:35 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-7d0bf70d-0ee1-498b-b9f2-8e80c2ef0603 tempest-GroupSnapshotsV319Test-1123895286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.253s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:46:35 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c11350-7583-4f37-9a46-cab2a8444200]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:46:35 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-89bfe1b4-0995-49d0-8558-aa1c07b03216 tempest-VolumesServicesTestJSON-1612499121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8bded3cf-0811-4340-969e-542dff23d6e5 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:35 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7d0bf70d-0ee1-498b-b9f2-8e80c2ef0603 tempest-GroupSnapshotsV319Test-1123895286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90bfb150-5833-4e15-b026-80d6ba47fb6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69f28264-6eac-4c7e-a7b8-d573859b0b9d', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:46:35 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7d0bf70d-0ee1-498b-b9f2-8e80c2ef0603 tempest-GroupSnapshotsV319Test-1123895286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02e00f10-9cd2-43a9-b19d-e0a73df8ee87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:46:35 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-7d0bf70d-0ee1-498b-b9f2-8e80c2ef0603 tempest-GroupSnapshotsV319Test-1123895286 None] Volume volume-69f28264-6eac-4c7e-a7b8-d573859b0b9d (69f28264-6eac-4c7e-a7b8-d573859b0b9d): created successfully Sep 25 11:46:35 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7d0bf70d-0ee1-498b-b9f2-8e80c2ef0603 tempest-GroupSnapshotsV319Test-1123895286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02e00f10-9cd2-43a9-b19d-e0a73df8ee87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:46:35 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7d0bf70d-0ee1-498b-b9f2-8e80c2ef0603 tempest-GroupSnapshotsV319Test-1123895286 None] Flow 'volume_create_manager' (dcf9a99f-6e95-4d07-a940-5951422355a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:46:35 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-7d0bf70d-0ee1-498b-b9f2-8e80c2ef0603 tempest-GroupSnapshotsV319Test-1123895286 None] Created volume successfully. Sep 25 11:46:35 devstack sudo[97155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8bded3cf-0811-4340-969e-542dff23d6e5 Sep 25 11:46:35 devstack sudo[97155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:36 devstack sudo[97155]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:36 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-89bfe1b4-0995-49d0-8558-aa1c07b03216 tempest-VolumesServicesTestJSON-1612499121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8bded3cf-0811-4340-969e-542dff23d6e5" returned: 0 in 0.576s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:36 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-89bfe1b4-0995-49d0-8558-aa1c07b03216 tempest-VolumesServicesTestJSON-1612499121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8bded3cf-0811-4340-969e-542dff23d6e5 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:36 devstack sudo[97160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8bded3cf-0811-4340-969e-542dff23d6e5 Sep 25 11:46:36 devstack sudo[97160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:36 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6cf7982-8caa-4a3c-bd34-013f6ccc6720 tempest-VolumeTypesAccessTest-721480724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:46:36 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f6cf7982-8caa-4a3c-bd34-013f6ccc6720 tempest-VolumeTypesAccessTest-721480724 None] Flow 'volume_create_manager' (4a724c1d-3600-4c31-a173-c5d488bf1e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:46:36 devstack sudo[97160]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:36 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f6cf7982-8caa-4a3c-bd34-013f6ccc6720 tempest-VolumeTypesAccessTest-721480724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9066bcfa-3a94-4acc-be3a-0d4715ecf88e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:46:36 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-89bfe1b4-0995-49d0-8558-aa1c07b03216 tempest-VolumesServicesTestJSON-1612499121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8bded3cf-0811-4340-969e-542dff23d6e5" returned: 0 in 0.512s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:36 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f6cf7982-8caa-4a3c-bd34-013f6ccc6720 tempest-VolumeTypesAccessTest-721480724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9066bcfa-3a94-4acc-be3a-0d4715ecf88e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:46:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1390633396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ad13934-22fa-4cf6-a1ed-9dc5b1d47c0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e8e8437236546ac863a121ba080e766',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:46:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:46:36Z,use_quota=True,user_id='a164e43523eb4974ad34cdf406dc6340',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f9ea4fad-a40c-4860-8904-9430f60ddf14),volume_type_id=f9ea4fad-a40c-4860-8904-9430f60ddf14)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:46:36 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f6cf7982-8caa-4a3c-bd34-013f6ccc6720 tempest-VolumeTypesAccessTest-721480724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ac6b2eb-1b71-49e3-b2c0-aa951aaa122c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:46:36 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f6cf7982-8caa-4a3c-bd34-013f6ccc6720 tempest-VolumeTypesAccessTest-721480724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ac6b2eb-1b71-49e3-b2c0-aa951aaa122c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:46:36 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f6cf7982-8caa-4a3c-bd34-013f6ccc6720 tempest-VolumeTypesAccessTest-721480724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (328fc9b5-682b-412a-8d56-5a19b6f095c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:46:36 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f6cf7982-8caa-4a3c-bd34-013f6ccc6720 tempest-VolumeTypesAccessTest-721480724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (328fc9b5-682b-412a-8d56-5a19b6f095c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ad13934-22fa-4cf6-a1ed-9dc5b1d47c0e', 'volume_name': 'volume-8ad13934-22fa-4cf6-a1ed-9dc5b1d47c0e', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:46:36 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f6cf7982-8caa-4a3c-bd34-013f6ccc6720 tempest-VolumeTypesAccessTest-721480724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1160e91-0272-49e6-9829-9f5eb9b51224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:46:36 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f6cf7982-8caa-4a3c-bd34-013f6ccc6720 tempest-VolumeTypesAccessTest-721480724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1160e91-0272-49e6-9829-9f5eb9b51224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:46:36 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f6cf7982-8caa-4a3c-bd34-013f6ccc6720 tempest-VolumeTypesAccessTest-721480724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (991c4806-d490-4a8f-a815-54efe486d104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:46:36 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-f6cf7982-8caa-4a3c-bd34-013f6ccc6720 tempest-VolumeTypesAccessTest-721480724 None] Volume 8ad13934-22fa-4cf6-a1ed-9dc5b1d47c0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ad13934-22fa-4cf6-a1ed-9dc5b1d47c0e', 'volume_size': 1} Sep 25 11:46:36 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f6cf7982-8caa-4a3c-bd34-013f6ccc6720 tempest-VolumeTypesAccessTest-721480724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:46:36 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f6cf7982-8caa-4a3c-bd34-013f6ccc6720 tempest-VolumeTypesAccessTest-721480724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:46:36 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-f6cf7982-8caa-4a3c-bd34-013f6ccc6720 tempest-VolumeTypesAccessTest-721480724 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:46:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1390633396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ad13934-22fa-4cf6-a1ed-9dc5b1d47c0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e8e8437236546ac863a121ba080e766',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:46:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:46:36Z,use_quota=True,user_id='a164e43523eb4974ad34cdf406dc6340',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f9ea4fad-a40c-4860-8904-9430f60ddf14),volume_type_id=f9ea4fad-a40c-4860-8904-9430f60ddf14)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:46:36 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-f6cf7982-8caa-4a3c-bd34-013f6ccc6720 tempest-VolumeTypesAccessTest-721480724 None] Creating volume 8ad13934-22fa-4cf6-a1ed-9dc5b1d47c0e {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:46:36 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f6cf7982-8caa-4a3c-bd34-013f6ccc6720 tempest-VolumeTypesAccessTest-721480724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:46:36 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f6cf7982-8caa-4a3c-bd34-013f6ccc6720 tempest-VolumeTypesAccessTest-721480724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:46:36 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-f6cf7982-8caa-4a3c-bd34-013f6ccc6720 tempest-VolumeTypesAccessTest-721480724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:46:36 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-f6cf7982-8caa-4a3c-bd34-013f6ccc6720 tempest-VolumeTypesAccessTest-721480724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:46:36 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f6cf7982-8caa-4a3c-bd34-013f6ccc6720 tempest-VolumeTypesAccessTest-721480724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:46:36 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-f6cf7982-8caa-4a3c-bd34-013f6ccc6720 tempest-VolumeTypesAccessTest-721480724 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:46:36 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-f6cf7982-8caa-4a3c-bd34-013f6ccc6720 tempest-VolumeTypesAccessTest-721480724 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:46:36 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f6cf7982-8caa-4a3c-bd34-013f6ccc6720 tempest-VolumeTypesAccessTest-721480724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8ad13934-22fa-4cf6-a1ed-9dc5b1d47c0e 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:36 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-89bfe1b4-0995-49d0-8558-aa1c07b03216 tempest-VolumesServicesTestJSON-1612499121 None] Lock "cinder-quobyte-8bded3cf-0811-4340-969e-542dff23d6e5" released by "delete_volume" :: held 1.226s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:46:36 devstack sudo[97163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8ad13934-22fa-4cf6-a1ed-9dc5b1d47c0e 1073741824 Sep 25 11:46:36 devstack sudo[97163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:36 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-89bfe1b4-0995-49d0-8558-aa1c07b03216 tempest-VolumesServicesTestJSON-1612499121 None] Created reservations ['4ec391f9-ef4a-4925-a23c-dc5d462b0264', '2f7c9702-5ef4-406b-9016-9333539aff20', '432e837a-20f9-4b23-b599-697228ba5379', 'b9da3bf0-200d-43e5-9d26-717f03b8af79'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:46:36 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-89bfe1b4-0995-49d0-8558-aa1c07b03216 tempest-VolumesServicesTestJSON-1612499121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:46:36 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-89bfe1b4-0995-49d0-8558-aa1c07b03216 tempest-VolumesServicesTestJSON-1612499121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:46:36 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-89bfe1b4-0995-49d0-8558-aa1c07b03216 tempest-VolumesServicesTestJSON-1612499121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:46:36 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-89bfe1b4-0995-49d0-8558-aa1c07b03216 tempest-VolumesServicesTestJSON-1612499121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:46:36 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-89bfe1b4-0995-49d0-8558-aa1c07b03216 tempest-VolumesServicesTestJSON-1612499121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:46:36 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-89bfe1b4-0995-49d0-8558-aa1c07b03216 tempest-VolumesServicesTestJSON-1612499121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:36 devstack sudo[97165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:46:36 devstack sudo[97165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:37 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-f68ba844-59ed-4b2e-93ee-9015c0a342f0 tempest-GroupSnapshotsV319Test-1123895286 None] GroupSnapshot b02d4395-ef63-474c-af6a-0953d939cca7: creating. Sep 25 11:46:37 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f68ba844-59ed-4b2e-93ee-9015c0a342f0 tempest-GroupSnapshotsV319Test-1123895286 None] Group snapshot b02d4395-ef63-474c-af6a-0953d939cca7: creating. {{(pid=86984) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 25 11:46:37 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f68ba844-59ed-4b2e-93ee-9015c0a342f0 tempest-GroupSnapshotsV319Test-1123895286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:46:37 devstack sudo[97165]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:37 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-89bfe1b4-0995-49d0-8558-aa1c07b03216 tempest-VolumesServicesTestJSON-1612499121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.384s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:37 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-89bfe1b4-0995-49d0-8558-aa1c07b03216 tempest-VolumesServicesTestJSON-1612499121 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:46:37 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-89bfe1b4-0995-49d0-8558-aa1c07b03216 tempest-VolumesServicesTestJSON-1612499121 None] Deleted volume successfully. Sep 25 11:46:37 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-89bfe1b4-0995-49d0-8558-aa1c07b03216 tempest-VolumesServicesTestJSON-1612499121 None] Lock "cinder-8bded3cf-0811-4340-969e-542dff23d6e5-delete_volume" released by "delete_volume" :: held 2.025s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:46:37 devstack sudo[97163]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:37 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f6cf7982-8caa-4a3c-bd34-013f6ccc6720 tempest-VolumeTypesAccessTest-721480724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8ad13934-22fa-4cf6-a1ed-9dc5b1d47c0e 1073741824" returned: 0 in 0.750s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:37 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f6cf7982-8caa-4a3c-bd34-013f6ccc6720 tempest-VolumeTypesAccessTest-721480724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8ad13934-22fa-4cf6-a1ed-9dc5b1d47c0e {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:37 devstack sudo[97173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8ad13934-22fa-4cf6-a1ed-9dc5b1d47c0e Sep 25 11:46:37 devstack sudo[97173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:37 devstack sudo[97173]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:37 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f6cf7982-8caa-4a3c-bd34-013f6ccc6720 tempest-VolumeTypesAccessTest-721480724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8ad13934-22fa-4cf6-a1ed-9dc5b1d47c0e" returned: 0 in 0.292s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:37 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-f6cf7982-8caa-4a3c-bd34-013f6ccc6720 tempest-VolumeTypesAccessTest-721480724 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:46:37 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f6cf7982-8caa-4a3c-bd34-013f6ccc6720 tempest-VolumeTypesAccessTest-721480724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:46:37 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f68ba844-59ed-4b2e-93ee-9015c0a342f0 tempest-GroupSnapshotsV319Test-1123895286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.665s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:46:37 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f6cf7982-8caa-4a3c-bd34-013f6ccc6720 tempest-VolumeTypesAccessTest-721480724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (991c4806-d490-4a8f-a815-54efe486d104) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ad13934-22fa-4cf6-a1ed-9dc5b1d47c0e', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:46:37 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f6cf7982-8caa-4a3c-bd34-013f6ccc6720 tempest-VolumeTypesAccessTest-721480724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b99ef829-1bac-4f7b-860f-3662128fbd23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:46:37 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-f68ba844-59ed-4b2e-93ee-9015c0a342f0 tempest-GroupSnapshotsV319Test-1123895286 None] Creating offline snapshot b49a6312-cc03-42e7-9b95-69a96bd32587 of volume 69f28264-6eac-4c7e-a7b8-d573859b0b9d {{(pid=86984) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:46:37 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-f6cf7982-8caa-4a3c-bd34-013f6ccc6720 tempest-VolumeTypesAccessTest-721480724 None] Volume volume-8ad13934-22fa-4cf6-a1ed-9dc5b1d47c0e (8ad13934-22fa-4cf6-a1ed-9dc5b1d47c0e): created successfully Sep 25 11:46:37 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f6cf7982-8caa-4a3c-bd34-013f6ccc6720 tempest-VolumeTypesAccessTest-721480724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b99ef829-1bac-4f7b-860f-3662128fbd23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:46:37 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f6cf7982-8caa-4a3c-bd34-013f6ccc6720 tempest-VolumeTypesAccessTest-721480724 None] Flow 'volume_create_manager' (4a724c1d-3600-4c31-a173-c5d488bf1e14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:46:37 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc81088-6f4c-4d00-a631-79b40c5b5874]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:46:37 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f68ba844-59ed-4b2e-93ee-9015c0a342f0 tempest-GroupSnapshotsV319Test-1123895286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-69f28264-6eac-4c7e-a7b8-d573859b0b9d {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:37 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-f6cf7982-8caa-4a3c-bd34-013f6ccc6720 tempest-VolumeTypesAccessTest-721480724 None] Created volume successfully. Sep 25 11:46:37 devstack sudo[97176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-69f28264-6eac-4c7e-a7b8-d573859b0b9d Sep 25 11:46:37 devstack sudo[97176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:38 devstack sudo[97176]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f68ba844-59ed-4b2e-93ee-9015c0a342f0 tempest-GroupSnapshotsV319Test-1123895286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-69f28264-6eac-4c7e-a7b8-d573859b0b9d" returned: 0 in 0.474s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f68ba844-59ed-4b2e-93ee-9015c0a342f0 tempest-GroupSnapshotsV319Test-1123895286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-69f28264-6eac-4c7e-a7b8-d573859b0b9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-69f28264-6eac-4c7e-a7b8-d573859b0b9d.b49a6312-cc03-42e7-9b95-69a96bd32587 1G {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:38 devstack sudo[97182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-69f28264-6eac-4c7e-a7b8-d573859b0b9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-69f28264-6eac-4c7e-a7b8-d573859b0b9d.b49a6312-cc03-42e7-9b95-69a96bd32587 1G Sep 25 11:46:38 devstack sudo[97182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:38 devstack cinder-volume[86984]: DEBUG oslo_service.periodic_task [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:46:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:46:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:46:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:46:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:46:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:46:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:38 devstack sudo[97194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:46:38 devstack sudo[97194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:38 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-439bde2b-958f-45e8-8565-e2d91ed1e08e tempest-VolumeTypesAccessTest-721480724 None] Acquiring lock "cinder-8ad13934-22fa-4cf6-a1ed-9dc5b1d47c0e-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:46:38 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-439bde2b-958f-45e8-8565-e2d91ed1e08e tempest-VolumeTypesAccessTest-721480724 None] Lock "cinder-8ad13934-22fa-4cf6-a1ed-9dc5b1d47c0e-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:46:38 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-439bde2b-958f-45e8-8565-e2d91ed1e08e tempest-VolumeTypesAccessTest-721480724 None] Acquiring lock "cinder-quobyte-8ad13934-22fa-4cf6-a1ed-9dc5b1d47c0e" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:46:38 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-439bde2b-958f-45e8-8565-e2d91ed1e08e tempest-VolumeTypesAccessTest-721480724 None] Lock "cinder-quobyte-8ad13934-22fa-4cf6-a1ed-9dc5b1d47c0e" acquired by "delete_volume" :: waited 0.036s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:46:38 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[881565e5-56bd-4771-a37f-06aa1aa0f6a7]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:46:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-439bde2b-958f-45e8-8565-e2d91ed1e08e tempest-VolumeTypesAccessTest-721480724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8ad13934-22fa-4cf6-a1ed-9dc5b1d47c0e {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:38 devstack sudo[97182]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f68ba844-59ed-4b2e-93ee-9015c0a342f0 tempest-GroupSnapshotsV319Test-1123895286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-69f28264-6eac-4c7e-a7b8-d573859b0b9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-69f28264-6eac-4c7e-a7b8-d573859b0b9d.b49a6312-cc03-42e7-9b95-69a96bd32587 1G" returned: 0 in 0.640s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f68ba844-59ed-4b2e-93ee-9015c0a342f0 tempest-GroupSnapshotsV319Test-1123895286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69f28264-6eac-4c7e-a7b8-d573859b0b9d -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-69f28264-6eac-4c7e-a7b8-d573859b0b9d.b49a6312-cc03-42e7-9b95-69a96bd32587 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:39 devstack sudo[97197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69f28264-6eac-4c7e-a7b8-d573859b0b9d -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-69f28264-6eac-4c7e-a7b8-d573859b0b9d.b49a6312-cc03-42e7-9b95-69a96bd32587 Sep 25 11:46:39 devstack sudo[97197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:39 devstack sudo[97194]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.421s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:39 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:46:39 devstack cinder-volume[86984]: DEBUG oslo_service.periodic_task [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running periodic task VolumeManager._thread_info {{(pid=86984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:46:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] thread count: 28 {{(pid=86984) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 11:46:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] thread info: [<_MainThread(MainThread, started 132046492332160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86984) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 11:46:39 devstack sudo[97196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8ad13934-22fa-4cf6-a1ed-9dc5b1d47c0e Sep 25 11:46:39 devstack sudo[97196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:39 devstack sudo[97197]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f68ba844-59ed-4b2e-93ee-9015c0a342f0 tempest-GroupSnapshotsV319Test-1123895286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69f28264-6eac-4c7e-a7b8-d573859b0b9d -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-69f28264-6eac-4c7e-a7b8-d573859b0b9d.b49a6312-cc03-42e7-9b95-69a96bd32587" returned: 0 in 0.571s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:39 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-f68ba844-59ed-4b2e-93ee-9015c0a342f0 tempest-GroupSnapshotsV319Test-1123895286 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-69f28264-6eac-4c7e-a7b8-d573859b0b9d.b49a6312-cc03-42e7-9b95-69a96bd32587 is being set with open permissions: ugo+rw: NotImplementedError Sep 25 11:46:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f68ba844-59ed-4b2e-93ee-9015c0a342f0 tempest-GroupSnapshotsV319Test-1123895286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-69f28264-6eac-4c7e-a7b8-d573859b0b9d.b49a6312-cc03-42e7-9b95-69a96bd32587 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:39 devstack sudo[97196]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-439bde2b-958f-45e8-8565-e2d91ed1e08e tempest-VolumeTypesAccessTest-721480724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8ad13934-22fa-4cf6-a1ed-9dc5b1d47c0e" returned: 0 in 0.623s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-439bde2b-958f-45e8-8565-e2d91ed1e08e tempest-VolumeTypesAccessTest-721480724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8ad13934-22fa-4cf6-a1ed-9dc5b1d47c0e {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:39 devstack sudo[97209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-69f28264-6eac-4c7e-a7b8-d573859b0b9d.b49a6312-cc03-42e7-9b95-69a96bd32587 Sep 25 11:46:39 devstack sudo[97209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:39 devstack sudo[97210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8ad13934-22fa-4cf6-a1ed-9dc5b1d47c0e Sep 25 11:46:39 devstack sudo[97210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:39 devstack sudo[97209]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f68ba844-59ed-4b2e-93ee-9015c0a342f0 tempest-GroupSnapshotsV319Test-1123895286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-69f28264-6eac-4c7e-a7b8-d573859b0b9d.b49a6312-cc03-42e7-9b95-69a96bd32587" returned: 0 in 0.387s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:39 devstack sudo[97210]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-439bde2b-958f-45e8-8565-e2d91ed1e08e tempest-VolumeTypesAccessTest-721480724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8ad13934-22fa-4cf6-a1ed-9dc5b1d47c0e" returned: 0 in 0.376s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:39 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-439bde2b-958f-45e8-8565-e2d91ed1e08e tempest-VolumeTypesAccessTest-721480724 None] Lock "cinder-quobyte-8ad13934-22fa-4cf6-a1ed-9dc5b1d47c0e" released by "delete_volume" :: held 1.068s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:46:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f68ba844-59ed-4b2e-93ee-9015c0a342f0 tempest-GroupSnapshotsV319Test-1123895286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-69f28264-6eac-4c7e-a7b8-d573859b0b9d.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:40 devstack cinder-volume[86984]: WARNING cinder.quota [None req-439bde2b-958f-45e8-8565-e2d91ed1e08e tempest-VolumeTypesAccessTest-721480724 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-2099484119 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-2099484119, it is now deprecated. Please use the default quota class for default quota. Sep 25 11:46:40 devstack sudo[97215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-69f28264-6eac-4c7e-a7b8-d573859b0b9d.info Sep 25 11:46:40 devstack sudo[97215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:40 devstack cinder-volume[86984]: WARNING cinder.quota [None req-439bde2b-958f-45e8-8565-e2d91ed1e08e tempest-VolumeTypesAccessTest-721480724 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-2099484119 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-2099484119, it is now deprecated. Please use the default quota class for default quota. Sep 25 11:46:40 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-439bde2b-958f-45e8-8565-e2d91ed1e08e tempest-VolumeTypesAccessTest-721480724 None] Created reservations ['a42ec6fd-bc12-4fe2-8f5a-25b9a64e2d15', 'd367e70a-d359-4c85-9dc6-429848b0dd39', 'c041b777-4b30-4111-b99c-fc789b52a054', '365d6b8b-68c7-4c95-b9fd-7cd8171ac506'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:46:40 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-439bde2b-958f-45e8-8565-e2d91ed1e08e tempest-VolumeTypesAccessTest-721480724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:46:40 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-439bde2b-958f-45e8-8565-e2d91ed1e08e tempest-VolumeTypesAccessTest-721480724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:46:40 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-439bde2b-958f-45e8-8565-e2d91ed1e08e tempest-VolumeTypesAccessTest-721480724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:46:40 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-439bde2b-958f-45e8-8565-e2d91ed1e08e tempest-VolumeTypesAccessTest-721480724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:46:40 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-439bde2b-958f-45e8-8565-e2d91ed1e08e tempest-VolumeTypesAccessTest-721480724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:46:40 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-439bde2b-958f-45e8-8565-e2d91ed1e08e tempest-VolumeTypesAccessTest-721480724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:40 devstack sudo[97217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:46:40 devstack sudo[97217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:40 devstack sudo[97215]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:40 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f68ba844-59ed-4b2e-93ee-9015c0a342f0 tempest-GroupSnapshotsV319Test-1123895286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-69f28264-6eac-4c7e-a7b8-d573859b0b9d.info" returned: 0 in 0.374s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:40 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-f68ba844-59ed-4b2e-93ee-9015c0a342f0 tempest-GroupSnapshotsV319Test-1123895286 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-69f28264-6eac-4c7e-a7b8-d573859b0b9d.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 11:46:40 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f68ba844-59ed-4b2e-93ee-9015c0a342f0 tempest-GroupSnapshotsV319Test-1123895286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-69f28264-6eac-4c7e-a7b8-d573859b0b9d.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:40 devstack sudo[97220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-69f28264-6eac-4c7e-a7b8-d573859b0b9d.info Sep 25 11:46:40 devstack sudo[97220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:40 devstack sudo[97217]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:40 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-439bde2b-958f-45e8-8565-e2d91ed1e08e tempest-VolumeTypesAccessTest-721480724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.347s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:40 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-439bde2b-958f-45e8-8565-e2d91ed1e08e tempest-VolumeTypesAccessTest-721480724 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:46:40 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-439bde2b-958f-45e8-8565-e2d91ed1e08e tempest-VolumeTypesAccessTest-721480724 None] Deleted volume successfully. Sep 25 11:46:40 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-439bde2b-958f-45e8-8565-e2d91ed1e08e tempest-VolumeTypesAccessTest-721480724 None] Lock "cinder-8ad13934-22fa-4cf6-a1ed-9dc5b1d47c0e-delete_volume" released by "delete_volume" :: held 1.819s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:46:40 devstack sudo[97220]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:40 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f68ba844-59ed-4b2e-93ee-9015c0a342f0 tempest-GroupSnapshotsV319Test-1123895286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-69f28264-6eac-4c7e-a7b8-d573859b0b9d.info" returned: 0 in 0.403s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:40 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f68ba844-59ed-4b2e-93ee-9015c0a342f0 tempest-GroupSnapshotsV319Test-1123895286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.041s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:46:41 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-301c1f4f-a76e-49f3-9746-85d427963683 tempest-VolumesImageMetadata-835150206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:46:41 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-301c1f4f-a76e-49f3-9746-85d427963683 tempest-VolumesImageMetadata-835150206 None] Flow 'volume_create_manager' (2fe901b3-3202-4026-af60-57985da6370a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:46:41 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-301c1f4f-a76e-49f3-9746-85d427963683 tempest-VolumesImageMetadata-835150206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e8c67be-d390-4f41-bdd5-ca64fd61f607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:46:41 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-301c1f4f-a76e-49f3-9746-85d427963683 tempest-VolumesImageMetadata-835150206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e8c67be-d390-4f41-bdd5-ca64fd61f607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:46:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-683581357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf85c444-f693-47ba-9092-f1934c2c0590,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18329c119dbe43278a4294abf071f43e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:46:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:46:41Z,use_quota=True,user_id='8d276762b4b844318efd5f5291da0756',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:46:41 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-301c1f4f-a76e-49f3-9746-85d427963683 tempest-VolumesImageMetadata-835150206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4998c3d8-f689-4c1e-8dcb-9999bfa7e947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:46:41 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-301c1f4f-a76e-49f3-9746-85d427963683 tempest-VolumesImageMetadata-835150206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4998c3d8-f689-4c1e-8dcb-9999bfa7e947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:46:41 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-301c1f4f-a76e-49f3-9746-85d427963683 tempest-VolumesImageMetadata-835150206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14e399b0-d26f-448b-a7f0-d9350e268c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:46:41 devstack cinder-volume[86984]: DEBUG cinder.image.glance [None req-301c1f4f-a76e-49f3-9746-85d427963683 tempest-VolumesImageMetadata-835150206 None] Creating Keystone auth plugin from conf {{(pid=86984) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 11:46:41 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-f68ba844-59ed-4b2e-93ee-9015c0a342f0 tempest-GroupSnapshotsV319Test-1123895286 None] group_snapshot b02d4395-ef63-474c-af6a-0953d939cca7: created successfully Sep 25 11:46:41 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-301c1f4f-a76e-49f3-9746-85d427963683 tempest-VolumesImageMetadata-835150206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14e399b0-d26f-448b-a7f0-d9350e268c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cf85c444-f693-47ba-9092-f1934c2c0590', 'volume_name': 'volume-cf85c444-f693-47ba-9092-f1934c2c0590', 'volume_size': 1, 'image_id': 'd93b0aa8-e297-4aff-bb90-fe80872f8b63', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d93b0aa8-e297-4aff-bb90-fe80872f8b63', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a57d184bdf174982a6b60117d6d4a5b4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd93b0aa8-e297-4aff-bb90-fe80872f8b63', 'created_at': datetime.datetime(2026, 9, 25, 9, 31, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 31, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d93b0aa8-e297-4aff-bb90-fe80872f8b63/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:46:41 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-301c1f4f-a76e-49f3-9746-85d427963683 tempest-VolumesImageMetadata-835150206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de1b06b7-3d37-40f5-b8a8-29b438712dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:46:41 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-301c1f4f-a76e-49f3-9746-85d427963683 tempest-VolumesImageMetadata-835150206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de1b06b7-3d37-40f5-b8a8-29b438712dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:46:41 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-301c1f4f-a76e-49f3-9746-85d427963683 tempest-VolumesImageMetadata-835150206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3624d5cb-9992-435f-8ca0-36f70514abca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:46:41 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-301c1f4f-a76e-49f3-9746-85d427963683 tempest-VolumesImageMetadata-835150206 None] Volume cf85c444-f693-47ba-9092-f1934c2c0590: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cf85c444-f693-47ba-9092-f1934c2c0590', 'volume_size': 1, 'image_id': 'd93b0aa8-e297-4aff-bb90-fe80872f8b63', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d93b0aa8-e297-4aff-bb90-fe80872f8b63', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a57d184bdf174982a6b60117d6d4a5b4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd93b0aa8-e297-4aff-bb90-fe80872f8b63', 'created_at': datetime.datetime(2026, 9, 25, 9, 31, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 31, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d93b0aa8-e297-4aff-bb90-fe80872f8b63/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 25 11:46:41 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-301c1f4f-a76e-49f3-9746-85d427963683 tempest-VolumesImageMetadata-835150206 None] Trying to clone cf85c444-f693-47ba-9092-f1934c2c0590 from image d93b0aa8-e297-4aff-bb90-fe80872f8b63 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d93b0aa8-e297-4aff-bb90-fe80872f8b63', 'metadata': {}}]). {{(pid=86984) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 11:46:42 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-de7d4915-4574-4805-b7ef-6df9a1671400 tempest-GroupSnapshotsV319Test-1123895286 None] group_snapshot b02d4395-ef63-474c-af6a-0953d939cca7: deleting Sep 25 11:46:42 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-de7d4915-4574-4805-b7ef-6df9a1671400 tempest-GroupSnapshotsV319Test-1123895286 None] group_snapshot b02d4395-ef63-474c-af6a-0953d939cca7: deleting {{(pid=86984) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 25 11:46:42 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-de7d4915-4574-4805-b7ef-6df9a1671400 tempest-GroupSnapshotsV319Test-1123895286 None] Acquiring lock "cinder-quobyte-69f28264-6eac-4c7e-a7b8-d573859b0b9d" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:46:42 devstack cinder-volume[86984]: DEBUG cinder.image.image_utils [None req-301c1f4f-a76e-49f3-9746-85d427963683 tempest-VolumesImageMetadata-835150206 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d93b0aa8-e297-4aff-bb90-fe80872f8b63_7aktjto4devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86984) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 11:46:42 devstack cinder-volume[86984]: INFO cinder.image.image_utils [None req-301c1f4f-a76e-49f3-9746-85d427963683 tempest-VolumesImageMetadata-835150206 None] Image download 20.69 MB at 20.69 MB/s Sep 25 11:46:42 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-de7d4915-4574-4805-b7ef-6df9a1671400 tempest-GroupSnapshotsV319Test-1123895286 None] Lock "cinder-quobyte-69f28264-6eac-4c7e-a7b8-d573859b0b9d" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:46:42 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-de7d4915-4574-4805-b7ef-6df9a1671400 tempest-GroupSnapshotsV319Test-1123895286 None] Acquiring lock "cinder-quobyte-b49a6312-cc03-42e7-9b95-69a96bd32587" by "_delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:46:42 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-de7d4915-4574-4805-b7ef-6df9a1671400 tempest-GroupSnapshotsV319Test-1123895286 None] Lock "cinder-quobyte-b49a6312-cc03-42e7-9b95-69a96bd32587" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:46:42 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-de7d4915-4574-4805-b7ef-6df9a1671400 tempest-GroupSnapshotsV319Test-1123895286 None] Deleting offline snapshot b49a6312-cc03-42e7-9b95-69a96bd32587 of volume 69f28264-6eac-4c7e-a7b8-d573859b0b9d {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:46:42 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-de7d4915-4574-4805-b7ef-6df9a1671400 tempest-GroupSnapshotsV319Test-1123895286 None] snapshot_file for this snap is: volume-69f28264-6eac-4c7e-a7b8-d573859b0b9d.b49a6312-cc03-42e7-9b95-69a96bd32587 {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:46:42 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[2380908e-367d-44c8-8abf-d3c360cac0f8]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:46:42 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[050e9de1-150f-4fb3-940a-1b4534255281]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:46:42 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-de7d4915-4574-4805-b7ef-6df9a1671400 tempest-GroupSnapshotsV319Test-1123895286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-69f28264-6eac-4c7e-a7b8-d573859b0b9d.b49a6312-cc03-42e7-9b95-69a96bd32587 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:42 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-301c1f4f-a76e-49f3-9746-85d427963683 tempest-VolumesImageMetadata-835150206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d93b0aa8-e297-4aff-bb90-fe80872f8b63_7aktjto4devstack@QuobyteHD {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:42 devstack sudo[97227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d93b0aa8-e297-4aff-bb90-fe80872f8b63_7aktjto4devstack@QuobyteHD Sep 25 11:46:42 devstack sudo[97227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:42 devstack sudo[97226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-69f28264-6eac-4c7e-a7b8-d573859b0b9d.b49a6312-cc03-42e7-9b95-69a96bd32587 Sep 25 11:46:42 devstack sudo[97226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:43 devstack sudo[97227]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-301c1f4f-a76e-49f3-9746-85d427963683 tempest-VolumesImageMetadata-835150206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d93b0aa8-e297-4aff-bb90-fe80872f8b63_7aktjto4devstack@QuobyteHD" returned: 0 in 0.564s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:43 devstack cinder-volume[86984]: DEBUG cinder.image.image_utils [None req-301c1f4f-a76e-49f3-9746-85d427963683 tempest-VolumesImageMetadata-835150206 None] Temporary image d93b0aa8-e297-4aff-bb90-fe80872f8b63 is fetched for user 8d276762b4b844318efd5f5291da0756. {{(pid=86984) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 11:46:43 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca2c3d8d-b97b-4497-aa9b-1f260e160092]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:46:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-301c1f4f-a76e-49f3-9746-85d427963683 tempest-VolumesImageMetadata-835150206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d93b0aa8-e297-4aff-bb90-fe80872f8b63_7aktjto4devstack@QuobyteHD {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:43 devstack sudo[97226]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-de7d4915-4574-4805-b7ef-6df9a1671400 tempest-GroupSnapshotsV319Test-1123895286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-69f28264-6eac-4c7e-a7b8-d573859b0b9d.b49a6312-cc03-42e7-9b95-69a96bd32587" returned: 0 in 0.799s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:43 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-de7d4915-4574-4805-b7ef-6df9a1671400 tempest-GroupSnapshotsV319Test-1123895286 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69f28264-6eac-4c7e-a7b8-d573859b0b9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86984) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:46:43 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f93d7e3-ad35-466f-926e-fe9d4d62bbf5]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:46:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-de7d4915-4574-4805-b7ef-6df9a1671400 tempest-GroupSnapshotsV319Test-1123895286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-69f28264-6eac-4c7e-a7b8-d573859b0b9d {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:43 devstack sudo[97237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d93b0aa8-e297-4aff-bb90-fe80872f8b63_7aktjto4devstack@QuobyteHD Sep 25 11:46:43 devstack sudo[97237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:43 devstack sudo[97238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-69f28264-6eac-4c7e-a7b8-d573859b0b9d Sep 25 11:46:43 devstack sudo[97238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:43 devstack sudo[97237]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-301c1f4f-a76e-49f3-9746-85d427963683 tempest-VolumesImageMetadata-835150206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d93b0aa8-e297-4aff-bb90-fe80872f8b63_7aktjto4devstack@QuobyteHD" returned: 0 in 0.660s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-301c1f4f-a76e-49f3-9746-85d427963683 tempest-VolumesImageMetadata-835150206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:46:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-301c1f4f-a76e-49f3-9746-85d427963683 tempest-VolumesImageMetadata-835150206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:46:43 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-301c1f4f-a76e-49f3-9746-85d427963683 tempest-VolumesImageMetadata-835150206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:46:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-683581357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf85c444-f693-47ba-9092-f1934c2c0590,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18329c119dbe43278a4294abf071f43e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:46:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:46:41Z,use_quota=True,user_id='8d276762b4b844318efd5f5291da0756',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:46:43 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-301c1f4f-a76e-49f3-9746-85d427963683 tempest-VolumesImageMetadata-835150206 None] Creating volume cf85c444-f693-47ba-9092-f1934c2c0590 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:46:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-301c1f4f-a76e-49f3-9746-85d427963683 tempest-VolumesImageMetadata-835150206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:46:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-301c1f4f-a76e-49f3-9746-85d427963683 tempest-VolumesImageMetadata-835150206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:46:43 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-301c1f4f-a76e-49f3-9746-85d427963683 tempest-VolumesImageMetadata-835150206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:46:43 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-301c1f4f-a76e-49f3-9746-85d427963683 tempest-VolumesImageMetadata-835150206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:46:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-301c1f4f-a76e-49f3-9746-85d427963683 tempest-VolumesImageMetadata-835150206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:46:43 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-301c1f4f-a76e-49f3-9746-85d427963683 tempest-VolumesImageMetadata-835150206 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:46:43 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-301c1f4f-a76e-49f3-9746-85d427963683 tempest-VolumesImageMetadata-835150206 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:46:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-301c1f4f-a76e-49f3-9746-85d427963683 tempest-VolumesImageMetadata-835150206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-cf85c444-f693-47ba-9092-f1934c2c0590 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:43 devstack sudo[97282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-cf85c444-f693-47ba-9092-f1934c2c0590 1073741824 Sep 25 11:46:43 devstack sudo[97282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:44 devstack sudo[97238]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-de7d4915-4574-4805-b7ef-6df9a1671400 tempest-GroupSnapshotsV319Test-1123895286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-69f28264-6eac-4c7e-a7b8-d573859b0b9d" returned: 0 in 0.651s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-de7d4915-4574-4805-b7ef-6df9a1671400 tempest-GroupSnapshotsV319Test-1123895286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-69f28264-6eac-4c7e-a7b8-d573859b0b9d.b49a6312-cc03-42e7-9b95-69a96bd32587 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:44 devstack sudo[97284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-69f28264-6eac-4c7e-a7b8-d573859b0b9d.b49a6312-cc03-42e7-9b95-69a96bd32587 Sep 25 11:46:44 devstack sudo[97284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:44 devstack sudo[97284]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-de7d4915-4574-4805-b7ef-6df9a1671400 tempest-GroupSnapshotsV319Test-1123895286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-69f28264-6eac-4c7e-a7b8-d573859b0b9d.b49a6312-cc03-42e7-9b95-69a96bd32587" returned: 0 in 0.753s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-de7d4915-4574-4805-b7ef-6df9a1671400 tempest-GroupSnapshotsV319Test-1123895286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-69f28264-6eac-4c7e-a7b8-d573859b0b9d.b49a6312-cc03-42e7-9b95-69a96bd32587 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:44 devstack sudo[97295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-69f28264-6eac-4c7e-a7b8-d573859b0b9d.b49a6312-cc03-42e7-9b95-69a96bd32587 Sep 25 11:46:44 devstack sudo[97295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:44 devstack sudo[97282]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-301c1f4f-a76e-49f3-9746-85d427963683 tempest-VolumesImageMetadata-835150206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-cf85c444-f693-47ba-9092-f1934c2c0590 1073741824" returned: 0 in 1.020s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-301c1f4f-a76e-49f3-9746-85d427963683 tempest-VolumesImageMetadata-835150206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-cf85c444-f693-47ba-9092-f1934c2c0590 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:45 devstack sudo[97297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-cf85c444-f693-47ba-9092-f1934c2c0590 Sep 25 11:46:45 devstack sudo[97297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:45 devstack sudo[97295]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-de7d4915-4574-4805-b7ef-6df9a1671400 tempest-GroupSnapshotsV319Test-1123895286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-69f28264-6eac-4c7e-a7b8-d573859b0b9d.b49a6312-cc03-42e7-9b95-69a96bd32587" returned: 0 in 0.499s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:45 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-de7d4915-4574-4805-b7ef-6df9a1671400 tempest-GroupSnapshotsV319Test-1123895286 None] Lock "cinder-quobyte-b49a6312-cc03-42e7-9b95-69a96bd32587" released by "_delete_snapshot" :: held 2.920s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:46:45 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-de7d4915-4574-4805-b7ef-6df9a1671400 tempest-GroupSnapshotsV319Test-1123895286 None] Lock "cinder-quobyte-69f28264-6eac-4c7e-a7b8-d573859b0b9d" released by "delete_snapshot" :: held 2.954s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:46:45 devstack sudo[97297]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-301c1f4f-a76e-49f3-9746-85d427963683 tempest-VolumesImageMetadata-835150206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-cf85c444-f693-47ba-9092-f1934c2c0590" returned: 0 in 0.409s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:45 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-301c1f4f-a76e-49f3-9746-85d427963683 tempest-VolumesImageMetadata-835150206 None] <== create_volume: return (1534ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:46:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-301c1f4f-a76e-49f3-9746-85d427963683 tempest-VolumesImageMetadata-835150206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.538s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:46:45 devstack cinder-volume[86984]: DEBUG cinder.volume.volume_utils [None req-301c1f4f-a76e-49f3-9746-85d427963683 tempest-VolumesImageMetadata-835150206 None] Attempting download of d93b0aa8-e297-4aff-bb90-fe80872f8b63 ((None, [{'url': 'file:///opt/stack/data/glance/images/d93b0aa8-e297-4aff-bb90-fe80872f8b63', 'metadata': {}}])) to volume cf85c444-f693-47ba-9092-f1934c2c0590. {{(pid=86984) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 11:46:45 devstack cinder-volume[86984]: WARNING cinder.quota [None req-de7d4915-4574-4805-b7ef-6df9a1671400 tempest-GroupSnapshotsV319Test-1123895286 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-368652386 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-368652386, it is now deprecated. Please use the default quota class for default quota. Sep 25 11:46:45 devstack cinder-volume[86984]: WARNING cinder.quota [None req-de7d4915-4574-4805-b7ef-6df9a1671400 tempest-GroupSnapshotsV319Test-1123895286 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-368652386 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-368652386, it is now deprecated. Please use the default quota class for default quota. Sep 25 11:46:45 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-de7d4915-4574-4805-b7ef-6df9a1671400 tempest-GroupSnapshotsV319Test-1123895286 None] Created reservations ['9d863674-7d61-4627-8cb6-343ee8ecae83', '9501b301-2ea9-4128-8a19-7ee78a23aad6', '58348d34-f78a-49e9-91e2-87b3c2713790', '2e77adb9-5823-48c3-b393-535909db6b05'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:46:45 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d4897a-f142-49d8-8a7b-d108d9ab3b4d]: (4, 'raw') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:46:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-301c1f4f-a76e-49f3-9746-85d427963683 tempest-VolumesImageMetadata-835150206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d93b0aa8-e297-4aff-bb90-fe80872f8b63_7obmqivv {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:45 devstack sudo[97301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d93b0aa8-e297-4aff-bb90-fe80872f8b63_7obmqivv Sep 25 11:46:45 devstack sudo[97301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:45 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-de7d4915-4574-4805-b7ef-6df9a1671400 tempest-GroupSnapshotsV319Test-1123895286 None] group_snapshot b02d4395-ef63-474c-af6a-0953d939cca7: deleted successfully Sep 25 11:46:46 devstack sudo[97301]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-301c1f4f-a76e-49f3-9746-85d427963683 tempest-VolumesImageMetadata-835150206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d93b0aa8-e297-4aff-bb90-fe80872f8b63_7obmqivv" returned: 0 in 0.666s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-301c1f4f-a76e-49f3-9746-85d427963683 tempest-VolumesImageMetadata-835150206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d93b0aa8-e297-4aff-bb90-fe80872f8b63_7obmqivv {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:46 devstack sudo[97305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d93b0aa8-e297-4aff-bb90-fe80872f8b63_7obmqivv Sep 25 11:46:46 devstack sudo[97305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:46 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-772f27ae-574d-4e27-9017-da6c4550b614 tempest-GroupSnapshotsV319Test-1123895286 None] Acquiring lock "cinder-quobyte-69f28264-6eac-4c7e-a7b8-d573859b0b9d" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:46:46 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-772f27ae-574d-4e27-9017-da6c4550b614 tempest-GroupSnapshotsV319Test-1123895286 None] Lock "cinder-quobyte-69f28264-6eac-4c7e-a7b8-d573859b0b9d" acquired by "delete_volume" :: waited 0.038s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:46:46 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[c10912d4-c5d2-4e6c-bfa1-f95ba622169d]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:46:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-772f27ae-574d-4e27-9017-da6c4550b614 tempest-GroupSnapshotsV319Test-1123895286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-69f28264-6eac-4c7e-a7b8-d573859b0b9d {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:46 devstack sudo[97305]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-301c1f4f-a76e-49f3-9746-85d427963683 tempest-VolumesImageMetadata-835150206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d93b0aa8-e297-4aff-bb90-fe80872f8b63_7obmqivv" returned: 1 in 0.523s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-301c1f4f-a76e-49f3-9746-85d427963683 tempest-VolumesImageMetadata-835150206 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d93b0aa8-e297-4aff-bb90-fe80872f8b63_7obmqivv' failed. Not Retrying. {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 11:46:46 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7404a4-f0f8-4b08-ae56-ca1d460b161f]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:46:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-301c1f4f-a76e-49f3-9746-85d427963683 tempest-VolumesImageMetadata-835150206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d93b0aa8-e297-4aff-bb90-fe80872f8b63_7aktjto4devstack@QuobyteHD {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:46 devstack sudo[97307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-69f28264-6eac-4c7e-a7b8-d573859b0b9d Sep 25 11:46:46 devstack sudo[97307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:47 devstack sudo[97310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d93b0aa8-e297-4aff-bb90-fe80872f8b63_7aktjto4devstack@QuobyteHD Sep 25 11:46:47 devstack sudo[97310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:47 devstack sudo[97307]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-772f27ae-574d-4e27-9017-da6c4550b614 tempest-GroupSnapshotsV319Test-1123895286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-69f28264-6eac-4c7e-a7b8-d573859b0b9d" returned: 0 in 0.734s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-772f27ae-574d-4e27-9017-da6c4550b614 tempest-GroupSnapshotsV319Test-1123895286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-69f28264-6eac-4c7e-a7b8-d573859b0b9d {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:47 devstack sudo[97316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-69f28264-6eac-4c7e-a7b8-d573859b0b9d Sep 25 11:46:47 devstack sudo[97316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:47 devstack sudo[97310]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-301c1f4f-a76e-49f3-9746-85d427963683 tempest-VolumesImageMetadata-835150206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d93b0aa8-e297-4aff-bb90-fe80872f8b63_7aktjto4devstack@QuobyteHD" returned: 0 in 0.658s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:47 devstack cinder-volume[86984]: DEBUG cinder.image.image_utils [None req-301c1f4f-a76e-49f3-9746-85d427963683 tempest-VolumesImageMetadata-835150206 None] d93b0aa8-e297-4aff-bb90-fe80872f8b63 was qcow2, converting to qcow2 {{(pid=86984) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 11:46:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-301c1f4f-a76e-49f3-9746-85d427963683 tempest-VolumesImageMetadata-835150206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d93b0aa8-e297-4aff-bb90-fe80872f8b63_7aktjto4devstack@QuobyteHD /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-cf85c444-f693-47ba-9092-f1934c2c0590 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:47 devstack sudo[97321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d93b0aa8-e297-4aff-bb90-fe80872f8b63_7aktjto4devstack@QuobyteHD /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-cf85c444-f693-47ba-9092-f1934c2c0590 Sep 25 11:46:47 devstack sudo[97321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:47 devstack sudo[97316]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-772f27ae-574d-4e27-9017-da6c4550b614 tempest-GroupSnapshotsV319Test-1123895286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-69f28264-6eac-4c7e-a7b8-d573859b0b9d" returned: 0 in 0.551s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:47 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-772f27ae-574d-4e27-9017-da6c4550b614 tempest-GroupSnapshotsV319Test-1123895286 None] Lock "cinder-quobyte-69f28264-6eac-4c7e-a7b8-d573859b0b9d" released by "delete_volume" :: held 1.417s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:46:48 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-772f27ae-574d-4e27-9017-da6c4550b614 tempest-GroupSnapshotsV319Test-1123895286 None] Created reservations ['790a7e90-971c-4d9d-961d-e9c8b0088301'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:46:48 devstack cinder-volume[86984]: WARNING cinder.quota [None req-772f27ae-574d-4e27-9017-da6c4550b614 tempest-GroupSnapshotsV319Test-1123895286 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-368652386 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-368652386, it is now deprecated. Please use the default quota class for default quota. Sep 25 11:46:48 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-772f27ae-574d-4e27-9017-da6c4550b614 tempest-GroupSnapshotsV319Test-1123895286 None] Created reservations ['669edd49-2319-4ea5-bc38-0fcca27f682f', '511de10f-a51d-4d5c-8f04-1894e86e3fe9', 'b85b84ab-f2e4-48e6-97de-deb2f2271592', '30667b12-230c-4340-a94e-434ac0622dfd'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:46:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-772f27ae-574d-4e27-9017-da6c4550b614 tempest-GroupSnapshotsV319Test-1123895286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:46:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-772f27ae-574d-4e27-9017-da6c4550b614 tempest-GroupSnapshotsV319Test-1123895286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:46:48 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-772f27ae-574d-4e27-9017-da6c4550b614 tempest-GroupSnapshotsV319Test-1123895286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:46:48 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-772f27ae-574d-4e27-9017-da6c4550b614 tempest-GroupSnapshotsV319Test-1123895286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:46:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-772f27ae-574d-4e27-9017-da6c4550b614 tempest-GroupSnapshotsV319Test-1123895286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:46:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-772f27ae-574d-4e27-9017-da6c4550b614 tempest-GroupSnapshotsV319Test-1123895286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:48 devstack sudo[97329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:46:48 devstack sudo[97329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:48 devstack sudo[97329]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-772f27ae-574d-4e27-9017-da6c4550b614 tempest-GroupSnapshotsV319Test-1123895286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.408s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:48 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-772f27ae-574d-4e27-9017-da6c4550b614 tempest-GroupSnapshotsV319Test-1123895286 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:46:48 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-772f27ae-574d-4e27-9017-da6c4550b614 tempest-GroupSnapshotsV319Test-1123895286 None] Delete group completed successfully. Sep 25 11:46:50 devstack sudo[97321]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-301c1f4f-a76e-49f3-9746-85d427963683 tempest-VolumesImageMetadata-835150206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d93b0aa8-e297-4aff-bb90-fe80872f8b63_7aktjto4devstack@QuobyteHD /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-cf85c444-f693-47ba-9092-f1934c2c0590" returned: 0 in 3.330s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:50 devstack cinder-volume[86984]: DEBUG cinder.image.image_utils [None req-301c1f4f-a76e-49f3-9746-85d427963683 tempest-VolumesImageMetadata-835150206 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d93b0aa8-e297-4aff-bb90-fe80872f8b63_7aktjto4devstack@QuobyteHD, size 112.00 MB, duration 3.33 sec, destination /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-cf85c444-f693-47ba-9092-f1934c2c0590 {{(pid=86984) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 11:46:50 devstack cinder-volume[86984]: INFO cinder.image.image_utils [None req-301c1f4f-a76e-49f3-9746-85d427963683 tempest-VolumesImageMetadata-835150206 None] Converted 112.00 MB image at 33.62 MB/s Sep 25 11:46:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-301c1f4f-a76e-49f3-9746-85d427963683 tempest-VolumesImageMetadata-835150206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-cf85c444-f693-47ba-9092-f1934c2c0590 1G {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:50 devstack sudo[97333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-cf85c444-f693-47ba-9092-f1934c2c0590 1G Sep 25 11:46:50 devstack sudo[97333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:51 devstack sudo[97333]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-301c1f4f-a76e-49f3-9746-85d427963683 tempest-VolumesImageMetadata-835150206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-cf85c444-f693-47ba-9092-f1934c2c0590 1G" returned: 0 in 0.610s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:51 devstack cinder-volume[86984]: DEBUG cinder.volume.volume_utils [None req-301c1f4f-a76e-49f3-9746-85d427963683 tempest-VolumesImageMetadata-835150206 None] Downloaded image d93b0aa8-e297-4aff-bb90-fe80872f8b63 ((None, [{'url': 'file:///opt/stack/data/glance/images/d93b0aa8-e297-4aff-bb90-fe80872f8b63', 'metadata': {}}])) to volume cf85c444-f693-47ba-9092-f1934c2c0590 successfully. {{(pid=86984) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 11:46:51 devstack cinder-volume[86984]: DEBUG cinder.image.image_utils [None req-301c1f4f-a76e-49f3-9746-85d427963683 tempest-VolumesImageMetadata-835150206 None] Temporary image d93b0aa8-e297-4aff-bb90-fe80872f8b63 for user 8d276762b4b844318efd5f5291da0756 is deleted. {{(pid=86984) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 11:46:51 devstack cinder-volume[86984]: DEBUG cinder.volume.volume_utils [None req-301c1f4f-a76e-49f3-9746-85d427963683 tempest-VolumesImageMetadata-835150206 None] Marking volume cf85c444-f693-47ba-9092-f1934c2c0590 as bootable. {{(pid=86984) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 11:46:51 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-301c1f4f-a76e-49f3-9746-85d427963683 tempest-VolumesImageMetadata-835150206 None] Copying metadata from image d93b0aa8-e297-4aff-bb90-fe80872f8b63 to cf85c444-f693-47ba-9092-f1934c2c0590. {{(pid=86984) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 11:46:51 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-301c1f4f-a76e-49f3-9746-85d427963683 tempest-VolumesImageMetadata-835150206 None] Creating volume glance metadata for volume cf85c444-f693-47ba-9092-f1934c2c0590 backed by image d93b0aa8-e297-4aff-bb90-fe80872f8b63 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd93b0aa8-e297-4aff-bb90-fe80872f8b63', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86984) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 11:46:51 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-301c1f4f-a76e-49f3-9746-85d427963683 tempest-VolumesImageMetadata-835150206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3624d5cb-9992-435f-8ca0-36f70514abca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf85c444-f693-47ba-9092-f1934c2c0590', 'volume_size': 1, 'image_id': 'd93b0aa8-e297-4aff-bb90-fe80872f8b63', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d93b0aa8-e297-4aff-bb90-fe80872f8b63', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a57d184bdf174982a6b60117d6d4a5b4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd93b0aa8-e297-4aff-bb90-fe80872f8b63', 'created_at': datetime.datetime(2026, 9, 25, 9, 31, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 31, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d93b0aa8-e297-4aff-bb90-fe80872f8b63/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:46:51 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-301c1f4f-a76e-49f3-9746-85d427963683 tempest-VolumesImageMetadata-835150206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c7705cf-864e-4f90-9b32-a53ef7a7dd1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:46:51 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-301c1f4f-a76e-49f3-9746-85d427963683 tempest-VolumesImageMetadata-835150206 None] Volume volume-cf85c444-f693-47ba-9092-f1934c2c0590 (cf85c444-f693-47ba-9092-f1934c2c0590): created successfully Sep 25 11:46:51 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-301c1f4f-a76e-49f3-9746-85d427963683 tempest-VolumesImageMetadata-835150206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c7705cf-864e-4f90-9b32-a53ef7a7dd1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:46:51 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-301c1f4f-a76e-49f3-9746-85d427963683 tempest-VolumesImageMetadata-835150206 None] Flow 'volume_create_manager' (2fe901b3-3202-4026-af60-57985da6370a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:46:51 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-301c1f4f-a76e-49f3-9746-85d427963683 tempest-VolumesImageMetadata-835150206 None] Created volume successfully. Sep 25 11:46:53 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-227f10d1-b279-4686-9963-ee78004a8f96 tempest-VolumesImageMetadata-835150206 None] Acquiring lock "cinder-cf85c444-f693-47ba-9092-f1934c2c0590-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:46:53 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-227f10d1-b279-4686-9963-ee78004a8f96 tempest-VolumesImageMetadata-835150206 None] Lock "cinder-cf85c444-f693-47ba-9092-f1934c2c0590-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:46:53 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-227f10d1-b279-4686-9963-ee78004a8f96 tempest-VolumesImageMetadata-835150206 None] Acquiring lock "cinder-quobyte-cf85c444-f693-47ba-9092-f1934c2c0590" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:46:53 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-227f10d1-b279-4686-9963-ee78004a8f96 tempest-VolumesImageMetadata-835150206 None] Lock "cinder-quobyte-cf85c444-f693-47ba-9092-f1934c2c0590" acquired by "delete_volume" :: waited 0.039s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:46:53 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a9ee25-b20f-44a1-b1e5-deb4122397c1]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:46:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-227f10d1-b279-4686-9963-ee78004a8f96 tempest-VolumesImageMetadata-835150206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-cf85c444-f693-47ba-9092-f1934c2c0590 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:53 devstack sudo[97340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-cf85c444-f693-47ba-9092-f1934c2c0590 Sep 25 11:46:53 devstack sudo[97340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:54 devstack sudo[97340]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-227f10d1-b279-4686-9963-ee78004a8f96 tempest-VolumesImageMetadata-835150206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-cf85c444-f693-47ba-9092-f1934c2c0590" returned: 0 in 0.619s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-227f10d1-b279-4686-9963-ee78004a8f96 tempest-VolumesImageMetadata-835150206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-cf85c444-f693-47ba-9092-f1934c2c0590 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:54 devstack sudo[97345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-cf85c444-f693-47ba-9092-f1934c2c0590 Sep 25 11:46:54 devstack sudo[97345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:54 devstack sudo[97345]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-227f10d1-b279-4686-9963-ee78004a8f96 tempest-VolumesImageMetadata-835150206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-cf85c444-f693-47ba-9092-f1934c2c0590" returned: 0 in 0.403s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:54 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-227f10d1-b279-4686-9963-ee78004a8f96 tempest-VolumesImageMetadata-835150206 None] Lock "cinder-quobyte-cf85c444-f693-47ba-9092-f1934c2c0590" released by "delete_volume" :: held 1.116s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:46:54 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-227f10d1-b279-4686-9963-ee78004a8f96 tempest-VolumesImageMetadata-835150206 None] Created reservations ['f88c59e7-4e55-4b47-a4e3-09411dceb59b', '2b1f8265-354c-4a08-931a-ce2fd3e3ee1d', '2ae68181-ded3-447e-98b0-48527998e500', 'bf35ebd8-06ba-4f7b-9426-96f04527e1c0'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:46:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-227f10d1-b279-4686-9963-ee78004a8f96 tempest-VolumesImageMetadata-835150206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:46:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-227f10d1-b279-4686-9963-ee78004a8f96 tempest-VolumesImageMetadata-835150206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:46:54 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-227f10d1-b279-4686-9963-ee78004a8f96 tempest-VolumesImageMetadata-835150206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:46:54 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-227f10d1-b279-4686-9963-ee78004a8f96 tempest-VolumesImageMetadata-835150206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:46:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-227f10d1-b279-4686-9963-ee78004a8f96 tempest-VolumesImageMetadata-835150206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:46:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-227f10d1-b279-4686-9963-ee78004a8f96 tempest-VolumesImageMetadata-835150206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:54 devstack sudo[97348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:46:54 devstack sudo[97348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:55 devstack sudo[97348]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-227f10d1-b279-4686-9963-ee78004a8f96 tempest-VolumesImageMetadata-835150206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.418s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:55 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-227f10d1-b279-4686-9963-ee78004a8f96 tempest-VolumesImageMetadata-835150206 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:46:55 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-227f10d1-b279-4686-9963-ee78004a8f96 tempest-VolumesImageMetadata-835150206 None] Deleted volume successfully. Sep 25 11:46:55 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-227f10d1-b279-4686-9963-ee78004a8f96 tempest-VolumesImageMetadata-835150206 None] Lock "cinder-cf85c444-f693-47ba-9092-f1934c2c0590-delete_volume" released by "delete_volume" :: held 1.911s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:46:55 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-665a4293-a9cb-4eb0-9f68-9499d4c0f94e tempest-SnapshotMetadataTestJSON-538939080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:46:55 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-665a4293-a9cb-4eb0-9f68-9499d4c0f94e tempest-SnapshotMetadataTestJSON-538939080 None] Flow 'volume_create_manager' (365c4a14-fc4b-45fc-b255-823d8335c29e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:46:55 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-665a4293-a9cb-4eb0-9f68-9499d4c0f94e tempest-SnapshotMetadataTestJSON-538939080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb0c697a-2869-4ace-a668-f65980cf19f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:46:55 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-665a4293-a9cb-4eb0-9f68-9499d4c0f94e tempest-SnapshotMetadataTestJSON-538939080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb0c697a-2869-4ace-a668-f65980cf19f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:46:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1135600347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4214a67-6d5b-49f5-a026-f538cd527495,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c82c8617c8044cd7a76e9069c1c63aec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:46:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:46:55Z,use_quota=True,user_id='5f2068055a674aefa0cb70ade83d210d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:46:55 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-665a4293-a9cb-4eb0-9f68-9499d4c0f94e tempest-SnapshotMetadataTestJSON-538939080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d056e64-cc77-467f-a868-4d16d10314b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:46:55 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-665a4293-a9cb-4eb0-9f68-9499d4c0f94e tempest-SnapshotMetadataTestJSON-538939080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d056e64-cc77-467f-a868-4d16d10314b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:46:55 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-665a4293-a9cb-4eb0-9f68-9499d4c0f94e tempest-SnapshotMetadataTestJSON-538939080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04d19698-823a-4432-a4c7-0d420238d9dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:46:55 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-665a4293-a9cb-4eb0-9f68-9499d4c0f94e tempest-SnapshotMetadataTestJSON-538939080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04d19698-823a-4432-a4c7-0d420238d9dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4214a67-6d5b-49f5-a026-f538cd527495', 'volume_name': 'volume-f4214a67-6d5b-49f5-a026-f538cd527495', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:46:55 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-665a4293-a9cb-4eb0-9f68-9499d4c0f94e tempest-SnapshotMetadataTestJSON-538939080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06a56674-c0e4-462f-9c9c-7c3ba7f70d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:46:55 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-665a4293-a9cb-4eb0-9f68-9499d4c0f94e tempest-SnapshotMetadataTestJSON-538939080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06a56674-c0e4-462f-9c9c-7c3ba7f70d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:46:55 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-665a4293-a9cb-4eb0-9f68-9499d4c0f94e tempest-SnapshotMetadataTestJSON-538939080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58d3a18c-2fd9-4396-9644-ca8dcdc61ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:46:55 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-665a4293-a9cb-4eb0-9f68-9499d4c0f94e tempest-SnapshotMetadataTestJSON-538939080 None] Volume f4214a67-6d5b-49f5-a026-f538cd527495: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4214a67-6d5b-49f5-a026-f538cd527495', 'volume_size': 1} Sep 25 11:46:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-665a4293-a9cb-4eb0-9f68-9499d4c0f94e tempest-SnapshotMetadataTestJSON-538939080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:46:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-665a4293-a9cb-4eb0-9f68-9499d4c0f94e tempest-SnapshotMetadataTestJSON-538939080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:46:55 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-665a4293-a9cb-4eb0-9f68-9499d4c0f94e tempest-SnapshotMetadataTestJSON-538939080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:46:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1135600347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4214a67-6d5b-49f5-a026-f538cd527495,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c82c8617c8044cd7a76e9069c1c63aec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:46:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:46:55Z,use_quota=True,user_id='5f2068055a674aefa0cb70ade83d210d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:46:55 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-665a4293-a9cb-4eb0-9f68-9499d4c0f94e tempest-SnapshotMetadataTestJSON-538939080 None] Creating volume f4214a67-6d5b-49f5-a026-f538cd527495 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:46:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-665a4293-a9cb-4eb0-9f68-9499d4c0f94e tempest-SnapshotMetadataTestJSON-538939080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:46:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-665a4293-a9cb-4eb0-9f68-9499d4c0f94e tempest-SnapshotMetadataTestJSON-538939080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:46:55 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-665a4293-a9cb-4eb0-9f68-9499d4c0f94e tempest-SnapshotMetadataTestJSON-538939080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:46:55 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-665a4293-a9cb-4eb0-9f68-9499d4c0f94e tempest-SnapshotMetadataTestJSON-538939080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:46:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-665a4293-a9cb-4eb0-9f68-9499d4c0f94e tempest-SnapshotMetadataTestJSON-538939080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:46:55 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-665a4293-a9cb-4eb0-9f68-9499d4c0f94e tempest-SnapshotMetadataTestJSON-538939080 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:46:55 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-665a4293-a9cb-4eb0-9f68-9499d4c0f94e tempest-SnapshotMetadataTestJSON-538939080 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:46:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-665a4293-a9cb-4eb0-9f68-9499d4c0f94e tempest-SnapshotMetadataTestJSON-538939080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f4214a67-6d5b-49f5-a026-f538cd527495 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:55 devstack sudo[97351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f4214a67-6d5b-49f5-a026-f538cd527495 1073741824 Sep 25 11:46:55 devstack sudo[97351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:56 devstack sudo[97351]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:56 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-665a4293-a9cb-4eb0-9f68-9499d4c0f94e tempest-SnapshotMetadataTestJSON-538939080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f4214a67-6d5b-49f5-a026-f538cd527495 1073741824" returned: 0 in 0.676s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:56 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-665a4293-a9cb-4eb0-9f68-9499d4c0f94e tempest-SnapshotMetadataTestJSON-538939080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f4214a67-6d5b-49f5-a026-f538cd527495 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:56 devstack sudo[97357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f4214a67-6d5b-49f5-a026-f538cd527495 Sep 25 11:46:56 devstack sudo[97357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:56 devstack sudo[97357]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:56 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-665a4293-a9cb-4eb0-9f68-9499d4c0f94e tempest-SnapshotMetadataTestJSON-538939080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f4214a67-6d5b-49f5-a026-f538cd527495" returned: 0 in 0.315s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:56 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-665a4293-a9cb-4eb0-9f68-9499d4c0f94e tempest-SnapshotMetadataTestJSON-538939080 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:46:56 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-665a4293-a9cb-4eb0-9f68-9499d4c0f94e tempest-SnapshotMetadataTestJSON-538939080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:46:56 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-665a4293-a9cb-4eb0-9f68-9499d4c0f94e tempest-SnapshotMetadataTestJSON-538939080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58d3a18c-2fd9-4396-9644-ca8dcdc61ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4214a67-6d5b-49f5-a026-f538cd527495', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:46:56 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-665a4293-a9cb-4eb0-9f68-9499d4c0f94e tempest-SnapshotMetadataTestJSON-538939080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e5f9de5-6bb4-49fb-ad78-fe268df7095e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:46:56 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-665a4293-a9cb-4eb0-9f68-9499d4c0f94e tempest-SnapshotMetadataTestJSON-538939080 None] Volume volume-f4214a67-6d5b-49f5-a026-f538cd527495 (f4214a67-6d5b-49f5-a026-f538cd527495): created successfully Sep 25 11:46:56 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-665a4293-a9cb-4eb0-9f68-9499d4c0f94e tempest-SnapshotMetadataTestJSON-538939080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e5f9de5-6bb4-49fb-ad78-fe268df7095e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:46:56 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-665a4293-a9cb-4eb0-9f68-9499d4c0f94e tempest-SnapshotMetadataTestJSON-538939080 None] Flow 'volume_create_manager' (365c4a14-fc4b-45fc-b255-823d8335c29e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:46:56 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-665a4293-a9cb-4eb0-9f68-9499d4c0f94e tempest-SnapshotMetadataTestJSON-538939080 None] Created volume successfully. Sep 25 11:46:58 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-1a8e4fd9-58cc-4d6b-a85e-5881e685a259 tempest-SnapshotMetadataTestJSON-538939080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:46:58 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-1a8e4fd9-58cc-4d6b-a85e-5881e685a259 tempest-SnapshotMetadataTestJSON-538939080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:46:58 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-1a8e4fd9-58cc-4d6b-a85e-5881e685a259 tempest-SnapshotMetadataTestJSON-538939080 None] Creating offline snapshot 26a972cf-5d2f-439c-bcb5-475117ff6e4d of volume f4214a67-6d5b-49f5-a026-f538cd527495 {{(pid=86984) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:46:58 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a03055-3f89-4c00-967c-c6ebbc9a6afe]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:46:58 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-1a8e4fd9-58cc-4d6b-a85e-5881e685a259 tempest-SnapshotMetadataTestJSON-538939080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f4214a67-6d5b-49f5-a026-f538cd527495 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:58 devstack sudo[97360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f4214a67-6d5b-49f5-a026-f538cd527495 Sep 25 11:46:58 devstack sudo[97360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:58 devstack sudo[97360]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:58 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-1a8e4fd9-58cc-4d6b-a85e-5881e685a259 tempest-SnapshotMetadataTestJSON-538939080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f4214a67-6d5b-49f5-a026-f538cd527495" returned: 0 in 0.558s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:58 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-1a8e4fd9-58cc-4d6b-a85e-5881e685a259 tempest-SnapshotMetadataTestJSON-538939080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f4214a67-6d5b-49f5-a026-f538cd527495,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f4214a67-6d5b-49f5-a026-f538cd527495.26a972cf-5d2f-439c-bcb5-475117ff6e4d 1G {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:58 devstack sudo[97365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f4214a67-6d5b-49f5-a026-f538cd527495,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f4214a67-6d5b-49f5-a026-f538cd527495.26a972cf-5d2f-439c-bcb5-475117ff6e4d 1G Sep 25 11:46:58 devstack sudo[97365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:59 devstack sudo[97365]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:59 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-1a8e4fd9-58cc-4d6b-a85e-5881e685a259 tempest-SnapshotMetadataTestJSON-538939080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f4214a67-6d5b-49f5-a026-f538cd527495,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f4214a67-6d5b-49f5-a026-f538cd527495.26a972cf-5d2f-439c-bcb5-475117ff6e4d 1G" returned: 0 in 0.630s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:59 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-1a8e4fd9-58cc-4d6b-a85e-5881e685a259 tempest-SnapshotMetadataTestJSON-538939080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4214a67-6d5b-49f5-a026-f538cd527495 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f4214a67-6d5b-49f5-a026-f538cd527495.26a972cf-5d2f-439c-bcb5-475117ff6e4d {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:59 devstack sudo[97371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4214a67-6d5b-49f5-a026-f538cd527495 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f4214a67-6d5b-49f5-a026-f538cd527495.26a972cf-5d2f-439c-bcb5-475117ff6e4d Sep 25 11:46:59 devstack sudo[97371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:46:59 devstack sudo[97371]: pam_unix(sudo:session): session closed for user root Sep 25 11:46:59 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-1a8e4fd9-58cc-4d6b-a85e-5881e685a259 tempest-SnapshotMetadataTestJSON-538939080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4214a67-6d5b-49f5-a026-f538cd527495 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f4214a67-6d5b-49f5-a026-f538cd527495.26a972cf-5d2f-439c-bcb5-475117ff6e4d" returned: 0 in 0.449s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:46:59 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-1a8e4fd9-58cc-4d6b-a85e-5881e685a259 tempest-SnapshotMetadataTestJSON-538939080 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f4214a67-6d5b-49f5-a026-f538cd527495.26a972cf-5d2f-439c-bcb5-475117ff6e4d is being set with open permissions: ugo+rw Sep 25 11:46:59 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-1a8e4fd9-58cc-4d6b-a85e-5881e685a259 tempest-SnapshotMetadataTestJSON-538939080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f4214a67-6d5b-49f5-a026-f538cd527495.26a972cf-5d2f-439c-bcb5-475117ff6e4d {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:46:59 devstack sudo[97377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f4214a67-6d5b-49f5-a026-f538cd527495.26a972cf-5d2f-439c-bcb5-475117ff6e4d Sep 25 11:46:59 devstack sudo[97377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:00 devstack sudo[97377]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:00 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-1a8e4fd9-58cc-4d6b-a85e-5881e685a259 tempest-SnapshotMetadataTestJSON-538939080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f4214a67-6d5b-49f5-a026-f538cd527495.26a972cf-5d2f-439c-bcb5-475117ff6e4d" returned: 0 in 0.401s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:00 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-1a8e4fd9-58cc-4d6b-a85e-5881e685a259 tempest-SnapshotMetadataTestJSON-538939080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f4214a67-6d5b-49f5-a026-f538cd527495.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:00 devstack sudo[97380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f4214a67-6d5b-49f5-a026-f538cd527495.info Sep 25 11:47:00 devstack sudo[97380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:00 devstack sudo[97380]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:00 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-1a8e4fd9-58cc-4d6b-a85e-5881e685a259 tempest-SnapshotMetadataTestJSON-538939080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f4214a67-6d5b-49f5-a026-f538cd527495.info" returned: 0 in 0.387s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:00 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-1a8e4fd9-58cc-4d6b-a85e-5881e685a259 tempest-SnapshotMetadataTestJSON-538939080 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f4214a67-6d5b-49f5-a026-f538cd527495.info is being set with open permissions: ugo+rw Sep 25 11:47:00 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-1a8e4fd9-58cc-4d6b-a85e-5881e685a259 tempest-SnapshotMetadataTestJSON-538939080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f4214a67-6d5b-49f5-a026-f538cd527495.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:00 devstack sudo[97383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f4214a67-6d5b-49f5-a026-f538cd527495.info Sep 25 11:47:00 devstack sudo[97383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:01 devstack sudo[97383]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:01 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-1a8e4fd9-58cc-4d6b-a85e-5881e685a259 tempest-SnapshotMetadataTestJSON-538939080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f4214a67-6d5b-49f5-a026-f538cd527495.info" returned: 0 in 0.380s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:01 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-1a8e4fd9-58cc-4d6b-a85e-5881e685a259 tempest-SnapshotMetadataTestJSON-538939080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.002s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:47:01 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-1a8e4fd9-58cc-4d6b-a85e-5881e685a259 tempest-SnapshotMetadataTestJSON-538939080 None] Create snapshot completed successfully Sep 25 11:47:01 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-89f2e376-e10f-417a-8d20-83728848b813 tempest-GroupsTest-2040236940 None] Group tempest-Group1-1377229863: creating Sep 25 11:47:01 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-89f2e376-e10f-417a-8d20-83728848b813 tempest-GroupsTest-2040236940 None] Group tempest-Group1-1377229863: created successfully Sep 25 11:47:01 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-89f2e376-e10f-417a-8d20-83728848b813 tempest-GroupsTest-2040236940 None] Create group completed successfully. Sep 25 11:47:03 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-89f85111-08d7-4f58-87d8-31781791d46c tempest-GroupsTest-2040236940 None] Group tempest-Group2-178471116: creating Sep 25 11:47:03 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-89f85111-08d7-4f58-87d8-31781791d46c tempest-GroupsTest-2040236940 None] Group tempest-Group2-178471116: created successfully Sep 25 11:47:03 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-89f85111-08d7-4f58-87d8-31781791d46c tempest-GroupsTest-2040236940 None] Create group completed successfully. Sep 25 11:47:03 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-7e335fda-f991-44f3-9a1a-b9d0ac42b22b tempest-SnapshotMetadataTestJSON-538939080 None] Acquiring lock "cinder-26a972cf-5d2f-439c-bcb5-475117ff6e4d-delete_snapshot" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:47:03 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-7e335fda-f991-44f3-9a1a-b9d0ac42b22b tempest-SnapshotMetadataTestJSON-538939080 None] Lock "cinder-26a972cf-5d2f-439c-bcb5-475117ff6e4d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:47:03 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-7e335fda-f991-44f3-9a1a-b9d0ac42b22b tempest-SnapshotMetadataTestJSON-538939080 None] Acquiring lock "cinder-quobyte-f4214a67-6d5b-49f5-a026-f538cd527495" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:47:03 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-7e335fda-f991-44f3-9a1a-b9d0ac42b22b tempest-SnapshotMetadataTestJSON-538939080 None] Lock "cinder-quobyte-f4214a67-6d5b-49f5-a026-f538cd527495" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:47:03 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-7e335fda-f991-44f3-9a1a-b9d0ac42b22b tempest-SnapshotMetadataTestJSON-538939080 None] Acquiring lock "cinder-quobyte-26a972cf-5d2f-439c-bcb5-475117ff6e4d" by "_delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:47:03 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-7e335fda-f991-44f3-9a1a-b9d0ac42b22b tempest-SnapshotMetadataTestJSON-538939080 None] Lock "cinder-quobyte-26a972cf-5d2f-439c-bcb5-475117ff6e4d" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:47:03 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-7e335fda-f991-44f3-9a1a-b9d0ac42b22b tempest-SnapshotMetadataTestJSON-538939080 None] Deleting offline snapshot 26a972cf-5d2f-439c-bcb5-475117ff6e4d of volume f4214a67-6d5b-49f5-a026-f538cd527495 {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:47:03 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-7e335fda-f991-44f3-9a1a-b9d0ac42b22b tempest-SnapshotMetadataTestJSON-538939080 None] snapshot_file for this snap is: volume-f4214a67-6d5b-49f5-a026-f538cd527495.26a972cf-5d2f-439c-bcb5-475117ff6e4d {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:47:03 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[13aeab28-db63-4496-b5e9-6d1bec9300f0]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:47:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7e335fda-f991-44f3-9a1a-b9d0ac42b22b tempest-SnapshotMetadataTestJSON-538939080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f4214a67-6d5b-49f5-a026-f538cd527495.26a972cf-5d2f-439c-bcb5-475117ff6e4d {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:03 devstack sudo[97387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f4214a67-6d5b-49f5-a026-f538cd527495.26a972cf-5d2f-439c-bcb5-475117ff6e4d Sep 25 11:47:03 devstack sudo[97387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:04 devstack sudo[97387]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:04 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7e335fda-f991-44f3-9a1a-b9d0ac42b22b tempest-SnapshotMetadataTestJSON-538939080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f4214a67-6d5b-49f5-a026-f538cd527495.26a972cf-5d2f-439c-bcb5-475117ff6e4d" returned: 0 in 0.520s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:04 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-7e335fda-f991-44f3-9a1a-b9d0ac42b22b tempest-SnapshotMetadataTestJSON-538939080 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4214a67-6d5b-49f5-a026-f538cd527495(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86984) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:47:04 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd0c2b4-8fde-4155-9f3c-5a985b76f6dd]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:47:04 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7e335fda-f991-44f3-9a1a-b9d0ac42b22b tempest-SnapshotMetadataTestJSON-538939080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f4214a67-6d5b-49f5-a026-f538cd527495 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:04 devstack sudo[97393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f4214a67-6d5b-49f5-a026-f538cd527495 Sep 25 11:47:04 devstack sudo[97393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:04 devstack sudo[97393]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:04 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7e335fda-f991-44f3-9a1a-b9d0ac42b22b tempest-SnapshotMetadataTestJSON-538939080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f4214a67-6d5b-49f5-a026-f538cd527495" returned: 0 in 0.657s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:04 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7e335fda-f991-44f3-9a1a-b9d0ac42b22b tempest-SnapshotMetadataTestJSON-538939080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f4214a67-6d5b-49f5-a026-f538cd527495.26a972cf-5d2f-439c-bcb5-475117ff6e4d {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:04 devstack sudo[97398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f4214a67-6d5b-49f5-a026-f538cd527495.26a972cf-5d2f-439c-bcb5-475117ff6e4d Sep 25 11:47:04 devstack sudo[97398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:05 devstack cinder-volume[86984]: DEBUG dbcounter [-] [86984] Writing DB stats cinder:UPDATE=104,cinder:DELETE=9,cinder:SELECT=89,cinder:INSERT=33 {{(pid=86984) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:47:05 devstack cinder-volume[86984]: DEBUG dbcounter [-] [86984] Writing DB stats cinder:UPDATE=110,cinder:SELECT=106,cinder:INSERT=27,cinder:DELETE=7 {{(pid=86984) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:47:05 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d18f817-1200-415a-a755-a9b112fcd8c7 tempest-GroupsTest-2040236940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:47:05 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7d18f817-1200-415a-a755-a9b112fcd8c7 tempest-GroupsTest-2040236940 None] Flow 'volume_create_manager' (e9961bab-6b7c-4635-b462-435ac5f1004a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:47:05 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7d18f817-1200-415a-a755-a9b112fcd8c7 tempest-GroupsTest-2040236940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76c96c0a-26ad-43ae-a42b-bc025f56554f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:05 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7d18f817-1200-415a-a755-a9b112fcd8c7 tempest-GroupsTest-2040236940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76c96c0a-26ad-43ae-a42b-bc025f56554f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:47:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-995525001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=019840eb-8c84-440e-b002-af606855ee0a,host='devstack@QuobyteHD#QuobyteHD',id=0dfea76a-7626-4184-a8da-60d722451c11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53c4d217802f44399201425b30bc3f36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:47:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:47:05Z,use_quota=True,user_id='724dfc15fb7c48b2b3755cb728de8b50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcbe480-7fdc-462f-9b64-2218728bb613),volume_type_id=ebcbe480-7fdc-462f-9b64-2218728bb613)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:05 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7d18f817-1200-415a-a755-a9b112fcd8c7 tempest-GroupsTest-2040236940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95f88083-6c87-4482-b869-5441bfcee120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:05 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7d18f817-1200-415a-a755-a9b112fcd8c7 tempest-GroupsTest-2040236940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95f88083-6c87-4482-b869-5441bfcee120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:05 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7d18f817-1200-415a-a755-a9b112fcd8c7 tempest-GroupsTest-2040236940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (521d4718-d06b-4d1a-a556-b9d30148cbb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:05 devstack sudo[97398]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:05 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7d18f817-1200-415a-a755-a9b112fcd8c7 tempest-GroupsTest-2040236940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (521d4718-d06b-4d1a-a556-b9d30148cbb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0dfea76a-7626-4184-a8da-60d722451c11', 'volume_name': 'volume-0dfea76a-7626-4184-a8da-60d722451c11', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:05 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7d18f817-1200-415a-a755-a9b112fcd8c7 tempest-GroupsTest-2040236940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33115ddb-58e4-45c8-8a75-f7e21bd60ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:05 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7d18f817-1200-415a-a755-a9b112fcd8c7 tempest-GroupsTest-2040236940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33115ddb-58e4-45c8-8a75-f7e21bd60ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:05 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7d18f817-1200-415a-a755-a9b112fcd8c7 tempest-GroupsTest-2040236940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aec48892-cbbe-456c-975a-bad03f3a6f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:05 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-7d18f817-1200-415a-a755-a9b112fcd8c7 tempest-GroupsTest-2040236940 None] Volume 0dfea76a-7626-4184-a8da-60d722451c11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0dfea76a-7626-4184-a8da-60d722451c11', 'volume_size': 1} Sep 25 11:47:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-7d18f817-1200-415a-a755-a9b112fcd8c7 tempest-GroupsTest-2040236940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:47:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-7d18f817-1200-415a-a755-a9b112fcd8c7 tempest-GroupsTest-2040236940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:47:05 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-7d18f817-1200-415a-a755-a9b112fcd8c7 tempest-GroupsTest-2040236940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=019840eb-8c84-440e-b002-af606855ee0a,created_at=2026-09-25T09:47:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-995525001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=019840eb-8c84-440e-b002-af606855ee0a,host='devstack@QuobyteHD#QuobyteHD',id=0dfea76a-7626-4184-a8da-60d722451c11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53c4d217802f44399201425b30bc3f36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:47:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:47:05Z,use_quota=True,user_id='724dfc15fb7c48b2b3755cb728de8b50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcbe480-7fdc-462f-9b64-2218728bb613),volume_type_id=ebcbe480-7fdc-462f-9b64-2218728bb613)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:47:05 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-7d18f817-1200-415a-a755-a9b112fcd8c7 tempest-GroupsTest-2040236940 None] Creating volume 0dfea76a-7626-4184-a8da-60d722451c11 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:47:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-7d18f817-1200-415a-a755-a9b112fcd8c7 tempest-GroupsTest-2040236940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:47:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-7d18f817-1200-415a-a755-a9b112fcd8c7 tempest-GroupsTest-2040236940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:47:05 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-7d18f817-1200-415a-a755-a9b112fcd8c7 tempest-GroupsTest-2040236940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:47:05 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-7d18f817-1200-415a-a755-a9b112fcd8c7 tempest-GroupsTest-2040236940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:47:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-7d18f817-1200-415a-a755-a9b112fcd8c7 tempest-GroupsTest-2040236940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:47:05 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-7d18f817-1200-415a-a755-a9b112fcd8c7 tempest-GroupsTest-2040236940 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:47:05 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-7d18f817-1200-415a-a755-a9b112fcd8c7 tempest-GroupsTest-2040236940 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:47:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7d18f817-1200-415a-a755-a9b112fcd8c7 tempest-GroupsTest-2040236940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0dfea76a-7626-4184-a8da-60d722451c11 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7e335fda-f991-44f3-9a1a-b9d0ac42b22b tempest-SnapshotMetadataTestJSON-538939080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f4214a67-6d5b-49f5-a026-f538cd527495.26a972cf-5d2f-439c-bcb5-475117ff6e4d" returned: 0 in 0.750s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7e335fda-f991-44f3-9a1a-b9d0ac42b22b tempest-SnapshotMetadataTestJSON-538939080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f4214a67-6d5b-49f5-a026-f538cd527495.26a972cf-5d2f-439c-bcb5-475117ff6e4d {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:05 devstack sudo[97403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0dfea76a-7626-4184-a8da-60d722451c11 1073741824 Sep 25 11:47:05 devstack sudo[97403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:05 devstack sudo[97404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f4214a67-6d5b-49f5-a026-f538cd527495.26a972cf-5d2f-439c-bcb5-475117ff6e4d Sep 25 11:47:05 devstack sudo[97404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:06 devstack sudo[97404]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7e335fda-f991-44f3-9a1a-b9d0ac42b22b tempest-SnapshotMetadataTestJSON-538939080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f4214a67-6d5b-49f5-a026-f538cd527495.26a972cf-5d2f-439c-bcb5-475117ff6e4d" returned: 0 in 0.503s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:06 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-7e335fda-f991-44f3-9a1a-b9d0ac42b22b tempest-SnapshotMetadataTestJSON-538939080 None] Lock "cinder-quobyte-26a972cf-5d2f-439c-bcb5-475117ff6e4d" released by "_delete_snapshot" :: held 2.651s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:47:06 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-7e335fda-f991-44f3-9a1a-b9d0ac42b22b tempest-SnapshotMetadataTestJSON-538939080 None] Lock "cinder-quobyte-f4214a67-6d5b-49f5-a026-f538cd527495" released by "delete_snapshot" :: held 2.687s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:47:06 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-7e335fda-f991-44f3-9a1a-b9d0ac42b22b tempest-SnapshotMetadataTestJSON-538939080 None] Created reservations ['3a6dbc79-c1c8-490a-90f2-0b21ac4ba454', 'cbcb7dce-c05f-4f2a-b8ee-608285dda562', 'e0f283ff-85fc-42fe-838d-3e29caed2ff8', 'bb08a1f5-1020-411b-8167-572312db7b5b'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:47:06 devstack sudo[97403]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7d18f817-1200-415a-a755-a9b112fcd8c7 tempest-GroupsTest-2040236940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0dfea76a-7626-4184-a8da-60d722451c11 1073741824" returned: 0 in 0.897s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:06 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-7e335fda-f991-44f3-9a1a-b9d0ac42b22b tempest-SnapshotMetadataTestJSON-538939080 None] Delete snapshot completed successfully. Sep 25 11:47:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7d18f817-1200-415a-a755-a9b112fcd8c7 tempest-GroupsTest-2040236940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0dfea76a-7626-4184-a8da-60d722451c11 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:06 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-7e335fda-f991-44f3-9a1a-b9d0ac42b22b tempest-SnapshotMetadataTestJSON-538939080 None] Lock "cinder-26a972cf-5d2f-439c-bcb5-475117ff6e4d-delete_snapshot" released by "delete_snapshot" :: held 3.095s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:47:06 devstack sudo[97412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0dfea76a-7626-4184-a8da-60d722451c11 Sep 25 11:47:06 devstack sudo[97412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:06 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-d55e30ee-5031-45ae-aba6-4745c7cb4e82 tempest-SnapshotMetadataTestJSON-538939080 None] Acquiring lock "cinder-f4214a67-6d5b-49f5-a026-f538cd527495-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:47:07 devstack sudo[97412]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7d18f817-1200-415a-a755-a9b112fcd8c7 tempest-GroupsTest-2040236940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0dfea76a-7626-4184-a8da-60d722451c11" returned: 0 in 0.478s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:07 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-7d18f817-1200-415a-a755-a9b112fcd8c7 tempest-GroupsTest-2040236940 None] <== create_volume: return (1491ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:47:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-7d18f817-1200-415a-a755-a9b112fcd8c7 tempest-GroupsTest-2040236940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.496s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:47:07 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-d55e30ee-5031-45ae-aba6-4745c7cb4e82 tempest-SnapshotMetadataTestJSON-538939080 None] Lock "cinder-f4214a67-6d5b-49f5-a026-f538cd527495-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:47:07 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7d18f817-1200-415a-a755-a9b112fcd8c7 tempest-GroupsTest-2040236940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aec48892-cbbe-456c-975a-bad03f3a6f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0dfea76a-7626-4184-a8da-60d722451c11', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:07 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7d18f817-1200-415a-a755-a9b112fcd8c7 tempest-GroupsTest-2040236940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e061334-667e-444c-a117-40eda58a60ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:07 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-7d18f817-1200-415a-a755-a9b112fcd8c7 tempest-GroupsTest-2040236940 None] Volume volume-0dfea76a-7626-4184-a8da-60d722451c11 (0dfea76a-7626-4184-a8da-60d722451c11): created successfully Sep 25 11:47:07 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7d18f817-1200-415a-a755-a9b112fcd8c7 tempest-GroupsTest-2040236940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e061334-667e-444c-a117-40eda58a60ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:07 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7d18f817-1200-415a-a755-a9b112fcd8c7 tempest-GroupsTest-2040236940 None] Flow 'volume_create_manager' (e9961bab-6b7c-4635-b462-435ac5f1004a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:47:07 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-7d18f817-1200-415a-a755-a9b112fcd8c7 tempest-GroupsTest-2040236940 None] Created volume successfully. Sep 25 11:47:07 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-d55e30ee-5031-45ae-aba6-4745c7cb4e82 tempest-SnapshotMetadataTestJSON-538939080 None] Acquiring lock "cinder-quobyte-f4214a67-6d5b-49f5-a026-f538cd527495" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:47:07 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-d55e30ee-5031-45ae-aba6-4745c7cb4e82 tempest-SnapshotMetadataTestJSON-538939080 None] Lock "cinder-quobyte-f4214a67-6d5b-49f5-a026-f538cd527495" acquired by "delete_volume" :: waited 0.036s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:47:07 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[622afc76-d587-44a0-86e7-074b153591b4]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:47:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d55e30ee-5031-45ae-aba6-4745c7cb4e82 tempest-SnapshotMetadataTestJSON-538939080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f4214a67-6d5b-49f5-a026-f538cd527495 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:07 devstack sudo[97415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f4214a67-6d5b-49f5-a026-f538cd527495 Sep 25 11:47:07 devstack sudo[97415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:07 devstack sudo[97415]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d55e30ee-5031-45ae-aba6-4745c7cb4e82 tempest-SnapshotMetadataTestJSON-538939080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f4214a67-6d5b-49f5-a026-f538cd527495" returned: 0 in 0.611s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d55e30ee-5031-45ae-aba6-4745c7cb4e82 tempest-SnapshotMetadataTestJSON-538939080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f4214a67-6d5b-49f5-a026-f538cd527495 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:08 devstack sudo[97420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f4214a67-6d5b-49f5-a026-f538cd527495 Sep 25 11:47:08 devstack sudo[97420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:08 devstack sudo[97420]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d55e30ee-5031-45ae-aba6-4745c7cb4e82 tempest-SnapshotMetadataTestJSON-538939080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f4214a67-6d5b-49f5-a026-f538cd527495" returned: 0 in 0.475s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:08 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-d55e30ee-5031-45ae-aba6-4745c7cb4e82 tempest-SnapshotMetadataTestJSON-538939080 None] Lock "cinder-quobyte-f4214a67-6d5b-49f5-a026-f538cd527495" released by "delete_volume" :: held 1.237s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:47:08 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-d55e30ee-5031-45ae-aba6-4745c7cb4e82 tempest-SnapshotMetadataTestJSON-538939080 None] Created reservations ['df569c93-03a4-4a90-9b52-ceda5d78ecb8', '04a96ea6-85ee-49fb-8f9f-7edf2dcfd370', '8cc3dc58-28c7-4fd3-8883-4f7eca78ee33', 'e0faf322-52c0-4b6d-b75c-110e72f04e92'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:47:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d55e30ee-5031-45ae-aba6-4745c7cb4e82 tempest-SnapshotMetadataTestJSON-538939080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:47:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d55e30ee-5031-45ae-aba6-4745c7cb4e82 tempest-SnapshotMetadataTestJSON-538939080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:47:08 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-d55e30ee-5031-45ae-aba6-4745c7cb4e82 tempest-SnapshotMetadataTestJSON-538939080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:47:08 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-d55e30ee-5031-45ae-aba6-4745c7cb4e82 tempest-SnapshotMetadataTestJSON-538939080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:47:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d55e30ee-5031-45ae-aba6-4745c7cb4e82 tempest-SnapshotMetadataTestJSON-538939080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:47:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d55e30ee-5031-45ae-aba6-4745c7cb4e82 tempest-SnapshotMetadataTestJSON-538939080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:08 devstack sudo[97423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:47:08 devstack sudo[97423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:08 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-d4ce13e1-79fd-4770-b07d-8cc7f85869bd tempest-GroupsTest-2040236940 None] Acquiring lock "cinder-quobyte-0dfea76a-7626-4184-a8da-60d722451c11" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:47:09 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-d4ce13e1-79fd-4770-b07d-8cc7f85869bd tempest-GroupsTest-2040236940 None] Lock "cinder-quobyte-0dfea76a-7626-4184-a8da-60d722451c11" acquired by "delete_volume" :: waited 0.056s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:47:09 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa4a3cf-e2d7-46cc-a999-5790f1fbc137]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:47:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d4ce13e1-79fd-4770-b07d-8cc7f85869bd tempest-GroupsTest-2040236940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0dfea76a-7626-4184-a8da-60d722451c11 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:09 devstack sudo[97423]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d55e30ee-5031-45ae-aba6-4745c7cb4e82 tempest-SnapshotMetadataTestJSON-538939080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.504s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:09 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-d55e30ee-5031-45ae-aba6-4745c7cb4e82 tempest-SnapshotMetadataTestJSON-538939080 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:47:09 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-d55e30ee-5031-45ae-aba6-4745c7cb4e82 tempest-SnapshotMetadataTestJSON-538939080 None] Deleted volume successfully. Sep 25 11:47:09 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-d55e30ee-5031-45ae-aba6-4745c7cb4e82 tempest-SnapshotMetadataTestJSON-538939080 None] Lock "cinder-f4214a67-6d5b-49f5-a026-f538cd527495-delete_volume" released by "delete_volume" :: held 2.240s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:47:09 devstack sudo[97425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0dfea76a-7626-4184-a8da-60d722451c11 Sep 25 11:47:09 devstack sudo[97425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:09 devstack sudo[97425]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d4ce13e1-79fd-4770-b07d-8cc7f85869bd tempest-GroupsTest-2040236940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0dfea76a-7626-4184-a8da-60d722451c11" returned: 0 in 0.610s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d4ce13e1-79fd-4770-b07d-8cc7f85869bd tempest-GroupsTest-2040236940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0dfea76a-7626-4184-a8da-60d722451c11 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:09 devstack sudo[97432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0dfea76a-7626-4184-a8da-60d722451c11 Sep 25 11:47:09 devstack sudo[97432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:10 devstack sudo[97432]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d4ce13e1-79fd-4770-b07d-8cc7f85869bd tempest-GroupsTest-2040236940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0dfea76a-7626-4184-a8da-60d722451c11" returned: 0 in 0.423s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:10 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-d4ce13e1-79fd-4770-b07d-8cc7f85869bd tempest-GroupsTest-2040236940 None] Lock "cinder-quobyte-0dfea76a-7626-4184-a8da-60d722451c11" released by "delete_volume" :: held 1.137s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:47:10 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-d4ce13e1-79fd-4770-b07d-8cc7f85869bd tempest-GroupsTest-2040236940 None] Created reservations ['3369d6f3-a10b-4627-b542-7ada70bf8caf'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:47:10 devstack cinder-volume[86984]: WARNING cinder.quota [None req-d4ce13e1-79fd-4770-b07d-8cc7f85869bd tempest-GroupsTest-2040236940 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1111376093 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1111376093, it is now deprecated. Please use the default quota class for default quota. Sep 25 11:47:10 devstack cinder-volume[86984]: WARNING cinder.quota [None req-d4ce13e1-79fd-4770-b07d-8cc7f85869bd tempest-GroupsTest-2040236940 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1111376093 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1111376093, it is now deprecated. Please use the default quota class for default quota. Sep 25 11:47:10 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-d4ce13e1-79fd-4770-b07d-8cc7f85869bd tempest-GroupsTest-2040236940 None] Created reservations ['86df1a2b-bdda-4aba-9168-bb49b8dd471b', '1e0202a6-d0f6-4ba3-ad54-0e8c5d2dbbc5', '15e9896d-724b-4964-b079-1d27a07f1865', '1181860c-6f6e-41ae-9ea9-1852abe27f8b'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:47:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d4ce13e1-79fd-4770-b07d-8cc7f85869bd tempest-GroupsTest-2040236940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:47:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d4ce13e1-79fd-4770-b07d-8cc7f85869bd tempest-GroupsTest-2040236940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:47:10 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-d4ce13e1-79fd-4770-b07d-8cc7f85869bd tempest-GroupsTest-2040236940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:47:10 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-d4ce13e1-79fd-4770-b07d-8cc7f85869bd tempest-GroupsTest-2040236940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:47:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d4ce13e1-79fd-4770-b07d-8cc7f85869bd tempest-GroupsTest-2040236940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:47:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d4ce13e1-79fd-4770-b07d-8cc7f85869bd tempest-GroupsTest-2040236940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:10 devstack sudo[97435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:47:10 devstack sudo[97435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:11 devstack sudo[97435]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d4ce13e1-79fd-4770-b07d-8cc7f85869bd tempest-GroupsTest-2040236940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.456s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:11 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-d4ce13e1-79fd-4770-b07d-8cc7f85869bd tempest-GroupsTest-2040236940 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:47:11 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-d4ce13e1-79fd-4770-b07d-8cc7f85869bd tempest-GroupsTest-2040236940 None] Delete group completed successfully. Sep 25 11:47:11 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-3822ec5c-060f-405b-ac92-c03d289f6641 tempest-AbsoluteLimitsTests-1384346402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:47:11 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3822ec5c-060f-405b-ac92-c03d289f6641 tempest-AbsoluteLimitsTests-1384346402 None] Flow 'volume_create_manager' (d733b122-660a-4b84-95c2-efd14aa6641f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:47:11 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3822ec5c-060f-405b-ac92-c03d289f6641 tempest-AbsoluteLimitsTests-1384346402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bf3a385-b970-4477-9408-e6900fc68fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:11 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3822ec5c-060f-405b-ac92-c03d289f6641 tempest-AbsoluteLimitsTests-1384346402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bf3a385-b970-4477-9408-e6900fc68fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:47:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1985902109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=308ef94c-7f5f-408f-afb4-8897a3085c24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bcf21ff15b44830b35033bed62590c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:47:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:47:11Z,use_quota=True,user_id='036d98cbcb9c4126be9aa39f969cfdee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:11 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3822ec5c-060f-405b-ac92-c03d289f6641 tempest-AbsoluteLimitsTests-1384346402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7defa9aa-c079-417d-8098-1d1f01ea1200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:11 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3822ec5c-060f-405b-ac92-c03d289f6641 tempest-AbsoluteLimitsTests-1384346402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7defa9aa-c079-417d-8098-1d1f01ea1200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:11 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3822ec5c-060f-405b-ac92-c03d289f6641 tempest-AbsoluteLimitsTests-1384346402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9e7d722-db5d-4efb-90b3-87beedc35f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:11 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3822ec5c-060f-405b-ac92-c03d289f6641 tempest-AbsoluteLimitsTests-1384346402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9e7d722-db5d-4efb-90b3-87beedc35f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '308ef94c-7f5f-408f-afb4-8897a3085c24', 'volume_name': 'volume-308ef94c-7f5f-408f-afb4-8897a3085c24', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:11 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3822ec5c-060f-405b-ac92-c03d289f6641 tempest-AbsoluteLimitsTests-1384346402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20beee52-f54b-4a0f-96df-18be2e813b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:11 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3822ec5c-060f-405b-ac92-c03d289f6641 tempest-AbsoluteLimitsTests-1384346402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20beee52-f54b-4a0f-96df-18be2e813b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:11 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3822ec5c-060f-405b-ac92-c03d289f6641 tempest-AbsoluteLimitsTests-1384346402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a13a5ac2-b724-44c3-a06d-891540569767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:11 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-3822ec5c-060f-405b-ac92-c03d289f6641 tempest-AbsoluteLimitsTests-1384346402 None] Volume 308ef94c-7f5f-408f-afb4-8897a3085c24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-308ef94c-7f5f-408f-afb4-8897a3085c24', 'volume_size': 1} Sep 25 11:47:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3822ec5c-060f-405b-ac92-c03d289f6641 tempest-AbsoluteLimitsTests-1384346402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:47:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3822ec5c-060f-405b-ac92-c03d289f6641 tempest-AbsoluteLimitsTests-1384346402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:47:11 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3822ec5c-060f-405b-ac92-c03d289f6641 tempest-AbsoluteLimitsTests-1384346402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:47:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1985902109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=308ef94c-7f5f-408f-afb4-8897a3085c24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bcf21ff15b44830b35033bed62590c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:47:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:47:11Z,use_quota=True,user_id='036d98cbcb9c4126be9aa39f969cfdee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:47:11 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-3822ec5c-060f-405b-ac92-c03d289f6641 tempest-AbsoluteLimitsTests-1384346402 None] Creating volume 308ef94c-7f5f-408f-afb4-8897a3085c24 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:47:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3822ec5c-060f-405b-ac92-c03d289f6641 tempest-AbsoluteLimitsTests-1384346402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:47:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3822ec5c-060f-405b-ac92-c03d289f6641 tempest-AbsoluteLimitsTests-1384346402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:47:11 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3822ec5c-060f-405b-ac92-c03d289f6641 tempest-AbsoluteLimitsTests-1384346402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:47:11 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3822ec5c-060f-405b-ac92-c03d289f6641 tempest-AbsoluteLimitsTests-1384346402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:47:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3822ec5c-060f-405b-ac92-c03d289f6641 tempest-AbsoluteLimitsTests-1384346402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:47:11 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3822ec5c-060f-405b-ac92-c03d289f6641 tempest-AbsoluteLimitsTests-1384346402 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:47:11 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-3822ec5c-060f-405b-ac92-c03d289f6641 tempest-AbsoluteLimitsTests-1384346402 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:47:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3822ec5c-060f-405b-ac92-c03d289f6641 tempest-AbsoluteLimitsTests-1384346402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-308ef94c-7f5f-408f-afb4-8897a3085c24 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:11 devstack sudo[97438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-308ef94c-7f5f-408f-afb4-8897a3085c24 1073741824 Sep 25 11:47:11 devstack sudo[97438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:11 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-ef221ff0-594d-4671-b2ac-b17d782107df tempest-GroupsTest-2040236940 None] Created reservations ['e0940720-30e2-4278-a454-3eca5eb2aba7'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:47:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-ef221ff0-594d-4671-b2ac-b17d782107df tempest-GroupsTest-2040236940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:47:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-ef221ff0-594d-4671-b2ac-b17d782107df tempest-GroupsTest-2040236940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:47:11 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-ef221ff0-594d-4671-b2ac-b17d782107df tempest-GroupsTest-2040236940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:47:11 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-ef221ff0-594d-4671-b2ac-b17d782107df tempest-GroupsTest-2040236940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:47:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-ef221ff0-594d-4671-b2ac-b17d782107df tempest-GroupsTest-2040236940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:47:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ef221ff0-594d-4671-b2ac-b17d782107df tempest-GroupsTest-2040236940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:12 devstack sudo[97443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:47:12 devstack sudo[97443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:12 devstack sudo[97438]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:12 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3822ec5c-060f-405b-ac92-c03d289f6641 tempest-AbsoluteLimitsTests-1384346402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-308ef94c-7f5f-408f-afb4-8897a3085c24 1073741824" returned: 0 in 0.817s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:12 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3822ec5c-060f-405b-ac92-c03d289f6641 tempest-AbsoluteLimitsTests-1384346402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-308ef94c-7f5f-408f-afb4-8897a3085c24 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:12 devstack sudo[97446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-308ef94c-7f5f-408f-afb4-8897a3085c24 Sep 25 11:47:12 devstack sudo[97446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:12 devstack sudo[97443]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:12 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ef221ff0-594d-4671-b2ac-b17d782107df tempest-GroupsTest-2040236940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.518s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:12 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-ef221ff0-594d-4671-b2ac-b17d782107df tempest-GroupsTest-2040236940 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:47:12 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-ef221ff0-594d-4671-b2ac-b17d782107df tempest-GroupsTest-2040236940 None] Delete group completed successfully. Sep 25 11:47:12 devstack sudo[97446]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:12 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3822ec5c-060f-405b-ac92-c03d289f6641 tempest-AbsoluteLimitsTests-1384346402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-308ef94c-7f5f-408f-afb4-8897a3085c24" returned: 0 in 0.368s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:12 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3822ec5c-060f-405b-ac92-c03d289f6641 tempest-AbsoluteLimitsTests-1384346402 None] <== create_volume: return (1256ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:47:12 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3822ec5c-060f-405b-ac92-c03d289f6641 tempest-AbsoluteLimitsTests-1384346402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.260s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:47:12 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3822ec5c-060f-405b-ac92-c03d289f6641 tempest-AbsoluteLimitsTests-1384346402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a13a5ac2-b724-44c3-a06d-891540569767) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-308ef94c-7f5f-408f-afb4-8897a3085c24', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:12 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3822ec5c-060f-405b-ac92-c03d289f6641 tempest-AbsoluteLimitsTests-1384346402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55505d60-17a3-4780-8b18-9719ff58ce41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:12 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-3822ec5c-060f-405b-ac92-c03d289f6641 tempest-AbsoluteLimitsTests-1384346402 None] Volume volume-308ef94c-7f5f-408f-afb4-8897a3085c24 (308ef94c-7f5f-408f-afb4-8897a3085c24): created successfully Sep 25 11:47:12 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3822ec5c-060f-405b-ac92-c03d289f6641 tempest-AbsoluteLimitsTests-1384346402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55505d60-17a3-4780-8b18-9719ff58ce41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:12 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3822ec5c-060f-405b-ac92-c03d289f6641 tempest-AbsoluteLimitsTests-1384346402 None] Flow 'volume_create_manager' (d733b122-660a-4b84-95c2-efd14aa6641f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:47:12 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-3822ec5c-060f-405b-ac92-c03d289f6641 tempest-AbsoluteLimitsTests-1384346402 None] Created volume successfully. Sep 25 11:47:13 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-4b5da252-2977-4ee2-bd07-f6b45ce2d5bd tempest-GroupsTest-2040236940 None] Group tempest-GroupsTest-Group-332852978: creating Sep 25 11:47:13 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-4b5da252-2977-4ee2-bd07-f6b45ce2d5bd tempest-GroupsTest-2040236940 None] Group tempest-GroupsTest-Group-332852978: created successfully Sep 25 11:47:13 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-4b5da252-2977-4ee2-bd07-f6b45ce2d5bd tempest-GroupsTest-2040236940 None] Create group completed successfully. Sep 25 11:47:14 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-aa29d380-6015-4d8e-84e9-b439e951c23d tempest-AbsoluteLimitsTests-1384346402 None] Acquiring lock "cinder-308ef94c-7f5f-408f-afb4-8897a3085c24-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:47:14 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-aa29d380-6015-4d8e-84e9-b439e951c23d tempest-AbsoluteLimitsTests-1384346402 None] Lock "cinder-308ef94c-7f5f-408f-afb4-8897a3085c24-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:47:14 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-aa29d380-6015-4d8e-84e9-b439e951c23d tempest-AbsoluteLimitsTests-1384346402 None] Acquiring lock "cinder-quobyte-308ef94c-7f5f-408f-afb4-8897a3085c24" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:47:14 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-aa29d380-6015-4d8e-84e9-b439e951c23d tempest-AbsoluteLimitsTests-1384346402 None] Lock "cinder-quobyte-308ef94c-7f5f-408f-afb4-8897a3085c24" acquired by "delete_volume" :: waited 0.027s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:47:14 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a3170d-b8bb-423d-a399-12736ab8051d]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:47:14 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-aa29d380-6015-4d8e-84e9-b439e951c23d tempest-AbsoluteLimitsTests-1384346402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-308ef94c-7f5f-408f-afb4-8897a3085c24 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:14 devstack sudo[97450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-308ef94c-7f5f-408f-afb4-8897a3085c24 Sep 25 11:47:14 devstack sudo[97450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:14 devstack sudo[97450]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:14 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-aa29d380-6015-4d8e-84e9-b439e951c23d tempest-AbsoluteLimitsTests-1384346402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-308ef94c-7f5f-408f-afb4-8897a3085c24" returned: 0 in 0.623s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:14 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-aa29d380-6015-4d8e-84e9-b439e951c23d tempest-AbsoluteLimitsTests-1384346402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-308ef94c-7f5f-408f-afb4-8897a3085c24 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:15 devstack sudo[97456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-308ef94c-7f5f-408f-afb4-8897a3085c24 Sep 25 11:47:15 devstack sudo[97456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:15 devstack sudo[97456]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:15 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-aa29d380-6015-4d8e-84e9-b439e951c23d tempest-AbsoluteLimitsTests-1384346402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-308ef94c-7f5f-408f-afb4-8897a3085c24" returned: 0 in 0.710s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:15 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-aa29d380-6015-4d8e-84e9-b439e951c23d tempest-AbsoluteLimitsTests-1384346402 None] Lock "cinder-quobyte-308ef94c-7f5f-408f-afb4-8897a3085c24" released by "delete_volume" :: held 1.451s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:47:15 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d2b4862-761d-41a9-a4f7-fdcf978e27fa tempest-GroupsTest-2040236940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:47:15 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7d2b4862-761d-41a9-a4f7-fdcf978e27fa tempest-GroupsTest-2040236940 None] Flow 'volume_create_manager' (93b86bb8-aee3-4a0c-8a28-2fad3db5744a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:47:15 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7d2b4862-761d-41a9-a4f7-fdcf978e27fa tempest-GroupsTest-2040236940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96663548-5613-44a8-bc90-c8f3957f3a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:15 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-aa29d380-6015-4d8e-84e9-b439e951c23d tempest-AbsoluteLimitsTests-1384346402 None] Created reservations ['c1ed6119-ce07-4952-9e0e-e708528025d6', '85db6f8c-1fd2-4a34-8b51-c4a282e94aae', '00995e1c-c5f1-4e4b-850e-8c633a0b0001', '65dfc8e5-9026-4356-ad99-003224394def'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:47:15 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7d2b4862-761d-41a9-a4f7-fdcf978e27fa tempest-GroupsTest-2040236940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96663548-5613-44a8-bc90-c8f3957f3a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:47:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1574517254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fc265d8f-cefd-4a67-90bb-d55853292368,host='devstack@QuobyteHD#QuobyteHD',id=f5a093f2-cd5b-4592-aecc-29c084d81b0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53c4d217802f44399201425b30bc3f36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:47:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:47:16Z,use_quota=True,user_id='724dfc15fb7c48b2b3755cb728de8b50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(16ea3652-b48b-4cd6-9429-31e71124e14b),volume_type_id=16ea3652-b48b-4cd6-9429-31e71124e14b)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:15 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7d2b4862-761d-41a9-a4f7-fdcf978e27fa tempest-GroupsTest-2040236940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4aedf98e-fae4-4d23-982d-d6945e14e70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:15 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7d2b4862-761d-41a9-a4f7-fdcf978e27fa tempest-GroupsTest-2040236940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4aedf98e-fae4-4d23-982d-d6945e14e70b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:15 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7d2b4862-761d-41a9-a4f7-fdcf978e27fa tempest-GroupsTest-2040236940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (449ce588-1249-4935-badc-d98195fa019f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:15 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7d2b4862-761d-41a9-a4f7-fdcf978e27fa tempest-GroupsTest-2040236940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (449ce588-1249-4935-badc-d98195fa019f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5a093f2-cd5b-4592-aecc-29c084d81b0b', 'volume_name': 'volume-f5a093f2-cd5b-4592-aecc-29c084d81b0b', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:15 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7d2b4862-761d-41a9-a4f7-fdcf978e27fa tempest-GroupsTest-2040236940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4be4fcbc-5b23-4a5c-9a79-381fa94e6393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:15 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7d2b4862-761d-41a9-a4f7-fdcf978e27fa tempest-GroupsTest-2040236940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4be4fcbc-5b23-4a5c-9a79-381fa94e6393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:15 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7d2b4862-761d-41a9-a4f7-fdcf978e27fa tempest-GroupsTest-2040236940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9c6571a-4ab3-4367-a763-d164e0f99be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:15 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-7d2b4862-761d-41a9-a4f7-fdcf978e27fa tempest-GroupsTest-2040236940 None] Volume f5a093f2-cd5b-4592-aecc-29c084d81b0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5a093f2-cd5b-4592-aecc-29c084d81b0b', 'volume_size': 1} Sep 25 11:47:15 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-7d2b4862-761d-41a9-a4f7-fdcf978e27fa tempest-GroupsTest-2040236940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:47:15 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-7d2b4862-761d-41a9-a4f7-fdcf978e27fa tempest-GroupsTest-2040236940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:47:15 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-7d2b4862-761d-41a9-a4f7-fdcf978e27fa tempest-GroupsTest-2040236940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fc265d8f-cefd-4a67-90bb-d55853292368,created_at=2026-09-25T09:47:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1574517254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fc265d8f-cefd-4a67-90bb-d55853292368,host='devstack@QuobyteHD#QuobyteHD',id=f5a093f2-cd5b-4592-aecc-29c084d81b0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53c4d217802f44399201425b30bc3f36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:47:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:47:16Z,use_quota=True,user_id='724dfc15fb7c48b2b3755cb728de8b50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(16ea3652-b48b-4cd6-9429-31e71124e14b),volume_type_id=16ea3652-b48b-4cd6-9429-31e71124e14b)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:47:15 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-7d2b4862-761d-41a9-a4f7-fdcf978e27fa tempest-GroupsTest-2040236940 None] Creating volume f5a093f2-cd5b-4592-aecc-29c084d81b0b {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:47:15 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-7d2b4862-761d-41a9-a4f7-fdcf978e27fa tempest-GroupsTest-2040236940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:47:15 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-7d2b4862-761d-41a9-a4f7-fdcf978e27fa tempest-GroupsTest-2040236940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:47:15 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-7d2b4862-761d-41a9-a4f7-fdcf978e27fa tempest-GroupsTest-2040236940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:47:15 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-7d2b4862-761d-41a9-a4f7-fdcf978e27fa tempest-GroupsTest-2040236940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:47:15 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-7d2b4862-761d-41a9-a4f7-fdcf978e27fa tempest-GroupsTest-2040236940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:47:16 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-7d2b4862-761d-41a9-a4f7-fdcf978e27fa tempest-GroupsTest-2040236940 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:47:16 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-7d2b4862-761d-41a9-a4f7-fdcf978e27fa tempest-GroupsTest-2040236940 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:47:16 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7d2b4862-761d-41a9-a4f7-fdcf978e27fa tempest-GroupsTest-2040236940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f5a093f2-cd5b-4592-aecc-29c084d81b0b 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:16 devstack sudo[97459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f5a093f2-cd5b-4592-aecc-29c084d81b0b 1073741824 Sep 25 11:47:16 devstack sudo[97459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:16 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-aa29d380-6015-4d8e-84e9-b439e951c23d tempest-AbsoluteLimitsTests-1384346402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:47:16 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-aa29d380-6015-4d8e-84e9-b439e951c23d tempest-AbsoluteLimitsTests-1384346402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:47:16 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-aa29d380-6015-4d8e-84e9-b439e951c23d tempest-AbsoluteLimitsTests-1384346402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:47:16 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-aa29d380-6015-4d8e-84e9-b439e951c23d tempest-AbsoluteLimitsTests-1384346402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:47:16 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-aa29d380-6015-4d8e-84e9-b439e951c23d tempest-AbsoluteLimitsTests-1384346402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:47:16 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-aa29d380-6015-4d8e-84e9-b439e951c23d tempest-AbsoluteLimitsTests-1384346402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:16 devstack sudo[97461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:47:16 devstack sudo[97461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:16 devstack sudo[97461]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:16 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-aa29d380-6015-4d8e-84e9-b439e951c23d tempest-AbsoluteLimitsTests-1384346402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.578s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:16 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-aa29d380-6015-4d8e-84e9-b439e951c23d tempest-AbsoluteLimitsTests-1384346402 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:47:16 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-aa29d380-6015-4d8e-84e9-b439e951c23d tempest-AbsoluteLimitsTests-1384346402 None] Deleted volume successfully. Sep 25 11:47:16 devstack sudo[97459]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:16 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7d2b4862-761d-41a9-a4f7-fdcf978e27fa tempest-GroupsTest-2040236940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f5a093f2-cd5b-4592-aecc-29c084d81b0b 1073741824" returned: 0 in 0.798s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:16 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-aa29d380-6015-4d8e-84e9-b439e951c23d tempest-AbsoluteLimitsTests-1384346402 None] Lock "cinder-308ef94c-7f5f-408f-afb4-8897a3085c24-delete_volume" released by "delete_volume" :: held 2.670s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:47:16 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7d2b4862-761d-41a9-a4f7-fdcf978e27fa tempest-GroupsTest-2040236940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f5a093f2-cd5b-4592-aecc-29c084d81b0b {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:16 devstack sudo[97468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f5a093f2-cd5b-4592-aecc-29c084d81b0b Sep 25 11:47:16 devstack sudo[97468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:17 devstack sudo[97468]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:17 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7d2b4862-761d-41a9-a4f7-fdcf978e27fa tempest-GroupsTest-2040236940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f5a093f2-cd5b-4592-aecc-29c084d81b0b" returned: 0 in 0.499s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:17 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-7d2b4862-761d-41a9-a4f7-fdcf978e27fa tempest-GroupsTest-2040236940 None] <== create_volume: return (1421ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:47:17 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-7d2b4862-761d-41a9-a4f7-fdcf978e27fa tempest-GroupsTest-2040236940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.425s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:47:17 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7d2b4862-761d-41a9-a4f7-fdcf978e27fa tempest-GroupsTest-2040236940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9c6571a-4ab3-4367-a763-d164e0f99be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5a093f2-cd5b-4592-aecc-29c084d81b0b', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:17 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7d2b4862-761d-41a9-a4f7-fdcf978e27fa tempest-GroupsTest-2040236940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2c7489e-f8c8-40f9-9dde-62df59dace20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:17 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-7d2b4862-761d-41a9-a4f7-fdcf978e27fa tempest-GroupsTest-2040236940 None] Volume volume-f5a093f2-cd5b-4592-aecc-29c084d81b0b (f5a093f2-cd5b-4592-aecc-29c084d81b0b): created successfully Sep 25 11:47:17 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7d2b4862-761d-41a9-a4f7-fdcf978e27fa tempest-GroupsTest-2040236940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2c7489e-f8c8-40f9-9dde-62df59dace20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:17 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7d2b4862-761d-41a9-a4f7-fdcf978e27fa tempest-GroupsTest-2040236940 None] Flow 'volume_create_manager' (93b86bb8-aee3-4a0c-8a28-2fad3db5744a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:47:17 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-7d2b4862-761d-41a9-a4f7-fdcf978e27fa tempest-GroupsTest-2040236940 None] Created volume successfully. Sep 25 11:47:19 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-69d4bf72-c7a6-4727-8b32-a8e84f89e81d tempest-GroupsTest-2040236940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:47:19 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-69d4bf72-c7a6-4727-8b32-a8e84f89e81d tempest-GroupsTest-2040236940 None] Flow 'volume_create_manager' (ae063369-952c-457d-bcbe-a691a5f77110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:47:19 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-69d4bf72-c7a6-4727-8b32-a8e84f89e81d tempest-GroupsTest-2040236940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (968e740b-fb55-4b5b-a103-c07695cd7530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:19 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-69d4bf72-c7a6-4727-8b32-a8e84f89e81d tempest-GroupsTest-2040236940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (968e740b-fb55-4b5b-a103-c07695cd7530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:47:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1417915119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fc265d8f-cefd-4a67-90bb-d55853292368,host='devstack@QuobyteHD#QuobyteHD',id=c1cdd6b6-4d3d-4ffc-b756-68dced88a035,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53c4d217802f44399201425b30bc3f36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:47:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:47:19Z,use_quota=True,user_id='724dfc15fb7c48b2b3755cb728de8b50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(16ea3652-b48b-4cd6-9429-31e71124e14b),volume_type_id=16ea3652-b48b-4cd6-9429-31e71124e14b)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:19 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-69d4bf72-c7a6-4727-8b32-a8e84f89e81d tempest-GroupsTest-2040236940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dec71a3-07ef-4fb0-a2f5-544d6bcf5dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:19 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-69d4bf72-c7a6-4727-8b32-a8e84f89e81d tempest-GroupsTest-2040236940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dec71a3-07ef-4fb0-a2f5-544d6bcf5dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:19 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-69d4bf72-c7a6-4727-8b32-a8e84f89e81d tempest-GroupsTest-2040236940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee16471b-9843-48d4-9687-9859186609fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:19 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-69d4bf72-c7a6-4727-8b32-a8e84f89e81d tempest-GroupsTest-2040236940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee16471b-9843-48d4-9687-9859186609fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1cdd6b6-4d3d-4ffc-b756-68dced88a035', 'volume_name': 'volume-c1cdd6b6-4d3d-4ffc-b756-68dced88a035', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:19 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-69d4bf72-c7a6-4727-8b32-a8e84f89e81d tempest-GroupsTest-2040236940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2dec71f-3005-426b-a485-ae4514bcb94c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:19 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-69d4bf72-c7a6-4727-8b32-a8e84f89e81d tempest-GroupsTest-2040236940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2dec71f-3005-426b-a485-ae4514bcb94c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:19 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-69d4bf72-c7a6-4727-8b32-a8e84f89e81d tempest-GroupsTest-2040236940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a1ef727-fde0-4a20-b4a0-0871018728b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:19 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-69d4bf72-c7a6-4727-8b32-a8e84f89e81d tempest-GroupsTest-2040236940 None] Volume c1cdd6b6-4d3d-4ffc-b756-68dced88a035: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1cdd6b6-4d3d-4ffc-b756-68dced88a035', 'volume_size': 1} Sep 25 11:47:19 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-69d4bf72-c7a6-4727-8b32-a8e84f89e81d tempest-GroupsTest-2040236940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:47:19 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-69d4bf72-c7a6-4727-8b32-a8e84f89e81d tempest-GroupsTest-2040236940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:47:19 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-69d4bf72-c7a6-4727-8b32-a8e84f89e81d tempest-GroupsTest-2040236940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fc265d8f-cefd-4a67-90bb-d55853292368,created_at=2026-09-25T09:47:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1417915119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fc265d8f-cefd-4a67-90bb-d55853292368,host='devstack@QuobyteHD#QuobyteHD',id=c1cdd6b6-4d3d-4ffc-b756-68dced88a035,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53c4d217802f44399201425b30bc3f36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:47:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:47:19Z,use_quota=True,user_id='724dfc15fb7c48b2b3755cb728de8b50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(16ea3652-b48b-4cd6-9429-31e71124e14b),volume_type_id=16ea3652-b48b-4cd6-9429-31e71124e14b)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:47:19 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-69d4bf72-c7a6-4727-8b32-a8e84f89e81d tempest-GroupsTest-2040236940 None] Creating volume c1cdd6b6-4d3d-4ffc-b756-68dced88a035 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:47:19 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-69d4bf72-c7a6-4727-8b32-a8e84f89e81d tempest-GroupsTest-2040236940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:47:19 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-69d4bf72-c7a6-4727-8b32-a8e84f89e81d tempest-GroupsTest-2040236940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:47:19 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-69d4bf72-c7a6-4727-8b32-a8e84f89e81d tempest-GroupsTest-2040236940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:47:19 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-69d4bf72-c7a6-4727-8b32-a8e84f89e81d tempest-GroupsTest-2040236940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:47:19 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-69d4bf72-c7a6-4727-8b32-a8e84f89e81d tempest-GroupsTest-2040236940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:47:19 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-69d4bf72-c7a6-4727-8b32-a8e84f89e81d tempest-GroupsTest-2040236940 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:47:19 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-69d4bf72-c7a6-4727-8b32-a8e84f89e81d tempest-GroupsTest-2040236940 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:47:19 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-69d4bf72-c7a6-4727-8b32-a8e84f89e81d tempest-GroupsTest-2040236940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c1cdd6b6-4d3d-4ffc-b756-68dced88a035 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:19 devstack sudo[97471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c1cdd6b6-4d3d-4ffc-b756-68dced88a035 1073741824 Sep 25 11:47:19 devstack sudo[97471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:20 devstack sudo[97471]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-69d4bf72-c7a6-4727-8b32-a8e84f89e81d tempest-GroupsTest-2040236940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c1cdd6b6-4d3d-4ffc-b756-68dced88a035 1073741824" returned: 0 in 0.690s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-69d4bf72-c7a6-4727-8b32-a8e84f89e81d tempest-GroupsTest-2040236940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c1cdd6b6-4d3d-4ffc-b756-68dced88a035 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:20 devstack sudo[97477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c1cdd6b6-4d3d-4ffc-b756-68dced88a035 Sep 25 11:47:20 devstack sudo[97477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:20 devstack sudo[97477]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-69d4bf72-c7a6-4727-8b32-a8e84f89e81d tempest-GroupsTest-2040236940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c1cdd6b6-4d3d-4ffc-b756-68dced88a035" returned: 0 in 0.499s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:20 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-69d4bf72-c7a6-4727-8b32-a8e84f89e81d tempest-GroupsTest-2040236940 None] <== create_volume: return (1262ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:47:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-69d4bf72-c7a6-4727-8b32-a8e84f89e81d tempest-GroupsTest-2040236940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.266s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:47:20 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-69d4bf72-c7a6-4727-8b32-a8e84f89e81d tempest-GroupsTest-2040236940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a1ef727-fde0-4a20-b4a0-0871018728b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1cdd6b6-4d3d-4ffc-b756-68dced88a035', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:20 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-69d4bf72-c7a6-4727-8b32-a8e84f89e81d tempest-GroupsTest-2040236940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d2e4716-e385-4878-8ecf-5c41084043d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:20 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-69d4bf72-c7a6-4727-8b32-a8e84f89e81d tempest-GroupsTest-2040236940 None] Volume volume-c1cdd6b6-4d3d-4ffc-b756-68dced88a035 (c1cdd6b6-4d3d-4ffc-b756-68dced88a035): created successfully Sep 25 11:47:20 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-69d4bf72-c7a6-4727-8b32-a8e84f89e81d tempest-GroupsTest-2040236940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d2e4716-e385-4878-8ecf-5c41084043d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:20 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-69d4bf72-c7a6-4727-8b32-a8e84f89e81d tempest-GroupsTest-2040236940 None] Flow 'volume_create_manager' (ae063369-952c-457d-bcbe-a691a5f77110) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:47:20 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-69d4bf72-c7a6-4727-8b32-a8e84f89e81d tempest-GroupsTest-2040236940 None] Created volume successfully. Sep 25 11:47:22 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-5730321c-ef30-44fa-9511-8a968659a123 tempest-GroupsTest-2040236940 None] Update group completed successfully. Sep 25 11:47:24 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-888d3d9e-f4f3-48c4-9a3c-3a49468016cd tempest-GroupsTest-2040236940 None] Update group completed successfully. Sep 25 11:47:26 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-dd72bc53-c4ef-414d-a8d5-02a9cb9db545 tempest-GroupsTest-2040236940 None] Acquiring lock "cinder-quobyte-c1cdd6b6-4d3d-4ffc-b756-68dced88a035" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:47:26 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-dd72bc53-c4ef-414d-a8d5-02a9cb9db545 tempest-GroupsTest-2040236940 None] Lock "cinder-quobyte-c1cdd6b6-4d3d-4ffc-b756-68dced88a035" acquired by "delete_volume" :: waited 0.047s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:47:26 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d24e56-e762-408e-8557-9556c4c9e46e]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:47:26 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-dd72bc53-c4ef-414d-a8d5-02a9cb9db545 tempest-GroupsTest-2040236940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c1cdd6b6-4d3d-4ffc-b756-68dced88a035 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:26 devstack sudo[97481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c1cdd6b6-4d3d-4ffc-b756-68dced88a035 Sep 25 11:47:26 devstack sudo[97481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:27 devstack sudo[97481]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:27 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-dd72bc53-c4ef-414d-a8d5-02a9cb9db545 tempest-GroupsTest-2040236940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c1cdd6b6-4d3d-4ffc-b756-68dced88a035" returned: 0 in 0.871s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:27 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-dd72bc53-c4ef-414d-a8d5-02a9cb9db545 tempest-GroupsTest-2040236940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c1cdd6b6-4d3d-4ffc-b756-68dced88a035 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:27 devstack sudo[97487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c1cdd6b6-4d3d-4ffc-b756-68dced88a035 Sep 25 11:47:27 devstack sudo[97487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:27 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-37ea8237-18a1-4b3f-b6bc-bf97ef02d33f tempest-VolumesTransfersV355Test-1060872184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:47:27 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-37ea8237-18a1-4b3f-b6bc-bf97ef02d33f tempest-VolumesTransfersV355Test-1060872184 None] Flow 'volume_create_manager' (7d6add01-25ee-48f4-b694-d85fd9260c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:47:27 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-37ea8237-18a1-4b3f-b6bc-bf97ef02d33f tempest-VolumesTransfersV355Test-1060872184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b59303cb-ffd3-4159-a918-f3975635f2f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:27 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-37ea8237-18a1-4b3f-b6bc-bf97ef02d33f tempest-VolumesTransfersV355Test-1060872184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b59303cb-ffd3-4159-a918-f3975635f2f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:47:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-126944363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fadc0296-a295-4ce7-ab79-a95bbe3718f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8c99ca7f45b4498aa11b9b8d55018a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:47:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:47:28Z,use_quota=True,user_id='05ea00f6464b40da8a21e2389006bf20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:27 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-37ea8237-18a1-4b3f-b6bc-bf97ef02d33f tempest-VolumesTransfersV355Test-1060872184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e9eeba5-cb63-4497-90cd-e3b39cf53f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:27 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-37ea8237-18a1-4b3f-b6bc-bf97ef02d33f tempest-VolumesTransfersV355Test-1060872184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e9eeba5-cb63-4497-90cd-e3b39cf53f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:27 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-37ea8237-18a1-4b3f-b6bc-bf97ef02d33f tempest-VolumesTransfersV355Test-1060872184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a25661cc-59d2-4539-9f63-2de88d1cc629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:27 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-37ea8237-18a1-4b3f-b6bc-bf97ef02d33f tempest-VolumesTransfersV355Test-1060872184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a25661cc-59d2-4539-9f63-2de88d1cc629) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fadc0296-a295-4ce7-ab79-a95bbe3718f5', 'volume_name': 'volume-fadc0296-a295-4ce7-ab79-a95bbe3718f5', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:27 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-37ea8237-18a1-4b3f-b6bc-bf97ef02d33f tempest-VolumesTransfersV355Test-1060872184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fc572ac-a92a-4b44-9ff1-ea9c22ffc127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:27 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-37ea8237-18a1-4b3f-b6bc-bf97ef02d33f tempest-VolumesTransfersV355Test-1060872184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fc572ac-a92a-4b44-9ff1-ea9c22ffc127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:27 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-37ea8237-18a1-4b3f-b6bc-bf97ef02d33f tempest-VolumesTransfersV355Test-1060872184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0fd1a84-07d2-40fb-8d44-ae7f4cc9672a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:27 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-37ea8237-18a1-4b3f-b6bc-bf97ef02d33f tempest-VolumesTransfersV355Test-1060872184 None] Volume fadc0296-a295-4ce7-ab79-a95bbe3718f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fadc0296-a295-4ce7-ab79-a95bbe3718f5', 'volume_size': 1} Sep 25 11:47:27 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-37ea8237-18a1-4b3f-b6bc-bf97ef02d33f tempest-VolumesTransfersV355Test-1060872184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:47:27 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-37ea8237-18a1-4b3f-b6bc-bf97ef02d33f tempest-VolumesTransfersV355Test-1060872184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:47:27 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-37ea8237-18a1-4b3f-b6bc-bf97ef02d33f tempest-VolumesTransfersV355Test-1060872184 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:47:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-126944363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fadc0296-a295-4ce7-ab79-a95bbe3718f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8c99ca7f45b4498aa11b9b8d55018a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:47:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:47:28Z,use_quota=True,user_id='05ea00f6464b40da8a21e2389006bf20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:47:27 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-37ea8237-18a1-4b3f-b6bc-bf97ef02d33f tempest-VolumesTransfersV355Test-1060872184 None] Creating volume fadc0296-a295-4ce7-ab79-a95bbe3718f5 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:47:27 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-37ea8237-18a1-4b3f-b6bc-bf97ef02d33f tempest-VolumesTransfersV355Test-1060872184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:47:27 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-37ea8237-18a1-4b3f-b6bc-bf97ef02d33f tempest-VolumesTransfersV355Test-1060872184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:47:27 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-37ea8237-18a1-4b3f-b6bc-bf97ef02d33f tempest-VolumesTransfersV355Test-1060872184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:47:27 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-37ea8237-18a1-4b3f-b6bc-bf97ef02d33f tempest-VolumesTransfersV355Test-1060872184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:47:27 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-37ea8237-18a1-4b3f-b6bc-bf97ef02d33f tempest-VolumesTransfersV355Test-1060872184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:47:27 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-37ea8237-18a1-4b3f-b6bc-bf97ef02d33f tempest-VolumesTransfersV355Test-1060872184 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:47:27 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-37ea8237-18a1-4b3f-b6bc-bf97ef02d33f tempest-VolumesTransfersV355Test-1060872184 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:47:27 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-37ea8237-18a1-4b3f-b6bc-bf97ef02d33f tempest-VolumesTransfersV355Test-1060872184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fadc0296-a295-4ce7-ab79-a95bbe3718f5 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:27 devstack sudo[97489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fadc0296-a295-4ce7-ab79-a95bbe3718f5 1073741824 Sep 25 11:47:27 devstack sudo[97489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:27 devstack sudo[97487]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:27 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-dd72bc53-c4ef-414d-a8d5-02a9cb9db545 tempest-GroupsTest-2040236940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c1cdd6b6-4d3d-4ffc-b756-68dced88a035" returned: 0 in 0.429s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:28 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-dd72bc53-c4ef-414d-a8d5-02a9cb9db545 tempest-GroupsTest-2040236940 None] Lock "cinder-quobyte-c1cdd6b6-4d3d-4ffc-b756-68dced88a035" released by "delete_volume" :: held 1.409s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:47:28 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-dd72bc53-c4ef-414d-a8d5-02a9cb9db545 tempest-GroupsTest-2040236940 None] Acquiring lock "cinder-quobyte-f5a093f2-cd5b-4592-aecc-29c084d81b0b" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:47:28 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-dd72bc53-c4ef-414d-a8d5-02a9cb9db545 tempest-GroupsTest-2040236940 None] Lock "cinder-quobyte-f5a093f2-cd5b-4592-aecc-29c084d81b0b" acquired by "delete_volume" :: waited 0.047s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:47:28 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[0164fa45-1c76-4128-a82c-38be2cf239c7]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:47:28 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-dd72bc53-c4ef-414d-a8d5-02a9cb9db545 tempest-GroupsTest-2040236940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f5a093f2-cd5b-4592-aecc-29c084d81b0b {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:28 devstack sudo[97492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f5a093f2-cd5b-4592-aecc-29c084d81b0b Sep 25 11:47:28 devstack sudo[97492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:28 devstack sudo[97489]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:28 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-37ea8237-18a1-4b3f-b6bc-bf97ef02d33f tempest-VolumesTransfersV355Test-1060872184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fadc0296-a295-4ce7-ab79-a95bbe3718f5 1073741824" returned: 0 in 0.939s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:28 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-37ea8237-18a1-4b3f-b6bc-bf97ef02d33f tempest-VolumesTransfersV355Test-1060872184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fadc0296-a295-4ce7-ab79-a95bbe3718f5 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:28 devstack sudo[97500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fadc0296-a295-4ce7-ab79-a95bbe3718f5 Sep 25 11:47:28 devstack sudo[97500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:28 devstack sudo[97492]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:28 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-dd72bc53-c4ef-414d-a8d5-02a9cb9db545 tempest-GroupsTest-2040236940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f5a093f2-cd5b-4592-aecc-29c084d81b0b" returned: 0 in 0.835s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:28 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-dd72bc53-c4ef-414d-a8d5-02a9cb9db545 tempest-GroupsTest-2040236940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f5a093f2-cd5b-4592-aecc-29c084d81b0b {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:29 devstack sudo[97503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f5a093f2-cd5b-4592-aecc-29c084d81b0b Sep 25 11:47:29 devstack sudo[97503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:29 devstack sudo[97500]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:29 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-37ea8237-18a1-4b3f-b6bc-bf97ef02d33f tempest-VolumesTransfersV355Test-1060872184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fadc0296-a295-4ce7-ab79-a95bbe3718f5" returned: 0 in 0.467s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:29 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-37ea8237-18a1-4b3f-b6bc-bf97ef02d33f tempest-VolumesTransfersV355Test-1060872184 None] <== create_volume: return (1499ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:47:29 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-37ea8237-18a1-4b3f-b6bc-bf97ef02d33f tempest-VolumesTransfersV355Test-1060872184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.504s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:47:29 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-37ea8237-18a1-4b3f-b6bc-bf97ef02d33f tempest-VolumesTransfersV355Test-1060872184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0fd1a84-07d2-40fb-8d44-ae7f4cc9672a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fadc0296-a295-4ce7-ab79-a95bbe3718f5', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:29 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-37ea8237-18a1-4b3f-b6bc-bf97ef02d33f tempest-VolumesTransfersV355Test-1060872184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ebad4bc-93fd-4612-a8cc-30c81d442e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:29 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-37ea8237-18a1-4b3f-b6bc-bf97ef02d33f tempest-VolumesTransfersV355Test-1060872184 None] Volume volume-fadc0296-a295-4ce7-ab79-a95bbe3718f5 (fadc0296-a295-4ce7-ab79-a95bbe3718f5): created successfully Sep 25 11:47:29 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-37ea8237-18a1-4b3f-b6bc-bf97ef02d33f tempest-VolumesTransfersV355Test-1060872184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ebad4bc-93fd-4612-a8cc-30c81d442e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:29 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-37ea8237-18a1-4b3f-b6bc-bf97ef02d33f tempest-VolumesTransfersV355Test-1060872184 None] Flow 'volume_create_manager' (7d6add01-25ee-48f4-b694-d85fd9260c10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:47:29 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-37ea8237-18a1-4b3f-b6bc-bf97ef02d33f tempest-VolumesTransfersV355Test-1060872184 None] Created volume successfully. Sep 25 11:47:29 devstack sudo[97503]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:29 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-dd72bc53-c4ef-414d-a8d5-02a9cb9db545 tempest-GroupsTest-2040236940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f5a093f2-cd5b-4592-aecc-29c084d81b0b" returned: 0 in 0.466s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:29 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-dd72bc53-c4ef-414d-a8d5-02a9cb9db545 tempest-GroupsTest-2040236940 None] Lock "cinder-quobyte-f5a093f2-cd5b-4592-aecc-29c084d81b0b" released by "delete_volume" :: held 1.414s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:47:29 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-dd72bc53-c4ef-414d-a8d5-02a9cb9db545 tempest-GroupsTest-2040236940 None] Created reservations ['a97b5850-ffb8-4157-8c64-ee15e813ffec'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:47:29 devstack cinder-volume[86984]: WARNING cinder.quota [None req-dd72bc53-c4ef-414d-a8d5-02a9cb9db545 tempest-GroupsTest-2040236940 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-123289919 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-123289919, it is now deprecated. Please use the default quota class for default quota. Sep 25 11:47:29 devstack cinder-volume[86984]: WARNING cinder.quota [None req-dd72bc53-c4ef-414d-a8d5-02a9cb9db545 tempest-GroupsTest-2040236940 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-123289919 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-123289919, it is now deprecated. Please use the default quota class for default quota. Sep 25 11:47:29 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-dd72bc53-c4ef-414d-a8d5-02a9cb9db545 tempest-GroupsTest-2040236940 None] Created reservations ['2d0b481a-4669-488e-b1f6-44ceb05cea2b', '46686c8d-5203-4e4e-be51-3a6bb69db92b', '2653d62c-4e6a-4b41-b278-9dcf0553ab1e', 'b80a46dd-dad4-4e8a-bfe0-fef98e8b477f'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:47:29 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d3b7872-0e1a-4967-8d39-a0b771dfdde1 tempest-VolumesTransfersTest-558307192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:47:29 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-9d3b7872-0e1a-4967-8d39-a0b771dfdde1 tempest-VolumesTransfersTest-558307192 None] Flow 'volume_create_manager' (f913f361-6321-4a44-9f0e-e2ba5437cf28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:47:29 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-9d3b7872-0e1a-4967-8d39-a0b771dfdde1 tempest-VolumesTransfersTest-558307192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7b36dfa-82fd-4def-b7bf-d659eacd6069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:29 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-9d3b7872-0e1a-4967-8d39-a0b771dfdde1 tempest-VolumesTransfersTest-558307192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7b36dfa-82fd-4def-b7bf-d659eacd6069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:47:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1320604313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1928f862-d526-41c5-8bcb-735654a85f3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79609525640c4fe6b98bce2159f48798',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:47:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:47:30Z,use_quota=True,user_id='744c806d9c6a44c8852dc783a3459888',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:29 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-9d3b7872-0e1a-4967-8d39-a0b771dfdde1 tempest-VolumesTransfersTest-558307192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (549167c4-656a-4ee2-b276-b5a40a567064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:29 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-9d3b7872-0e1a-4967-8d39-a0b771dfdde1 tempest-VolumesTransfersTest-558307192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (549167c4-656a-4ee2-b276-b5a40a567064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:29 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-9d3b7872-0e1a-4967-8d39-a0b771dfdde1 tempest-VolumesTransfersTest-558307192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46602d81-ee08-4918-b290-d82fd2ff538b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:29 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-9d3b7872-0e1a-4967-8d39-a0b771dfdde1 tempest-VolumesTransfersTest-558307192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46602d81-ee08-4918-b290-d82fd2ff538b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1928f862-d526-41c5-8bcb-735654a85f3f', 'volume_name': 'volume-1928f862-d526-41c5-8bcb-735654a85f3f', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:29 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-9d3b7872-0e1a-4967-8d39-a0b771dfdde1 tempest-VolumesTransfersTest-558307192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b600846-2ee2-4924-a57a-493ed6621979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:29 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-9d3b7872-0e1a-4967-8d39-a0b771dfdde1 tempest-VolumesTransfersTest-558307192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b600846-2ee2-4924-a57a-493ed6621979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:29 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-9d3b7872-0e1a-4967-8d39-a0b771dfdde1 tempest-VolumesTransfersTest-558307192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9af9c8c9-7d67-4a56-b955-317b65a99e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:29 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-9d3b7872-0e1a-4967-8d39-a0b771dfdde1 tempest-VolumesTransfersTest-558307192 None] Volume 1928f862-d526-41c5-8bcb-735654a85f3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1928f862-d526-41c5-8bcb-735654a85f3f', 'volume_size': 1} Sep 25 11:47:29 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-9d3b7872-0e1a-4967-8d39-a0b771dfdde1 tempest-VolumesTransfersTest-558307192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:47:29 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-9d3b7872-0e1a-4967-8d39-a0b771dfdde1 tempest-VolumesTransfersTest-558307192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:47:29 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-9d3b7872-0e1a-4967-8d39-a0b771dfdde1 tempest-VolumesTransfersTest-558307192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:47:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1320604313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1928f862-d526-41c5-8bcb-735654a85f3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79609525640c4fe6b98bce2159f48798',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:47:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:47:30Z,use_quota=True,user_id='744c806d9c6a44c8852dc783a3459888',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:47:29 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-9d3b7872-0e1a-4967-8d39-a0b771dfdde1 tempest-VolumesTransfersTest-558307192 None] Creating volume 1928f862-d526-41c5-8bcb-735654a85f3f {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:47:29 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-9d3b7872-0e1a-4967-8d39-a0b771dfdde1 tempest-VolumesTransfersTest-558307192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:47:29 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-9d3b7872-0e1a-4967-8d39-a0b771dfdde1 tempest-VolumesTransfersTest-558307192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:47:29 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-9d3b7872-0e1a-4967-8d39-a0b771dfdde1 tempest-VolumesTransfersTest-558307192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:47:29 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-9d3b7872-0e1a-4967-8d39-a0b771dfdde1 tempest-VolumesTransfersTest-558307192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:47:29 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-9d3b7872-0e1a-4967-8d39-a0b771dfdde1 tempest-VolumesTransfersTest-558307192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:47:29 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-9d3b7872-0e1a-4967-8d39-a0b771dfdde1 tempest-VolumesTransfersTest-558307192 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:47:29 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-9d3b7872-0e1a-4967-8d39-a0b771dfdde1 tempest-VolumesTransfersTest-558307192 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:47:29 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-9d3b7872-0e1a-4967-8d39-a0b771dfdde1 tempest-VolumesTransfersTest-558307192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1928f862-d526-41c5-8bcb-735654a85f3f 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:29 devstack sudo[97507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1928f862-d526-41c5-8bcb-735654a85f3f 1073741824 Sep 25 11:47:29 devstack sudo[97507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:30 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-dd72bc53-c4ef-414d-a8d5-02a9cb9db545 tempest-GroupsTest-2040236940 None] Created reservations ['8684d626-a538-47f3-905a-516d9dbf7f67', '55ff0d11-ed71-4fa3-8333-f35e2dd7c106', 'f00adbec-49d1-44a7-be65-67ae0fab3c85', '549c99c9-e0ab-4afb-aa0b-e581e0983889'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:47:30 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-dd72bc53-c4ef-414d-a8d5-02a9cb9db545 tempest-GroupsTest-2040236940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:47:30 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-dd72bc53-c4ef-414d-a8d5-02a9cb9db545 tempest-GroupsTest-2040236940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:47:30 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-dd72bc53-c4ef-414d-a8d5-02a9cb9db545 tempest-GroupsTest-2040236940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:47:30 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-dd72bc53-c4ef-414d-a8d5-02a9cb9db545 tempest-GroupsTest-2040236940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:47:30 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-dd72bc53-c4ef-414d-a8d5-02a9cb9db545 tempest-GroupsTest-2040236940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:47:30 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-dd72bc53-c4ef-414d-a8d5-02a9cb9db545 tempest-GroupsTest-2040236940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:30 devstack sudo[97513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:47:30 devstack sudo[97513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:31 devstack sudo[97507]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:31 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-9d3b7872-0e1a-4967-8d39-a0b771dfdde1 tempest-VolumesTransfersTest-558307192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1928f862-d526-41c5-8bcb-735654a85f3f 1073741824" returned: 0 in 1.150s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:31 devstack sudo[97513]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:31 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-dd72bc53-c4ef-414d-a8d5-02a9cb9db545 tempest-GroupsTest-2040236940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.616s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:31 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-dd72bc53-c4ef-414d-a8d5-02a9cb9db545 tempest-GroupsTest-2040236940 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:47:31 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-9d3b7872-0e1a-4967-8d39-a0b771dfdde1 tempest-VolumesTransfersTest-558307192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1928f862-d526-41c5-8bcb-735654a85f3f {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:31 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-dd72bc53-c4ef-414d-a8d5-02a9cb9db545 tempest-GroupsTest-2040236940 None] Delete group completed successfully. Sep 25 11:47:31 devstack sudo[97518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1928f862-d526-41c5-8bcb-735654a85f3f Sep 25 11:47:31 devstack sudo[97518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:31 devstack sudo[97518]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:31 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-eb2e05bb-e4f4-45d0-b91a-9ab725bf57a9 tempest-VolumesTransfersV355Test-960428646 None] Transfer volume completed successfully. Sep 25 11:47:31 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-9d3b7872-0e1a-4967-8d39-a0b771dfdde1 tempest-VolumesTransfersTest-558307192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1928f862-d526-41c5-8bcb-735654a85f3f" returned: 0 in 0.765s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:31 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-9d3b7872-0e1a-4967-8d39-a0b771dfdde1 tempest-VolumesTransfersTest-558307192 None] <== create_volume: return (2044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:47:31 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-9d3b7872-0e1a-4967-8d39-a0b771dfdde1 tempest-VolumesTransfersTest-558307192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.051s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:47:31 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-9d3b7872-0e1a-4967-8d39-a0b771dfdde1 tempest-VolumesTransfersTest-558307192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9af9c8c9-7d67-4a56-b955-317b65a99e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1928f862-d526-41c5-8bcb-735654a85f3f', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:32 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-9d3b7872-0e1a-4967-8d39-a0b771dfdde1 tempest-VolumesTransfersTest-558307192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7be8398-d52a-4271-9d04-03fe7d065849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:32 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-9d3b7872-0e1a-4967-8d39-a0b771dfdde1 tempest-VolumesTransfersTest-558307192 None] Volume volume-1928f862-d526-41c5-8bcb-735654a85f3f (1928f862-d526-41c5-8bcb-735654a85f3f): created successfully Sep 25 11:47:32 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-9d3b7872-0e1a-4967-8d39-a0b771dfdde1 tempest-VolumesTransfersTest-558307192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7be8398-d52a-4271-9d04-03fe7d065849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:32 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-9d3b7872-0e1a-4967-8d39-a0b771dfdde1 tempest-VolumesTransfersTest-558307192 None] Flow 'volume_create_manager' (f913f361-6321-4a44-9f0e-e2ba5437cf28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:47:32 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-9d3b7872-0e1a-4967-8d39-a0b771dfdde1 tempest-VolumesTransfersTest-558307192 None] Created volume successfully. Sep 25 11:47:33 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-cd04c0d0-4775-49a7-800d-ccdea8410d6f tempest-VolumesTransfersV355Test-1501118606 None] Acquiring lock "cinder-fadc0296-a295-4ce7-ab79-a95bbe3718f5-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:47:33 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-cd04c0d0-4775-49a7-800d-ccdea8410d6f tempest-VolumesTransfersV355Test-1501118606 None] Lock "cinder-fadc0296-a295-4ce7-ab79-a95bbe3718f5-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:47:33 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-cd04c0d0-4775-49a7-800d-ccdea8410d6f tempest-VolumesTransfersV355Test-1501118606 None] Acquiring lock "cinder-quobyte-fadc0296-a295-4ce7-ab79-a95bbe3718f5" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:47:33 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-cd04c0d0-4775-49a7-800d-ccdea8410d6f tempest-VolumesTransfersV355Test-1501118606 None] Lock "cinder-quobyte-fadc0296-a295-4ce7-ab79-a95bbe3718f5" acquired by "delete_volume" :: waited 0.037s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:47:33 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[a75e1cbb-1d6e-4332-b567-037313b3b2f4]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:47:33 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cd04c0d0-4775-49a7-800d-ccdea8410d6f tempest-VolumesTransfersV355Test-1501118606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fadc0296-a295-4ce7-ab79-a95bbe3718f5 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:33 devstack sudo[97522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fadc0296-a295-4ce7-ab79-a95bbe3718f5 Sep 25 11:47:33 devstack sudo[97522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:33 devstack sudo[97522]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:33 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cd04c0d0-4775-49a7-800d-ccdea8410d6f tempest-VolumesTransfersV355Test-1501118606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fadc0296-a295-4ce7-ab79-a95bbe3718f5" returned: 0 in 0.586s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:33 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cd04c0d0-4775-49a7-800d-ccdea8410d6f tempest-VolumesTransfersV355Test-1501118606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fadc0296-a295-4ce7-ab79-a95bbe3718f5 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:33 devstack sudo[97527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fadc0296-a295-4ce7-ab79-a95bbe3718f5 Sep 25 11:47:33 devstack sudo[97527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:34 devstack sudo[97527]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:34 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cd04c0d0-4775-49a7-800d-ccdea8410d6f tempest-VolumesTransfersV355Test-1501118606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fadc0296-a295-4ce7-ab79-a95bbe3718f5" returned: 0 in 0.497s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:34 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-cd04c0d0-4775-49a7-800d-ccdea8410d6f tempest-VolumesTransfersV355Test-1501118606 None] Lock "cinder-quobyte-fadc0296-a295-4ce7-ab79-a95bbe3718f5" released by "delete_volume" :: held 1.149s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:47:34 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-a75630d4-fbf2-4757-869f-86bde09788ac tempest-VolumesTransfersTest-97508712 None] Transfer volume completed successfully. Sep 25 11:47:34 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-cd04c0d0-4775-49a7-800d-ccdea8410d6f tempest-VolumesTransfersV355Test-1501118606 None] Created reservations ['ac0244ff-6d77-4184-8e95-280c16f30107', '93a98d7d-ae45-4ee6-b3a8-291f1eb52d28', 'e32cf6fb-5dc5-4e91-b253-5359367f3ae0', '9e0924cb-c551-4d0d-9669-61c44af05558'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:47:34 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-cd04c0d0-4775-49a7-800d-ccdea8410d6f tempest-VolumesTransfersV355Test-1501118606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:47:34 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-cd04c0d0-4775-49a7-800d-ccdea8410d6f tempest-VolumesTransfersV355Test-1501118606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:47:34 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-cd04c0d0-4775-49a7-800d-ccdea8410d6f tempest-VolumesTransfersV355Test-1501118606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:47:34 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-cd04c0d0-4775-49a7-800d-ccdea8410d6f tempest-VolumesTransfersV355Test-1501118606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:47:34 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-cd04c0d0-4775-49a7-800d-ccdea8410d6f tempest-VolumesTransfersV355Test-1501118606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:47:34 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cd04c0d0-4775-49a7-800d-ccdea8410d6f tempest-VolumesTransfersV355Test-1501118606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:34 devstack sudo[97530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:47:34 devstack sudo[97530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:35 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c00e999-1ac2-4d57-90b9-1ebca94bdc7b tempest-VolumesActionsTest-794756051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:47:35 devstack sudo[97530]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:35 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2c00e999-1ac2-4d57-90b9-1ebca94bdc7b tempest-VolumesActionsTest-794756051 None] Flow 'volume_create_manager' (43ed559d-c8fd-49e5-8529-37585d97f4b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:47:35 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2c00e999-1ac2-4d57-90b9-1ebca94bdc7b tempest-VolumesActionsTest-794756051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (351c8382-c61b-41bf-b9e0-21fcc04093d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:35 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cd04c0d0-4775-49a7-800d-ccdea8410d6f tempest-VolumesTransfersV355Test-1501118606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.548s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:35 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-cd04c0d0-4775-49a7-800d-ccdea8410d6f tempest-VolumesTransfersV355Test-1501118606 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:47:35 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-cd04c0d0-4775-49a7-800d-ccdea8410d6f tempest-VolumesTransfersV355Test-1501118606 None] Deleted volume successfully. Sep 25 11:47:35 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2c00e999-1ac2-4d57-90b9-1ebca94bdc7b tempest-VolumesActionsTest-794756051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (351c8382-c61b-41bf-b9e0-21fcc04093d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:47:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2005295536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a630d61-19c6-487b-abd2-6c3a21b3d7fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8177ff78a1e34f62b7b1cda033d40f10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:47:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:47:35Z,use_quota=True,user_id='d471bb98d14e4f43b03561e022fd0b1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:35 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2c00e999-1ac2-4d57-90b9-1ebca94bdc7b tempest-VolumesActionsTest-794756051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7570ff0-113e-48c4-959f-b6363b06ce81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:35 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2c00e999-1ac2-4d57-90b9-1ebca94bdc7b tempest-VolumesActionsTest-794756051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7570ff0-113e-48c4-959f-b6363b06ce81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:35 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2c00e999-1ac2-4d57-90b9-1ebca94bdc7b tempest-VolumesActionsTest-794756051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba04359b-7201-4311-bef7-08df4a81009d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:35 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2c00e999-1ac2-4d57-90b9-1ebca94bdc7b tempest-VolumesActionsTest-794756051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba04359b-7201-4311-bef7-08df4a81009d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a630d61-19c6-487b-abd2-6c3a21b3d7fe', 'volume_name': 'volume-1a630d61-19c6-487b-abd2-6c3a21b3d7fe', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:35 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2c00e999-1ac2-4d57-90b9-1ebca94bdc7b tempest-VolumesActionsTest-794756051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (754c4b09-1c63-4990-a697-87818ae63482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:35 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2c00e999-1ac2-4d57-90b9-1ebca94bdc7b tempest-VolumesActionsTest-794756051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (754c4b09-1c63-4990-a697-87818ae63482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:35 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2c00e999-1ac2-4d57-90b9-1ebca94bdc7b tempest-VolumesActionsTest-794756051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7e37e61-4a15-46c3-bf83-babcd289671f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:35 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-2c00e999-1ac2-4d57-90b9-1ebca94bdc7b tempest-VolumesActionsTest-794756051 None] Volume 1a630d61-19c6-487b-abd2-6c3a21b3d7fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a630d61-19c6-487b-abd2-6c3a21b3d7fe', 'volume_size': 1} Sep 25 11:47:35 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-2c00e999-1ac2-4d57-90b9-1ebca94bdc7b tempest-VolumesActionsTest-794756051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:47:35 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-2c00e999-1ac2-4d57-90b9-1ebca94bdc7b tempest-VolumesActionsTest-794756051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:47:35 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-2c00e999-1ac2-4d57-90b9-1ebca94bdc7b tempest-VolumesActionsTest-794756051 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:47:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2005295536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a630d61-19c6-487b-abd2-6c3a21b3d7fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8177ff78a1e34f62b7b1cda033d40f10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:47:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:47:35Z,use_quota=True,user_id='d471bb98d14e4f43b03561e022fd0b1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:47:35 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-2c00e999-1ac2-4d57-90b9-1ebca94bdc7b tempest-VolumesActionsTest-794756051 None] Creating volume 1a630d61-19c6-487b-abd2-6c3a21b3d7fe {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:47:35 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-2c00e999-1ac2-4d57-90b9-1ebca94bdc7b tempest-VolumesActionsTest-794756051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:47:35 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-2c00e999-1ac2-4d57-90b9-1ebca94bdc7b tempest-VolumesActionsTest-794756051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:47:35 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-2c00e999-1ac2-4d57-90b9-1ebca94bdc7b tempest-VolumesActionsTest-794756051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:47:35 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-2c00e999-1ac2-4d57-90b9-1ebca94bdc7b tempest-VolumesActionsTest-794756051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:47:35 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-2c00e999-1ac2-4d57-90b9-1ebca94bdc7b tempest-VolumesActionsTest-794756051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:47:35 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-2c00e999-1ac2-4d57-90b9-1ebca94bdc7b tempest-VolumesActionsTest-794756051 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:47:35 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-2c00e999-1ac2-4d57-90b9-1ebca94bdc7b tempest-VolumesActionsTest-794756051 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:47:35 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2c00e999-1ac2-4d57-90b9-1ebca94bdc7b tempest-VolumesActionsTest-794756051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a630d61-19c6-487b-abd2-6c3a21b3d7fe 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:35 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-cd04c0d0-4775-49a7-800d-ccdea8410d6f tempest-VolumesTransfersV355Test-1501118606 None] Lock "cinder-fadc0296-a295-4ce7-ab79-a95bbe3718f5-delete_volume" released by "delete_volume" :: held 2.302s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:47:35 devstack sudo[97533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a630d61-19c6-487b-abd2-6c3a21b3d7fe 1073741824 Sep 25 11:47:35 devstack sudo[97533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:35 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-05045b59-52af-4eee-b24f-34b3de297ff5 tempest-VolumesTransfersV355Test-1060872184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:47:35 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-05045b59-52af-4eee-b24f-34b3de297ff5 tempest-VolumesTransfersV355Test-1060872184 None] Flow 'volume_create_manager' (b7762969-9ef3-4df0-a328-0acdbc08b364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:47:35 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-05045b59-52af-4eee-b24f-34b3de297ff5 tempest-VolumesTransfersV355Test-1060872184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32840b74-bb42-4d19-bb86-1aec30e3f9ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:35 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-05045b59-52af-4eee-b24f-34b3de297ff5 tempest-VolumesTransfersV355Test-1060872184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32840b74-bb42-4d19-bb86-1aec30e3f9ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:47:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2085339782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09a25deb-3f6c-4813-9da1-5844f90020a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8c99ca7f45b4498aa11b9b8d55018a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:47:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:47:36Z,use_quota=True,user_id='05ea00f6464b40da8a21e2389006bf20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:35 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-05045b59-52af-4eee-b24f-34b3de297ff5 tempest-VolumesTransfersV355Test-1060872184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a41a2011-69ff-4f3d-a777-1653656f43fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:35 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-05045b59-52af-4eee-b24f-34b3de297ff5 tempest-VolumesTransfersV355Test-1060872184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a41a2011-69ff-4f3d-a777-1653656f43fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:35 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-05045b59-52af-4eee-b24f-34b3de297ff5 tempest-VolumesTransfersV355Test-1060872184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fce30ae0-3962-46b2-96da-1026d6403ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:35 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-05045b59-52af-4eee-b24f-34b3de297ff5 tempest-VolumesTransfersV355Test-1060872184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fce30ae0-3962-46b2-96da-1026d6403ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09a25deb-3f6c-4813-9da1-5844f90020a1', 'volume_name': 'volume-09a25deb-3f6c-4813-9da1-5844f90020a1', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:35 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-05045b59-52af-4eee-b24f-34b3de297ff5 tempest-VolumesTransfersV355Test-1060872184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de8b6737-e6d7-4182-b787-4b238624f8ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:35 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-05045b59-52af-4eee-b24f-34b3de297ff5 tempest-VolumesTransfersV355Test-1060872184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de8b6737-e6d7-4182-b787-4b238624f8ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:35 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-05045b59-52af-4eee-b24f-34b3de297ff5 tempest-VolumesTransfersV355Test-1060872184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25a82eef-6d83-4044-88f8-aa167b20d37b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:35 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-05045b59-52af-4eee-b24f-34b3de297ff5 tempest-VolumesTransfersV355Test-1060872184 None] Volume 09a25deb-3f6c-4813-9da1-5844f90020a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09a25deb-3f6c-4813-9da1-5844f90020a1', 'volume_size': 1} Sep 25 11:47:35 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-05045b59-52af-4eee-b24f-34b3de297ff5 tempest-VolumesTransfersV355Test-1060872184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:47:35 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e080cc2a-3206-4d6f-88aa-adae2a056086 tempest-VolumesTransfersTest-1388949388 None] Acquiring lock "cinder-1928f862-d526-41c5-8bcb-735654a85f3f-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:47:35 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e080cc2a-3206-4d6f-88aa-adae2a056086 tempest-VolumesTransfersTest-1388949388 None] Lock "cinder-1928f862-d526-41c5-8bcb-735654a85f3f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:47:36 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e080cc2a-3206-4d6f-88aa-adae2a056086 tempest-VolumesTransfersTest-1388949388 None] Acquiring lock "cinder-quobyte-1928f862-d526-41c5-8bcb-735654a85f3f" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:47:36 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e080cc2a-3206-4d6f-88aa-adae2a056086 tempest-VolumesTransfersTest-1388949388 None] Lock "cinder-quobyte-1928f862-d526-41c5-8bcb-735654a85f3f" acquired by "delete_volume" :: waited 0.029s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:47:36 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[371bc73c-b782-4712-afcc-0d67cf599135]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:47:36 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e080cc2a-3206-4d6f-88aa-adae2a056086 tempest-VolumesTransfersTest-1388949388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1928f862-d526-41c5-8bcb-735654a85f3f {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:36 devstack sudo[97533]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:36 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2c00e999-1ac2-4d57-90b9-1ebca94bdc7b tempest-VolumesActionsTest-794756051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a630d61-19c6-487b-abd2-6c3a21b3d7fe 1073741824" returned: 0 in 0.827s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:36 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2c00e999-1ac2-4d57-90b9-1ebca94bdc7b tempest-VolumesActionsTest-794756051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a630d61-19c6-487b-abd2-6c3a21b3d7fe {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:36 devstack sudo[97540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a630d61-19c6-487b-abd2-6c3a21b3d7fe Sep 25 11:47:36 devstack sudo[97540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:36 devstack sudo[97539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1928f862-d526-41c5-8bcb-735654a85f3f Sep 25 11:47:36 devstack sudo[97539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:36 devstack sudo[97540]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:36 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2c00e999-1ac2-4d57-90b9-1ebca94bdc7b tempest-VolumesActionsTest-794756051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a630d61-19c6-487b-abd2-6c3a21b3d7fe" returned: 0 in 0.381s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:36 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-2c00e999-1ac2-4d57-90b9-1ebca94bdc7b tempest-VolumesActionsTest-794756051 None] <== create_volume: return (1280ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:47:36 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-2c00e999-1ac2-4d57-90b9-1ebca94bdc7b tempest-VolumesActionsTest-794756051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.289s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:47:36 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-05045b59-52af-4eee-b24f-34b3de297ff5 tempest-VolumesTransfersV355Test-1060872184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.677s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:47:36 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-05045b59-52af-4eee-b24f-34b3de297ff5 tempest-VolumesTransfersV355Test-1060872184 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:47:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2085339782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09a25deb-3f6c-4813-9da1-5844f90020a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8c99ca7f45b4498aa11b9b8d55018a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:47:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:47:36Z,use_quota=True,user_id='05ea00f6464b40da8a21e2389006bf20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:47:36 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-05045b59-52af-4eee-b24f-34b3de297ff5 tempest-VolumesTransfersV355Test-1060872184 None] Creating volume 09a25deb-3f6c-4813-9da1-5844f90020a1 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:47:36 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-05045b59-52af-4eee-b24f-34b3de297ff5 tempest-VolumesTransfersV355Test-1060872184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:47:36 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-05045b59-52af-4eee-b24f-34b3de297ff5 tempest-VolumesTransfersV355Test-1060872184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:47:36 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-05045b59-52af-4eee-b24f-34b3de297ff5 tempest-VolumesTransfersV355Test-1060872184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:47:36 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-05045b59-52af-4eee-b24f-34b3de297ff5 tempest-VolumesTransfersV355Test-1060872184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:47:36 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-05045b59-52af-4eee-b24f-34b3de297ff5 tempest-VolumesTransfersV355Test-1060872184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:47:36 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-05045b59-52af-4eee-b24f-34b3de297ff5 tempest-VolumesTransfersV355Test-1060872184 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:47:36 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-05045b59-52af-4eee-b24f-34b3de297ff5 tempest-VolumesTransfersV355Test-1060872184 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:47:36 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-05045b59-52af-4eee-b24f-34b3de297ff5 tempest-VolumesTransfersV355Test-1060872184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-09a25deb-3f6c-4813-9da1-5844f90020a1 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:36 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2c00e999-1ac2-4d57-90b9-1ebca94bdc7b tempest-VolumesActionsTest-794756051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7e37e61-4a15-46c3-bf83-babcd289671f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a630d61-19c6-487b-abd2-6c3a21b3d7fe', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:36 devstack sudo[97544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-09a25deb-3f6c-4813-9da1-5844f90020a1 1073741824 Sep 25 11:47:36 devstack sudo[97544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:36 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2c00e999-1ac2-4d57-90b9-1ebca94bdc7b tempest-VolumesActionsTest-794756051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3cc700a-0b46-4318-92d2-bd79a61a29b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:36 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-2c00e999-1ac2-4d57-90b9-1ebca94bdc7b tempest-VolumesActionsTest-794756051 None] Volume volume-1a630d61-19c6-487b-abd2-6c3a21b3d7fe (1a630d61-19c6-487b-abd2-6c3a21b3d7fe): created successfully Sep 25 11:47:36 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2c00e999-1ac2-4d57-90b9-1ebca94bdc7b tempest-VolumesActionsTest-794756051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3cc700a-0b46-4318-92d2-bd79a61a29b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:36 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2c00e999-1ac2-4d57-90b9-1ebca94bdc7b tempest-VolumesActionsTest-794756051 None] Flow 'volume_create_manager' (43ed559d-c8fd-49e5-8529-37585d97f4b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:47:36 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-2c00e999-1ac2-4d57-90b9-1ebca94bdc7b tempest-VolumesActionsTest-794756051 None] Created volume successfully. Sep 25 11:47:36 devstack sudo[97539]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:36 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e080cc2a-3206-4d6f-88aa-adae2a056086 tempest-VolumesTransfersTest-1388949388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1928f862-d526-41c5-8bcb-735654a85f3f" returned: 0 in 0.678s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:36 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e080cc2a-3206-4d6f-88aa-adae2a056086 tempest-VolumesTransfersTest-1388949388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1928f862-d526-41c5-8bcb-735654a85f3f {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:36 devstack sudo[97550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1928f862-d526-41c5-8bcb-735654a85f3f Sep 25 11:47:36 devstack sudo[97550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:37 devstack sudo[97550]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:37 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e080cc2a-3206-4d6f-88aa-adae2a056086 tempest-VolumesTransfersTest-1388949388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1928f862-d526-41c5-8bcb-735654a85f3f" returned: 0 in 0.504s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:37 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e080cc2a-3206-4d6f-88aa-adae2a056086 tempest-VolumesTransfersTest-1388949388 None] Lock "cinder-quobyte-1928f862-d526-41c5-8bcb-735654a85f3f" released by "delete_volume" :: held 1.244s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:47:37 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-e080cc2a-3206-4d6f-88aa-adae2a056086 tempest-VolumesTransfersTest-1388949388 None] Created reservations ['e4899f30-f499-447e-b3a6-7712f1cc897d', '940f33c5-1a27-4cf0-9068-20c8b7547b10', 'f1905cdc-3e87-4396-a7ef-112c250843be', '84ac320c-5817-4312-80d7-b2816bc525f8'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:47:37 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-e080cc2a-3206-4d6f-88aa-adae2a056086 tempest-VolumesTransfersTest-1388949388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:47:37 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-e080cc2a-3206-4d6f-88aa-adae2a056086 tempest-VolumesTransfersTest-1388949388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:47:37 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-e080cc2a-3206-4d6f-88aa-adae2a056086 tempest-VolumesTransfersTest-1388949388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:47:37 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-e080cc2a-3206-4d6f-88aa-adae2a056086 tempest-VolumesTransfersTest-1388949388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:47:37 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-e080cc2a-3206-4d6f-88aa-adae2a056086 tempest-VolumesTransfersTest-1388949388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:47:37 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e080cc2a-3206-4d6f-88aa-adae2a056086 tempest-VolumesTransfersTest-1388949388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:37 devstack sudo[97558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:47:37 devstack sudo[97558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:37 devstack sudo[97544]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:37 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-05045b59-52af-4eee-b24f-34b3de297ff5 tempest-VolumesTransfersV355Test-1060872184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-09a25deb-3f6c-4813-9da1-5844f90020a1 1073741824" returned: 0 in 0.900s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:37 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-05045b59-52af-4eee-b24f-34b3de297ff5 tempest-VolumesTransfersV355Test-1060872184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-09a25deb-3f6c-4813-9da1-5844f90020a1 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:37 devstack sudo[97560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-09a25deb-3f6c-4813-9da1-5844f90020a1 Sep 25 11:47:37 devstack sudo[97560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:37 devstack sudo[97558]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:37 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e080cc2a-3206-4d6f-88aa-adae2a056086 tempest-VolumesTransfersTest-1388949388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.372s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:37 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-e080cc2a-3206-4d6f-88aa-adae2a056086 tempest-VolumesTransfersTest-1388949388 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:47:37 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-e080cc2a-3206-4d6f-88aa-adae2a056086 tempest-VolumesTransfersTest-1388949388 None] Deleted volume successfully. Sep 25 11:47:37 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e080cc2a-3206-4d6f-88aa-adae2a056086 tempest-VolumesTransfersTest-1388949388 None] Lock "cinder-1928f862-d526-41c5-8bcb-735654a85f3f-delete_volume" released by "delete_volume" :: held 1.931s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:47:38 devstack sudo[97560]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-05045b59-52af-4eee-b24f-34b3de297ff5 tempest-VolumesTransfersV355Test-1060872184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-09a25deb-3f6c-4813-9da1-5844f90020a1" returned: 0 in 0.417s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-05045b59-52af-4eee-b24f-34b3de297ff5 tempest-VolumesTransfersV355Test-1060872184 None] <== create_volume: return (1411ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:47:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-05045b59-52af-4eee-b24f-34b3de297ff5 tempest-VolumesTransfersV355Test-1060872184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.416s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:47:38 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-05045b59-52af-4eee-b24f-34b3de297ff5 tempest-VolumesTransfersV355Test-1060872184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25a82eef-6d83-4044-88f8-aa167b20d37b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09a25deb-3f6c-4813-9da1-5844f90020a1', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:38 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-05045b59-52af-4eee-b24f-34b3de297ff5 tempest-VolumesTransfersV355Test-1060872184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30d9d355-6827-4cb9-86cc-30390e151a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:38 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-05045b59-52af-4eee-b24f-34b3de297ff5 tempest-VolumesTransfersV355Test-1060872184 None] Volume volume-09a25deb-3f6c-4813-9da1-5844f90020a1 (09a25deb-3f6c-4813-9da1-5844f90020a1): created successfully Sep 25 11:47:38 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-05045b59-52af-4eee-b24f-34b3de297ff5 tempest-VolumesTransfersV355Test-1060872184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30d9d355-6827-4cb9-86cc-30390e151a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:38 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-05045b59-52af-4eee-b24f-34b3de297ff5 tempest-VolumesTransfersV355Test-1060872184 None] Flow 'volume_create_manager' (b7762969-9ef3-4df0-a328-0acdbc08b364) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:47:38 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-05045b59-52af-4eee-b24f-34b3de297ff5 tempest-VolumesTransfersV355Test-1060872184 None] Created volume successfully. Sep 25 11:47:38 devstack cinder-volume[86984]: DEBUG oslo_service.periodic_task [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:47:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:47:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:47:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:47:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:47:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:47:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:38 devstack sudo[97573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:47:38 devstack sudo[97573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:39 devstack sudo[97573]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:39 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdb89e2b-2a4c-4e96-a077-1f80e2576da0 tempest-VolumesTransfersTest-558307192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:47:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-bdb89e2b-2a4c-4e96-a077-1f80e2576da0 tempest-VolumesTransfersTest-558307192 None] Flow 'volume_create_manager' (07d638fb-dd82-4a6b-9c12-5947130212a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:47:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-bdb89e2b-2a4c-4e96-a077-1f80e2576da0 tempest-VolumesTransfersTest-558307192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b93e4b3d-ceed-4641-8ccc-68f055e34e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.692s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:39 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:47:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-bdb89e2b-2a4c-4e96-a077-1f80e2576da0 tempest-VolumesTransfersTest-558307192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b93e4b3d-ceed-4641-8ccc-68f055e34e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:47:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1507924963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fa383d7-1718-4b05-a8e4-231e996532e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79609525640c4fe6b98bce2159f48798',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:47:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:47:39Z,use_quota=True,user_id='744c806d9c6a44c8852dc783a3459888',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-bdb89e2b-2a4c-4e96-a077-1f80e2576da0 tempest-VolumesTransfersTest-558307192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9637e17-2901-402d-984e-324009cf6bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-bdb89e2b-2a4c-4e96-a077-1f80e2576da0 tempest-VolumesTransfersTest-558307192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9637e17-2901-402d-984e-324009cf6bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-bdb89e2b-2a4c-4e96-a077-1f80e2576da0 tempest-VolumesTransfersTest-558307192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b02742c4-09d3-4cf0-8088-34cde72bc590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-bdb89e2b-2a4c-4e96-a077-1f80e2576da0 tempest-VolumesTransfersTest-558307192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b02742c4-09d3-4cf0-8088-34cde72bc590) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fa383d7-1718-4b05-a8e4-231e996532e4', 'volume_name': 'volume-4fa383d7-1718-4b05-a8e4-231e996532e4', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-bdb89e2b-2a4c-4e96-a077-1f80e2576da0 tempest-VolumesTransfersTest-558307192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfc1ed4e-5560-4fbf-86ac-1ad8ea62d841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-bdb89e2b-2a4c-4e96-a077-1f80e2576da0 tempest-VolumesTransfersTest-558307192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfc1ed4e-5560-4fbf-86ac-1ad8ea62d841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-bdb89e2b-2a4c-4e96-a077-1f80e2576da0 tempest-VolumesTransfersTest-558307192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fedda7f-19ef-44bc-b8db-d67cafb9b282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:39 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-bdb89e2b-2a4c-4e96-a077-1f80e2576da0 tempest-VolumesTransfersTest-558307192 None] Volume 4fa383d7-1718-4b05-a8e4-231e996532e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fa383d7-1718-4b05-a8e4-231e996532e4', 'volume_size': 1} Sep 25 11:47:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-bdb89e2b-2a4c-4e96-a077-1f80e2576da0 tempest-VolumesTransfersTest-558307192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:47:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-bdb89e2b-2a4c-4e96-a077-1f80e2576da0 tempest-VolumesTransfersTest-558307192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:47:39 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-bdb89e2b-2a4c-4e96-a077-1f80e2576da0 tempest-VolumesTransfersTest-558307192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:47:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1507924963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fa383d7-1718-4b05-a8e4-231e996532e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79609525640c4fe6b98bce2159f48798',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:47:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:47:39Z,use_quota=True,user_id='744c806d9c6a44c8852dc783a3459888',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:47:39 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-bdb89e2b-2a4c-4e96-a077-1f80e2576da0 tempest-VolumesTransfersTest-558307192 None] Creating volume 4fa383d7-1718-4b05-a8e4-231e996532e4 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:47:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-bdb89e2b-2a4c-4e96-a077-1f80e2576da0 tempest-VolumesTransfersTest-558307192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:47:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-bdb89e2b-2a4c-4e96-a077-1f80e2576da0 tempest-VolumesTransfersTest-558307192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:47:39 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-bdb89e2b-2a4c-4e96-a077-1f80e2576da0 tempest-VolumesTransfersTest-558307192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:47:39 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-bdb89e2b-2a4c-4e96-a077-1f80e2576da0 tempest-VolumesTransfersTest-558307192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:47:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-bdb89e2b-2a4c-4e96-a077-1f80e2576da0 tempest-VolumesTransfersTest-558307192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:47:39 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-bdb89e2b-2a4c-4e96-a077-1f80e2576da0 tempest-VolumesTransfersTest-558307192 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:47:39 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-bdb89e2b-2a4c-4e96-a077-1f80e2576da0 tempest-VolumesTransfersTest-558307192 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:47:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-bdb89e2b-2a4c-4e96-a077-1f80e2576da0 tempest-VolumesTransfersTest-558307192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-4fa383d7-1718-4b05-a8e4-231e996532e4 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:39 devstack cinder-volume[86984]: DEBUG oslo_service.periodic_task [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running periodic task VolumeManager._thread_info {{(pid=86984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:47:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] thread count: 28 {{(pid=86984) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 11:47:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] thread info: [<_MainThread(MainThread, started 132046492332160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86984) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 11:47:39 devstack sudo[97576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-4fa383d7-1718-4b05-a8e4-231e996532e4 1073741824 Sep 25 11:47:39 devstack sudo[97576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:39 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f2331124-84d8-44c0-8315-c2760a11be3c tempest-VolumesTransfersV355Test-1501118606 None] Acquiring lock "cinder-09a25deb-3f6c-4813-9da1-5844f90020a1-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:47:39 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f2331124-84d8-44c0-8315-c2760a11be3c tempest-VolumesTransfersV355Test-1501118606 None] Lock "cinder-09a25deb-3f6c-4813-9da1-5844f90020a1-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:47:39 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f2331124-84d8-44c0-8315-c2760a11be3c tempest-VolumesTransfersV355Test-1501118606 None] Acquiring lock "cinder-quobyte-09a25deb-3f6c-4813-9da1-5844f90020a1" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:47:39 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f2331124-84d8-44c0-8315-c2760a11be3c tempest-VolumesTransfersV355Test-1501118606 None] Lock "cinder-quobyte-09a25deb-3f6c-4813-9da1-5844f90020a1" acquired by "delete_volume" :: waited 0.042s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:47:39 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[14249b8f-6462-42c6-a756-0bad744c4b0a]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:47:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f2331124-84d8-44c0-8315-c2760a11be3c tempest-VolumesTransfersV355Test-1501118606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-09a25deb-3f6c-4813-9da1-5844f90020a1 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:40 devstack sudo[97578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-09a25deb-3f6c-4813-9da1-5844f90020a1 Sep 25 11:47:40 devstack sudo[97578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:40 devstack sudo[97576]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:40 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-bdb89e2b-2a4c-4e96-a077-1f80e2576da0 tempest-VolumesTransfersTest-558307192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-4fa383d7-1718-4b05-a8e4-231e996532e4 1073741824" returned: 0 in 0.953s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:40 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-bdb89e2b-2a4c-4e96-a077-1f80e2576da0 tempest-VolumesTransfersTest-558307192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-4fa383d7-1718-4b05-a8e4-231e996532e4 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:40 devstack sudo[97588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-4fa383d7-1718-4b05-a8e4-231e996532e4 Sep 25 11:47:40 devstack sudo[97588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:40 devstack sudo[97578]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:40 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f2331124-84d8-44c0-8315-c2760a11be3c tempest-VolumesTransfersV355Test-1501118606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-09a25deb-3f6c-4813-9da1-5844f90020a1" returned: 0 in 0.761s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:40 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f2331124-84d8-44c0-8315-c2760a11be3c tempest-VolumesTransfersV355Test-1501118606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-09a25deb-3f6c-4813-9da1-5844f90020a1 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:40 devstack sudo[97590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-09a25deb-3f6c-4813-9da1-5844f90020a1 Sep 25 11:47:40 devstack sudo[97590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:40 devstack sudo[97588]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:40 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-bdb89e2b-2a4c-4e96-a077-1f80e2576da0 tempest-VolumesTransfersTest-558307192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-4fa383d7-1718-4b05-a8e4-231e996532e4" returned: 0 in 0.417s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:40 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-bdb89e2b-2a4c-4e96-a077-1f80e2576da0 tempest-VolumesTransfersTest-558307192 None] <== create_volume: return (1452ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:47:40 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-bdb89e2b-2a4c-4e96-a077-1f80e2576da0 tempest-VolumesTransfersTest-558307192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.457s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:47:40 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-bdb89e2b-2a4c-4e96-a077-1f80e2576da0 tempest-VolumesTransfersTest-558307192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fedda7f-19ef-44bc-b8db-d67cafb9b282) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fa383d7-1718-4b05-a8e4-231e996532e4', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:40 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-bdb89e2b-2a4c-4e96-a077-1f80e2576da0 tempest-VolumesTransfersTest-558307192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10e5d895-d43c-4efd-b451-6d3a9d330017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:40 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-bdb89e2b-2a4c-4e96-a077-1f80e2576da0 tempest-VolumesTransfersTest-558307192 None] Volume volume-4fa383d7-1718-4b05-a8e4-231e996532e4 (4fa383d7-1718-4b05-a8e4-231e996532e4): created successfully Sep 25 11:47:41 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-bdb89e2b-2a4c-4e96-a077-1f80e2576da0 tempest-VolumesTransfersTest-558307192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10e5d895-d43c-4efd-b451-6d3a9d330017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:41 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-bdb89e2b-2a4c-4e96-a077-1f80e2576da0 tempest-VolumesTransfersTest-558307192 None] Flow 'volume_create_manager' (07d638fb-dd82-4a6b-9c12-5947130212a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:47:41 devstack sudo[97590]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f2331124-84d8-44c0-8315-c2760a11be3c tempest-VolumesTransfersV355Test-1501118606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-09a25deb-3f6c-4813-9da1-5844f90020a1" returned: 0 in 0.446s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:41 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-bdb89e2b-2a4c-4e96-a077-1f80e2576da0 tempest-VolumesTransfersTest-558307192 None] Created volume successfully. Sep 25 11:47:41 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f2331124-84d8-44c0-8315-c2760a11be3c tempest-VolumesTransfersV355Test-1501118606 None] Lock "cinder-quobyte-09a25deb-3f6c-4813-9da1-5844f90020a1" released by "delete_volume" :: held 1.299s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:47:41 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-f2331124-84d8-44c0-8315-c2760a11be3c tempest-VolumesTransfersV355Test-1501118606 None] Created reservations ['5b682be3-ee3d-4e51-b70e-3deb62d1d7f2', 'f2cfe517-0252-486c-94f8-0239da370a62', '6d636354-4a83-4a8b-a33a-27b216ec71f4', 'b41e2d59-77b8-446e-9856-323a0546b901'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:47:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f2331124-84d8-44c0-8315-c2760a11be3c tempest-VolumesTransfersV355Test-1501118606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:47:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f2331124-84d8-44c0-8315-c2760a11be3c tempest-VolumesTransfersV355Test-1501118606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:47:41 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-f2331124-84d8-44c0-8315-c2760a11be3c tempest-VolumesTransfersV355Test-1501118606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:47:41 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-f2331124-84d8-44c0-8315-c2760a11be3c tempest-VolumesTransfersV355Test-1501118606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:47:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f2331124-84d8-44c0-8315-c2760a11be3c tempest-VolumesTransfersV355Test-1501118606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:47:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f2331124-84d8-44c0-8315-c2760a11be3c tempest-VolumesTransfersV355Test-1501118606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:41 devstack sudo[97594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:47:41 devstack sudo[97594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:41 devstack sudo[97594]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f2331124-84d8-44c0-8315-c2760a11be3c tempest-VolumesTransfersV355Test-1501118606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.493s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:41 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-f2331124-84d8-44c0-8315-c2760a11be3c tempest-VolumesTransfersV355Test-1501118606 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:47:41 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-f2331124-84d8-44c0-8315-c2760a11be3c tempest-VolumesTransfersV355Test-1501118606 None] Deleted volume successfully. Sep 25 11:47:41 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f2331124-84d8-44c0-8315-c2760a11be3c tempest-VolumesTransfersV355Test-1501118606 None] Lock "cinder-09a25deb-3f6c-4813-9da1-5844f90020a1-delete_volume" released by "delete_volume" :: held 2.307s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:47:42 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-cca1e61a-714d-4abb-8610-7140f6e6ca43 tempest-VolumesTransfersTest-1388949388 None] Acquiring lock "cinder-4fa383d7-1718-4b05-a8e4-231e996532e4-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:47:42 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-cca1e61a-714d-4abb-8610-7140f6e6ca43 tempest-VolumesTransfersTest-1388949388 None] Lock "cinder-4fa383d7-1718-4b05-a8e4-231e996532e4-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:47:42 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-cca1e61a-714d-4abb-8610-7140f6e6ca43 tempest-VolumesTransfersTest-1388949388 None] Acquiring lock "cinder-quobyte-4fa383d7-1718-4b05-a8e4-231e996532e4" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:47:42 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-cca1e61a-714d-4abb-8610-7140f6e6ca43 tempest-VolumesTransfersTest-1388949388 None] Lock "cinder-quobyte-4fa383d7-1718-4b05-a8e4-231e996532e4" acquired by "delete_volume" :: waited 0.047s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:47:42 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[e710f25c-3192-4848-8470-7b6448db495c]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:47:42 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cca1e61a-714d-4abb-8610-7140f6e6ca43 tempest-VolumesTransfersTest-1388949388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-4fa383d7-1718-4b05-a8e4-231e996532e4 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:42 devstack sudo[97601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-4fa383d7-1718-4b05-a8e4-231e996532e4 Sep 25 11:47:42 devstack sudo[97601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:43 devstack sudo[97601]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cca1e61a-714d-4abb-8610-7140f6e6ca43 tempest-VolumesTransfersTest-1388949388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-4fa383d7-1718-4b05-a8e4-231e996532e4" returned: 0 in 0.718s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cca1e61a-714d-4abb-8610-7140f6e6ca43 tempest-VolumesTransfersTest-1388949388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-4fa383d7-1718-4b05-a8e4-231e996532e4 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:43 devstack sudo[97620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-4fa383d7-1718-4b05-a8e4-231e996532e4 Sep 25 11:47:43 devstack sudo[97620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:43 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-bcbab7e7-db06-4808-a0bc-cc1b83dc1c74 tempest-GroupsV314Test-1916189067 None] Group tempest-GroupsV314Test-Group-244666271: creating Sep 25 11:47:43 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-bcbab7e7-db06-4808-a0bc-cc1b83dc1c74 tempest-GroupsV314Test-1916189067 None] Group tempest-GroupsV314Test-Group-244666271: created successfully Sep 25 11:47:43 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-bcbab7e7-db06-4808-a0bc-cc1b83dc1c74 tempest-GroupsV314Test-1916189067 None] Create group completed successfully. Sep 25 11:47:43 devstack sudo[97620]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cca1e61a-714d-4abb-8610-7140f6e6ca43 tempest-VolumesTransfersTest-1388949388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-4fa383d7-1718-4b05-a8e4-231e996532e4" returned: 0 in 0.671s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:43 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-cca1e61a-714d-4abb-8610-7140f6e6ca43 tempest-VolumesTransfersTest-1388949388 None] Lock "cinder-quobyte-4fa383d7-1718-4b05-a8e4-231e996532e4" released by "delete_volume" :: held 1.523s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:47:43 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-cca1e61a-714d-4abb-8610-7140f6e6ca43 tempest-VolumesTransfersTest-1388949388 None] Created reservations ['ae44f5de-2c57-4803-b670-f7e711df73f5', '5e114d01-3fd6-4122-aef7-6997d1e421e5', 'b4c3e122-01c6-4921-8719-b6fc3f9a1e64', '001f9d59-1f5a-44ef-b3a8-5c63e20eb5ad'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:47:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-cca1e61a-714d-4abb-8610-7140f6e6ca43 tempest-VolumesTransfersTest-1388949388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:47:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-cca1e61a-714d-4abb-8610-7140f6e6ca43 tempest-VolumesTransfersTest-1388949388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:47:43 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-cca1e61a-714d-4abb-8610-7140f6e6ca43 tempest-VolumesTransfersTest-1388949388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:47:43 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-cca1e61a-714d-4abb-8610-7140f6e6ca43 tempest-VolumesTransfersTest-1388949388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:47:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-cca1e61a-714d-4abb-8610-7140f6e6ca43 tempest-VolumesTransfersTest-1388949388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:47:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cca1e61a-714d-4abb-8610-7140f6e6ca43 tempest-VolumesTransfersTest-1388949388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:44 devstack sudo[97625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:47:44 devstack sudo[97625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:44 devstack sudo[97625]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cca1e61a-714d-4abb-8610-7140f6e6ca43 tempest-VolumesTransfersTest-1388949388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.346s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:44 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-cca1e61a-714d-4abb-8610-7140f6e6ca43 tempest-VolumesTransfersTest-1388949388 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:47:44 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-cca1e61a-714d-4abb-8610-7140f6e6ca43 tempest-VolumesTransfersTest-1388949388 None] Deleted volume successfully. Sep 25 11:47:44 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-cca1e61a-714d-4abb-8610-7140f6e6ca43 tempest-VolumesTransfersTest-1388949388 None] Lock "cinder-4fa383d7-1718-4b05-a8e4-231e996532e4-delete_volume" released by "delete_volume" :: held 2.271s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:47:45 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c422239-b6cf-4442-afaf-ca4539bd704a tempest-GroupsV314Test-1916189067 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:47:45 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4c422239-b6cf-4442-afaf-ca4539bd704a tempest-GroupsV314Test-1916189067 None] Flow 'volume_create_manager' (613a5eed-a703-4225-8214-648daae8ba05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:47:45 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4c422239-b6cf-4442-afaf-ca4539bd704a tempest-GroupsV314Test-1916189067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48d9a444-10ad-43af-ba90-f302160950ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:45 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4c422239-b6cf-4442-afaf-ca4539bd704a tempest-GroupsV314Test-1916189067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48d9a444-10ad-43af-ba90-f302160950ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:47:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-116328584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1085f14f-92c4-4d56-9def-76dffc066bbc,host='devstack@QuobyteHD#QuobyteHD',id=8c5f54b9-adce-4a49-86de-be12cc986fa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7538d3019cf4565b436f0ec8525720f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:47:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:47:46Z,use_quota=True,user_id='00948ffdea294636a651c4e11e753736',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3959e681-13ed-44ee-9ad4-9cc248e55c43),volume_type_id=3959e681-13ed-44ee-9ad4-9cc248e55c43)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:45 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4c422239-b6cf-4442-afaf-ca4539bd704a tempest-GroupsV314Test-1916189067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b1d5ff2-1b9e-4cc0-a750-8f3605305318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:45 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4c422239-b6cf-4442-afaf-ca4539bd704a tempest-GroupsV314Test-1916189067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b1d5ff2-1b9e-4cc0-a750-8f3605305318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:45 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4c422239-b6cf-4442-afaf-ca4539bd704a tempest-GroupsV314Test-1916189067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81065402-0fbd-4cdb-a4c7-527b25930907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:45 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4c422239-b6cf-4442-afaf-ca4539bd704a tempest-GroupsV314Test-1916189067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81065402-0fbd-4cdb-a4c7-527b25930907) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c5f54b9-adce-4a49-86de-be12cc986fa4', 'volume_name': 'volume-8c5f54b9-adce-4a49-86de-be12cc986fa4', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:45 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4c422239-b6cf-4442-afaf-ca4539bd704a tempest-GroupsV314Test-1916189067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abe57deb-8970-46fb-89f7-b6c2fc9d0da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:45 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4c422239-b6cf-4442-afaf-ca4539bd704a tempest-GroupsV314Test-1916189067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abe57deb-8970-46fb-89f7-b6c2fc9d0da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:45 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4c422239-b6cf-4442-afaf-ca4539bd704a tempest-GroupsV314Test-1916189067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (477458e5-fdf1-47df-9c12-dbf435d8e9a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:45 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-4c422239-b6cf-4442-afaf-ca4539bd704a tempest-GroupsV314Test-1916189067 None] Volume 8c5f54b9-adce-4a49-86de-be12cc986fa4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c5f54b9-adce-4a49-86de-be12cc986fa4', 'volume_size': 1} Sep 25 11:47:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-4c422239-b6cf-4442-afaf-ca4539bd704a tempest-GroupsV314Test-1916189067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:47:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-4c422239-b6cf-4442-afaf-ca4539bd704a tempest-GroupsV314Test-1916189067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:47:45 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-4c422239-b6cf-4442-afaf-ca4539bd704a tempest-GroupsV314Test-1916189067 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1085f14f-92c4-4d56-9def-76dffc066bbc,created_at=2026-09-25T09:47:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-116328584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1085f14f-92c4-4d56-9def-76dffc066bbc,host='devstack@QuobyteHD#QuobyteHD',id=8c5f54b9-adce-4a49-86de-be12cc986fa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7538d3019cf4565b436f0ec8525720f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:47:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:47:46Z,use_quota=True,user_id='00948ffdea294636a651c4e11e753736',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3959e681-13ed-44ee-9ad4-9cc248e55c43),volume_type_id=3959e681-13ed-44ee-9ad4-9cc248e55c43)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:47:45 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-4c422239-b6cf-4442-afaf-ca4539bd704a tempest-GroupsV314Test-1916189067 None] Creating volume 8c5f54b9-adce-4a49-86de-be12cc986fa4 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:47:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-4c422239-b6cf-4442-afaf-ca4539bd704a tempest-GroupsV314Test-1916189067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:47:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-4c422239-b6cf-4442-afaf-ca4539bd704a tempest-GroupsV314Test-1916189067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:47:45 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-4c422239-b6cf-4442-afaf-ca4539bd704a tempest-GroupsV314Test-1916189067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:47:45 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-4c422239-b6cf-4442-afaf-ca4539bd704a tempest-GroupsV314Test-1916189067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:47:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-4c422239-b6cf-4442-afaf-ca4539bd704a tempest-GroupsV314Test-1916189067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:47:45 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-4c422239-b6cf-4442-afaf-ca4539bd704a tempest-GroupsV314Test-1916189067 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:47:45 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-4c422239-b6cf-4442-afaf-ca4539bd704a tempest-GroupsV314Test-1916189067 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:47:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-4c422239-b6cf-4442-afaf-ca4539bd704a tempest-GroupsV314Test-1916189067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8c5f54b9-adce-4a49-86de-be12cc986fa4 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:45 devstack sudo[97664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8c5f54b9-adce-4a49-86de-be12cc986fa4 1073741824 Sep 25 11:47:45 devstack sudo[97664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:46 devstack sudo[97664]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-4c422239-b6cf-4442-afaf-ca4539bd704a tempest-GroupsV314Test-1916189067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8c5f54b9-adce-4a49-86de-be12cc986fa4 1073741824" returned: 0 in 0.866s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-4c422239-b6cf-4442-afaf-ca4539bd704a tempest-GroupsV314Test-1916189067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8c5f54b9-adce-4a49-86de-be12cc986fa4 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:46 devstack sudo[97672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8c5f54b9-adce-4a49-86de-be12cc986fa4 Sep 25 11:47:46 devstack sudo[97672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:47 devstack sudo[97672]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-4c422239-b6cf-4442-afaf-ca4539bd704a tempest-GroupsV314Test-1916189067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8c5f54b9-adce-4a49-86de-be12cc986fa4" returned: 0 in 0.422s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:47 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-4c422239-b6cf-4442-afaf-ca4539bd704a tempest-GroupsV314Test-1916189067 None] <== create_volume: return (1408ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:47:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-4c422239-b6cf-4442-afaf-ca4539bd704a tempest-GroupsV314Test-1916189067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.414s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:47:47 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4c422239-b6cf-4442-afaf-ca4539bd704a tempest-GroupsV314Test-1916189067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (477458e5-fdf1-47df-9c12-dbf435d8e9a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c5f54b9-adce-4a49-86de-be12cc986fa4', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:47 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4c422239-b6cf-4442-afaf-ca4539bd704a tempest-GroupsV314Test-1916189067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f8ac225-b17c-411d-9733-cb3b4d5a9d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:47:47 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-4c422239-b6cf-4442-afaf-ca4539bd704a tempest-GroupsV314Test-1916189067 None] Volume volume-8c5f54b9-adce-4a49-86de-be12cc986fa4 (8c5f54b9-adce-4a49-86de-be12cc986fa4): created successfully Sep 25 11:47:47 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4c422239-b6cf-4442-afaf-ca4539bd704a tempest-GroupsV314Test-1916189067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f8ac225-b17c-411d-9733-cb3b4d5a9d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:47:47 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4c422239-b6cf-4442-afaf-ca4539bd704a tempest-GroupsV314Test-1916189067 None] Flow 'volume_create_manager' (613a5eed-a703-4225-8214-648daae8ba05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:47:47 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-4c422239-b6cf-4442-afaf-ca4539bd704a tempest-GroupsV314Test-1916189067 None] Created volume successfully. Sep 25 11:47:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-2be522fe-7685-4ad3-b3b8-a85bb6625063 tempest-GroupsV314Test-1916189067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:47:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-2be522fe-7685-4ad3-b3b8-a85bb6625063 tempest-GroupsV314Test-1916189067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:47:50 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-2be522fe-7685-4ad3-b3b8-a85bb6625063 tempest-GroupsV314Test-1916189067 None] Cloning volume 8c5f54b9-adce-4a49-86de-be12cc986fa4 to volume 6601d7f0-f9d3-47bc-b03d-f606cdfc348e Sep 25 11:47:50 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-2be522fe-7685-4ad3-b3b8-a85bb6625063 tempest-GroupsV314Test-1916189067 None] Creating offline snapshot 80ec6adc-418b-4f2d-a486-d1a3e0572a54 of volume 8c5f54b9-adce-4a49-86de-be12cc986fa4 {{(pid=86984) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:47:50 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae08b2c-cd3c-4b12-86b8-751dc5cfcd99]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:47:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2be522fe-7685-4ad3-b3b8-a85bb6625063 tempest-GroupsV314Test-1916189067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8c5f54b9-adce-4a49-86de-be12cc986fa4 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:50 devstack sudo[97756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8c5f54b9-adce-4a49-86de-be12cc986fa4 Sep 25 11:47:50 devstack sudo[97756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:51 devstack sudo[97756]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2be522fe-7685-4ad3-b3b8-a85bb6625063 tempest-GroupsV314Test-1916189067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8c5f54b9-adce-4a49-86de-be12cc986fa4" returned: 0 in 1.000s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2be522fe-7685-4ad3-b3b8-a85bb6625063 tempest-GroupsV314Test-1916189067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8c5f54b9-adce-4a49-86de-be12cc986fa4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8c5f54b9-adce-4a49-86de-be12cc986fa4.80ec6adc-418b-4f2d-a486-d1a3e0572a54 1G {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:51 devstack sudo[97761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8c5f54b9-adce-4a49-86de-be12cc986fa4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8c5f54b9-adce-4a49-86de-be12cc986fa4.80ec6adc-418b-4f2d-a486-d1a3e0572a54 1G Sep 25 11:47:51 devstack sudo[97761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:52 devstack sudo[97761]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2be522fe-7685-4ad3-b3b8-a85bb6625063 tempest-GroupsV314Test-1916189067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8c5f54b9-adce-4a49-86de-be12cc986fa4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8c5f54b9-adce-4a49-86de-be12cc986fa4.80ec6adc-418b-4f2d-a486-d1a3e0572a54 1G" returned: 0 in 1.243s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2be522fe-7685-4ad3-b3b8-a85bb6625063 tempest-GroupsV314Test-1916189067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c5f54b9-adce-4a49-86de-be12cc986fa4 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8c5f54b9-adce-4a49-86de-be12cc986fa4.80ec6adc-418b-4f2d-a486-d1a3e0572a54 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:52 devstack sudo[97768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c5f54b9-adce-4a49-86de-be12cc986fa4 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8c5f54b9-adce-4a49-86de-be12cc986fa4.80ec6adc-418b-4f2d-a486-d1a3e0572a54 Sep 25 11:47:52 devstack sudo[97768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:53 devstack sudo[97768]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2be522fe-7685-4ad3-b3b8-a85bb6625063 tempest-GroupsV314Test-1916189067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c5f54b9-adce-4a49-86de-be12cc986fa4 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8c5f54b9-adce-4a49-86de-be12cc986fa4.80ec6adc-418b-4f2d-a486-d1a3e0572a54" returned: 0 in 0.638s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:53 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-2be522fe-7685-4ad3-b3b8-a85bb6625063 tempest-GroupsV314Test-1916189067 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8c5f54b9-adce-4a49-86de-be12cc986fa4.80ec6adc-418b-4f2d-a486-d1a3e0572a54 is being set with open permissions: ugo+rw: NotImplementedError Sep 25 11:47:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2be522fe-7685-4ad3-b3b8-a85bb6625063 tempest-GroupsV314Test-1916189067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8c5f54b9-adce-4a49-86de-be12cc986fa4.80ec6adc-418b-4f2d-a486-d1a3e0572a54 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:53 devstack sudo[97775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8c5f54b9-adce-4a49-86de-be12cc986fa4.80ec6adc-418b-4f2d-a486-d1a3e0572a54 Sep 25 11:47:53 devstack sudo[97775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:53 devstack sudo[97775]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2be522fe-7685-4ad3-b3b8-a85bb6625063 tempest-GroupsV314Test-1916189067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8c5f54b9-adce-4a49-86de-be12cc986fa4.80ec6adc-418b-4f2d-a486-d1a3e0572a54" returned: 0 in 0.339s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2be522fe-7685-4ad3-b3b8-a85bb6625063 tempest-GroupsV314Test-1916189067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8c5f54b9-adce-4a49-86de-be12cc986fa4.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:53 devstack sudo[97778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8c5f54b9-adce-4a49-86de-be12cc986fa4.info Sep 25 11:47:53 devstack sudo[97778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:54 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f1697ff8-acd9-4b6d-b0db-ff2043b0d6bd tempest-VolumesActionsTest-794756051 None] Acquiring lock "cinder-1a630d61-19c6-487b-abd2-6c3a21b3d7fe" by "attach_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:47:54 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f1697ff8-acd9-4b6d-b0db-ff2043b0d6bd tempest-VolumesActionsTest-794756051 None] Lock "cinder-1a630d61-19c6-487b-abd2-6c3a21b3d7fe" acquired by "attach_volume" :: waited 0.050s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:47:54 devstack sudo[97778]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2be522fe-7685-4ad3-b3b8-a85bb6625063 tempest-GroupsV314Test-1916189067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8c5f54b9-adce-4a49-86de-be12cc986fa4.info" returned: 0 in 0.930s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:54 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-2be522fe-7685-4ad3-b3b8-a85bb6625063 tempest-GroupsV314Test-1916189067 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8c5f54b9-adce-4a49-86de-be12cc986fa4.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 11:47:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2be522fe-7685-4ad3-b3b8-a85bb6625063 tempest-GroupsV314Test-1916189067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8c5f54b9-adce-4a49-86de-be12cc986fa4.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:54 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-f1697ff8-acd9-4b6d-b0db-ff2043b0d6bd tempest-VolumesActionsTest-794756051 None] Attaching volume 1a630d61-19c6-487b-abd2-6c3a21b3d7fe to instance 15a92439-6d2e-4e3b-a7fb-a91dbce2c8be at mountpoint /dev/vdb on host None. Sep 25 11:47:54 devstack sudo[97781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8c5f54b9-adce-4a49-86de-be12cc986fa4.info Sep 25 11:47:54 devstack sudo[97781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:54 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-f1697ff8-acd9-4b6d-b0db-ff2043b0d6bd tempest-VolumesActionsTest-794756051 None] Attach volume completed successfully. Sep 25 11:47:54 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f1697ff8-acd9-4b6d-b0db-ff2043b0d6bd tempest-VolumesActionsTest-794756051 None] Lock "cinder-1a630d61-19c6-487b-abd2-6c3a21b3d7fe" released by "attach_volume" :: held 0.323s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:47:55 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-61deebdd-bd36-481a-b03b-1daaf7b97505 tempest-VolumesActionsTest-794756051 None] Acquiring lock "cinder-1a630d61-19c6-487b-abd2-6c3a21b3d7fe-detach_volume" by "detach_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:47:55 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-61deebdd-bd36-481a-b03b-1daaf7b97505 tempest-VolumesActionsTest-794756051 None] Lock "cinder-1a630d61-19c6-487b-abd2-6c3a21b3d7fe-detach_volume" acquired by "detach_volume" :: waited 0.046s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:47:55 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-61deebdd-bd36-481a-b03b-1daaf7b97505 tempest-VolumesActionsTest-794756051 None] Detaching volume 1a630d61-19c6-487b-abd2-6c3a21b3d7fe from instance 15a92439-6d2e-4e3b-a7fb-a91dbce2c8be. Sep 25 11:47:55 devstack sudo[97781]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2be522fe-7685-4ad3-b3b8-a85bb6625063 tempest-GroupsV314Test-1916189067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8c5f54b9-adce-4a49-86de-be12cc986fa4.info" returned: 0 in 0.611s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:55 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-2be522fe-7685-4ad3-b3b8-a85bb6625063 tempest-GroupsV314Test-1916189067 None] Acquiring lock "cinder-quobyte-6601d7f0-f9d3-47bc-b03d-f606cdfc348e" by "_copy_volume_from_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:47:55 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-2be522fe-7685-4ad3-b3b8-a85bb6625063 tempest-GroupsV314Test-1916189067 None] Lock "cinder-quobyte-6601d7f0-f9d3-47bc-b03d-f606cdfc348e" acquired by "_copy_volume_from_snapshot" :: waited 0.059s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:47:55 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-2be522fe-7685-4ad3-b3b8-a85bb6625063 tempest-GroupsV314Test-1916189067 None] snapshot: 80ec6adc-418b-4f2d-a486-d1a3e0572a54, volume: 6601d7f0-f9d3-47bc-b03d-f606cdfc348e, {{(pid=86984) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 11:47:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-2be522fe-7685-4ad3-b3b8-a85bb6625063 tempest-GroupsV314Test-1916189067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:47:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-2be522fe-7685-4ad3-b3b8-a85bb6625063 tempest-GroupsV314Test-1916189067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:47:55 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-2be522fe-7685-4ad3-b3b8-a85bb6625063 tempest-GroupsV314Test-1916189067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:47:55 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-2be522fe-7685-4ad3-b3b8-a85bb6625063 tempest-GroupsV314Test-1916189067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:47:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-2be522fe-7685-4ad3-b3b8-a85bb6625063 tempest-GroupsV314Test-1916189067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:47:55 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab38df24-2c4e-4269-b906-62cc5538e4ec]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:47:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2be522fe-7685-4ad3-b3b8-a85bb6625063 tempest-GroupsV314Test-1916189067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8c5f54b9-adce-4a49-86de-be12cc986fa4.80ec6adc-418b-4f2d-a486-d1a3e0572a54 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:55 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-61deebdd-bd36-481a-b03b-1daaf7b97505 tempest-VolumesActionsTest-794756051 None] Detach volume completed successfully. Sep 25 11:47:55 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-61deebdd-bd36-481a-b03b-1daaf7b97505 tempest-VolumesActionsTest-794756051 None] Lock "cinder-1a630d61-19c6-487b-abd2-6c3a21b3d7fe-detach_volume" released by "detach_volume" :: held 0.318s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:47:55 devstack sudo[97784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8c5f54b9-adce-4a49-86de-be12cc986fa4.80ec6adc-418b-4f2d-a486-d1a3e0572a54 Sep 25 11:47:55 devstack sudo[97784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:56 devstack sudo[97784]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:56 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2be522fe-7685-4ad3-b3b8-a85bb6625063 tempest-GroupsV314Test-1916189067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8c5f54b9-adce-4a49-86de-be12cc986fa4.80ec6adc-418b-4f2d-a486-d1a3e0572a54" returned: 0 in 0.936s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:56 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-2be522fe-7685-4ad3-b3b8-a85bb6625063 tempest-GroupsV314Test-1916189067 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c5f54b9-adce-4a49-86de-be12cc986fa4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86984) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:47:56 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d93527-9176-4453-93cb-5dca2acb98e8]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:47:56 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2be522fe-7685-4ad3-b3b8-a85bb6625063 tempest-GroupsV314Test-1916189067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8c5f54b9-adce-4a49-86de-be12cc986fa4 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:56 devstack sudo[97792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8c5f54b9-adce-4a49-86de-be12cc986fa4 Sep 25 11:47:56 devstack sudo[97792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:47:57 devstack sudo[97792]: pam_unix(sudo:session): session closed for user root Sep 25 11:47:57 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2be522fe-7685-4ad3-b3b8-a85bb6625063 tempest-GroupsV314Test-1916189067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8c5f54b9-adce-4a49-86de-be12cc986fa4" returned: 0 in 0.909s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:47:57 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-2be522fe-7685-4ad3-b3b8-a85bb6625063 tempest-GroupsV314Test-1916189067 None] will copy from snapshot at /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8c5f54b9-adce-4a49-86de-be12cc986fa4 {{(pid=86984) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 11:47:57 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-2be522fe-7685-4ad3-b3b8-a85bb6625063 tempest-GroupsV314Test-1916189067 None] Creating direct copy from snapshot {{(pid=86984) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 11:47:57 devstack cinder-volume[86984]: DEBUG cinder.utils [None req-2be522fe-7685-4ad3-b3b8-a85bb6625063 tempest-GroupsV314Test-1916189067 None] Path /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6601d7f0-f9d3-47bc-b03d-f606cdfc348e not found in is_blk_device check {{(pid=86984) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 11:47:57 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2be522fe-7685-4ad3-b3b8-a85bb6625063 tempest-GroupsV314Test-1916189067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8c5f54b9-adce-4a49-86de-be12cc986fa4 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6601d7f0-f9d3-47bc-b03d-f606cdfc348e {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:47:57 devstack sudo[97821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8c5f54b9-adce-4a49-86de-be12cc986fa4 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6601d7f0-f9d3-47bc-b03d-f606cdfc348e Sep 25 11:47:57 devstack sudo[97821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:05 devstack cinder-volume[86984]: DEBUG dbcounter [-] [86984] Writing DB stats cinder:SELECT=102,cinder:INSERT=28,cinder:UPDATE=118,cinder:DELETE=3 {{(pid=86984) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:48:05 devstack cinder-volume[86984]: DEBUG dbcounter [-] [86984] Writing DB stats cinder:SELECT=101,cinder:INSERT=29,cinder:UPDATE=126,cinder:DELETE=13 {{(pid=86984) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:48:06 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2accffa-56f2-46d6-9971-631b3b0466fb tempest-VolumesTransfersV357Test-1096093527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:48:06 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b2accffa-56f2-46d6-9971-631b3b0466fb tempest-VolumesTransfersV357Test-1096093527 None] Flow 'volume_create_manager' (3ea82e56-8b8e-4f22-a4c1-258aa73c2662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:48:06 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b2accffa-56f2-46d6-9971-631b3b0466fb tempest-VolumesTransfersV357Test-1096093527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (684da982-b2bc-488e-9d3f-243c1673b07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:48:06 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b2accffa-56f2-46d6-9971-631b3b0466fb tempest-VolumesTransfersV357Test-1096093527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (684da982-b2bc-488e-9d3f-243c1673b07a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:48:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1030104054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e59b78a-fbbf-4d90-8a4b-430d3d1e2d70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7def1c172ada45e0ad991b90554cb856',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:48:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:48:06Z,use_quota=True,user_id='7bfce17528e14f10b764b46184e1d808',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:48:06 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b2accffa-56f2-46d6-9971-631b3b0466fb tempest-VolumesTransfersV357Test-1096093527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1f64e5a-c15a-441e-8104-2ddf637049a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:48:06 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b2accffa-56f2-46d6-9971-631b3b0466fb tempest-VolumesTransfersV357Test-1096093527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1f64e5a-c15a-441e-8104-2ddf637049a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:48:06 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b2accffa-56f2-46d6-9971-631b3b0466fb tempest-VolumesTransfersV357Test-1096093527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8a7c2b7-1968-40b0-aea5-9adb6c730f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:48:06 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b2accffa-56f2-46d6-9971-631b3b0466fb tempest-VolumesTransfersV357Test-1096093527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8a7c2b7-1968-40b0-aea5-9adb6c730f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e59b78a-fbbf-4d90-8a4b-430d3d1e2d70', 'volume_name': 'volume-7e59b78a-fbbf-4d90-8a4b-430d3d1e2d70', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:48:06 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b2accffa-56f2-46d6-9971-631b3b0466fb tempest-VolumesTransfersV357Test-1096093527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0eaa9424-f843-4afd-9add-62cc625bbebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:48:06 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b2accffa-56f2-46d6-9971-631b3b0466fb tempest-VolumesTransfersV357Test-1096093527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0eaa9424-f843-4afd-9add-62cc625bbebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:48:06 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b2accffa-56f2-46d6-9971-631b3b0466fb tempest-VolumesTransfersV357Test-1096093527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1860a25e-8fdf-4634-85e8-f38509c79f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:48:06 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-b2accffa-56f2-46d6-9971-631b3b0466fb tempest-VolumesTransfersV357Test-1096093527 None] Volume 7e59b78a-fbbf-4d90-8a4b-430d3d1e2d70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e59b78a-fbbf-4d90-8a4b-430d3d1e2d70', 'volume_size': 1} Sep 25 11:48:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-b2accffa-56f2-46d6-9971-631b3b0466fb tempest-VolumesTransfersV357Test-1096093527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:48:06 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-8df26cb1-82cf-478e-b116-f79e70d94067 tempest-VolumesGetTest-1984201126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:48:06 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8df26cb1-82cf-478e-b116-f79e70d94067 tempest-VolumesGetTest-1984201126 None] Flow 'volume_create_manager' (dc4a4d66-3d94-47b7-8e94-6afd14e8843f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:48:06 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8df26cb1-82cf-478e-b116-f79e70d94067 tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f64b56ce-f431-4347-992c-baca99996fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:48:06 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8df26cb1-82cf-478e-b116-f79e70d94067 tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f64b56ce-f431-4347-992c-baca99996fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:48:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-186317824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6f83b2b-5122-4073-8935-55d628b7a1ff,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1f6a1c00cee34650b3106442f2443249',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:48:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:48:06Z,use_quota=True,user_id='0b750a9ac0d643ab979b6125b2297eb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:48:06 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8df26cb1-82cf-478e-b116-f79e70d94067 tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7afe8092-24ad-4c28-9103-1f6acea3f288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:48:06 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8df26cb1-82cf-478e-b116-f79e70d94067 tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7afe8092-24ad-4c28-9103-1f6acea3f288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:48:06 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8df26cb1-82cf-478e-b116-f79e70d94067 tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (373ae002-3a42-475f-ad73-cdfbad5a0b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:48:06 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8df26cb1-82cf-478e-b116-f79e70d94067 tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (373ae002-3a42-475f-ad73-cdfbad5a0b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6f83b2b-5122-4073-8935-55d628b7a1ff', 'volume_name': 'volume-a6f83b2b-5122-4073-8935-55d628b7a1ff', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:48:06 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8df26cb1-82cf-478e-b116-f79e70d94067 tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79c71eb7-7fa8-4631-b50a-06e36ff23d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:48:06 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8df26cb1-82cf-478e-b116-f79e70d94067 tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79c71eb7-7fa8-4631-b50a-06e36ff23d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:48:06 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8df26cb1-82cf-478e-b116-f79e70d94067 tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98dfc9a0-23cb-433d-b61b-3232bdb04a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:48:06 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-8df26cb1-82cf-478e-b116-f79e70d94067 tempest-VolumesGetTest-1984201126 None] Volume a6f83b2b-5122-4073-8935-55d628b7a1ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6f83b2b-5122-4073-8935-55d628b7a1ff', 'volume_size': 1} Sep 25 11:48:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-8df26cb1-82cf-478e-b116-f79e70d94067 tempest-VolumesGetTest-1984201126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:48:09 devstack sudo[97821]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2be522fe-7685-4ad3-b3b8-a85bb6625063 tempest-GroupsV314Test-1916189067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8c5f54b9-adce-4a49-86de-be12cc986fa4 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6601d7f0-f9d3-47bc-b03d-f606cdfc348e" returned: 0 in 11.812s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:09 devstack cinder-volume[86984]: DEBUG cinder.image.image_utils [None req-2be522fe-7685-4ad3-b3b8-a85bb6625063 tempest-GroupsV314Test-1916189067 None] Image conversion details: src /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8c5f54b9-adce-4a49-86de-be12cc986fa4, size 1024.00 MB, duration 11.81 sec, destination /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6601d7f0-f9d3-47bc-b03d-f606cdfc348e {{(pid=86984) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 11:48:09 devstack cinder-volume[86984]: INFO cinder.image.image_utils [None req-2be522fe-7685-4ad3-b3b8-a85bb6625063 tempest-GroupsV314Test-1916189067 None] Converted 1024.00 MB image at 86.68 MB/s Sep 25 11:48:09 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-2be522fe-7685-4ad3-b3b8-a85bb6625063 tempest-GroupsV314Test-1916189067 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6601d7f0-f9d3-47bc-b03d-f606cdfc348e is being set with open permissions: ugo+rw: NotImplementedError Sep 25 11:48:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2be522fe-7685-4ad3-b3b8-a85bb6625063 tempest-GroupsV314Test-1916189067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6601d7f0-f9d3-47bc-b03d-f606cdfc348e {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:09 devstack sudo[97852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6601d7f0-f9d3-47bc-b03d-f606cdfc348e Sep 25 11:48:09 devstack sudo[97852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:09 devstack sudo[97852]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2be522fe-7685-4ad3-b3b8-a85bb6625063 tempest-GroupsV314Test-1916189067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6601d7f0-f9d3-47bc-b03d-f606cdfc348e" returned: 0 in 0.449s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:09 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-2be522fe-7685-4ad3-b3b8-a85bb6625063 tempest-GroupsV314Test-1916189067 None] Lock "cinder-quobyte-6601d7f0-f9d3-47bc-b03d-f606cdfc348e" released by "_copy_volume_from_snapshot" :: held 14.261s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:48:09 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-2be522fe-7685-4ad3-b3b8-a85bb6625063 tempest-GroupsV314Test-1916189067 None] Acquiring lock "cinder-quobyte-80ec6adc-418b-4f2d-a486-d1a3e0572a54" by "_delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:48:09 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-2be522fe-7685-4ad3-b3b8-a85bb6625063 tempest-GroupsV314Test-1916189067 None] Lock "cinder-quobyte-80ec6adc-418b-4f2d-a486-d1a3e0572a54" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:48:09 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-2be522fe-7685-4ad3-b3b8-a85bb6625063 tempest-GroupsV314Test-1916189067 None] Deleting offline snapshot 80ec6adc-418b-4f2d-a486-d1a3e0572a54 of volume 8c5f54b9-adce-4a49-86de-be12cc986fa4 {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:48:09 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-2be522fe-7685-4ad3-b3b8-a85bb6625063 tempest-GroupsV314Test-1916189067 None] snapshot_file for this snap is: volume-8c5f54b9-adce-4a49-86de-be12cc986fa4.80ec6adc-418b-4f2d-a486-d1a3e0572a54 {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:48:09 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[00bbab42-7bf1-4d0c-9371-f91956b0eb0d]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:48:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2be522fe-7685-4ad3-b3b8-a85bb6625063 tempest-GroupsV314Test-1916189067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8c5f54b9-adce-4a49-86de-be12cc986fa4.80ec6adc-418b-4f2d-a486-d1a3e0572a54 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:09 devstack sudo[97859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8c5f54b9-adce-4a49-86de-be12cc986fa4.80ec6adc-418b-4f2d-a486-d1a3e0572a54 Sep 25 11:48:09 devstack sudo[97859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:10 devstack sudo[97859]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2be522fe-7685-4ad3-b3b8-a85bb6625063 tempest-GroupsV314Test-1916189067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8c5f54b9-adce-4a49-86de-be12cc986fa4.80ec6adc-418b-4f2d-a486-d1a3e0572a54" returned: 0 in 0.497s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:10 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-2be522fe-7685-4ad3-b3b8-a85bb6625063 tempest-GroupsV314Test-1916189067 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c5f54b9-adce-4a49-86de-be12cc986fa4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86984) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:48:10 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[a729aee1-07d7-4187-9a6b-bc9cd23a08a3]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:48:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2be522fe-7685-4ad3-b3b8-a85bb6625063 tempest-GroupsV314Test-1916189067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8c5f54b9-adce-4a49-86de-be12cc986fa4 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:10 devstack sudo[97864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8c5f54b9-adce-4a49-86de-be12cc986fa4 Sep 25 11:48:10 devstack sudo[97864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:11 devstack sudo[97864]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2be522fe-7685-4ad3-b3b8-a85bb6625063 tempest-GroupsV314Test-1916189067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8c5f54b9-adce-4a49-86de-be12cc986fa4" returned: 0 in 0.858s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2be522fe-7685-4ad3-b3b8-a85bb6625063 tempest-GroupsV314Test-1916189067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8c5f54b9-adce-4a49-86de-be12cc986fa4.80ec6adc-418b-4f2d-a486-d1a3e0572a54 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:11 devstack sudo[97870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8c5f54b9-adce-4a49-86de-be12cc986fa4.80ec6adc-418b-4f2d-a486-d1a3e0572a54 Sep 25 11:48:11 devstack sudo[97870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:11 devstack sudo[97870]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2be522fe-7685-4ad3-b3b8-a85bb6625063 tempest-GroupsV314Test-1916189067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8c5f54b9-adce-4a49-86de-be12cc986fa4.80ec6adc-418b-4f2d-a486-d1a3e0572a54" returned: 0 in 0.547s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2be522fe-7685-4ad3-b3b8-a85bb6625063 tempest-GroupsV314Test-1916189067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8c5f54b9-adce-4a49-86de-be12cc986fa4.80ec6adc-418b-4f2d-a486-d1a3e0572a54 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:11 devstack sudo[97877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8c5f54b9-adce-4a49-86de-be12cc986fa4.80ec6adc-418b-4f2d-a486-d1a3e0572a54 Sep 25 11:48:11 devstack sudo[97877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:12 devstack sudo[97877]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:12 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2be522fe-7685-4ad3-b3b8-a85bb6625063 tempest-GroupsV314Test-1916189067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8c5f54b9-adce-4a49-86de-be12cc986fa4.80ec6adc-418b-4f2d-a486-d1a3e0572a54" returned: 0 in 0.404s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:12 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-2be522fe-7685-4ad3-b3b8-a85bb6625063 tempest-GroupsV314Test-1916189067 None] Lock "cinder-quobyte-80ec6adc-418b-4f2d-a486-d1a3e0572a54" released by "_delete_snapshot" :: held 2.509s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:48:12 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-2be522fe-7685-4ad3-b3b8-a85bb6625063 tempest-GroupsV314Test-1916189067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 21.986s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:48:12 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-b2accffa-56f2-46d6-9971-631b3b0466fb tempest-VolumesTransfersV357Test-1096093527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.910s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:48:12 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-b2accffa-56f2-46d6-9971-631b3b0466fb tempest-VolumesTransfersV357Test-1096093527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:48:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1030104054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e59b78a-fbbf-4d90-8a4b-430d3d1e2d70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7def1c172ada45e0ad991b90554cb856',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:48:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:48:06Z,use_quota=True,user_id='7bfce17528e14f10b764b46184e1d808',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:48:12 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-b2accffa-56f2-46d6-9971-631b3b0466fb tempest-VolumesTransfersV357Test-1096093527 None] Creating volume 7e59b78a-fbbf-4d90-8a4b-430d3d1e2d70 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:48:12 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-b2accffa-56f2-46d6-9971-631b3b0466fb tempest-VolumesTransfersV357Test-1096093527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:48:12 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-b2accffa-56f2-46d6-9971-631b3b0466fb tempest-VolumesTransfersV357Test-1096093527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:48:12 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-b2accffa-56f2-46d6-9971-631b3b0466fb tempest-VolumesTransfersV357Test-1096093527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:48:12 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-b2accffa-56f2-46d6-9971-631b3b0466fb tempest-VolumesTransfersV357Test-1096093527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:48:12 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-b2accffa-56f2-46d6-9971-631b3b0466fb tempest-VolumesTransfersV357Test-1096093527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:48:12 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-b2accffa-56f2-46d6-9971-631b3b0466fb tempest-VolumesTransfersV357Test-1096093527 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:48:12 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-b2accffa-56f2-46d6-9971-631b3b0466fb tempest-VolumesTransfersV357Test-1096093527 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:48:12 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-b2accffa-56f2-46d6-9971-631b3b0466fb tempest-VolumesTransfersV357Test-1096093527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7e59b78a-fbbf-4d90-8a4b-430d3d1e2d70 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:12 devstack sudo[97894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7e59b78a-fbbf-4d90-8a4b-430d3d1e2d70 1073741824 Sep 25 11:48:12 devstack sudo[97894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:12 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-2be522fe-7685-4ad3-b3b8-a85bb6625063 tempest-GroupsV314Test-1916189067 None] Create group from source-group-1085f14f-92c4-4d56-9def-76dffc066bbc completed successfully. Sep 25 11:48:13 devstack sudo[97894]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:13 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-b2accffa-56f2-46d6-9971-631b3b0466fb tempest-VolumesTransfersV357Test-1096093527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7e59b78a-fbbf-4d90-8a4b-430d3d1e2d70 1073741824" returned: 0 in 1.195s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:13 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-b2accffa-56f2-46d6-9971-631b3b0466fb tempest-VolumesTransfersV357Test-1096093527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7e59b78a-fbbf-4d90-8a4b-430d3d1e2d70 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:13 devstack sudo[97944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7e59b78a-fbbf-4d90-8a4b-430d3d1e2d70 Sep 25 11:48:13 devstack sudo[97944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:14 devstack sudo[97944]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:14 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-b2accffa-56f2-46d6-9971-631b3b0466fb tempest-VolumesTransfersV357Test-1096093527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7e59b78a-fbbf-4d90-8a4b-430d3d1e2d70" returned: 0 in 0.509s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:14 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-b2accffa-56f2-46d6-9971-631b3b0466fb tempest-VolumesTransfersV357Test-1096093527 None] <== create_volume: return (1844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:48:14 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-b2accffa-56f2-46d6-9971-631b3b0466fb tempest-VolumesTransfersV357Test-1096093527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.852s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:48:14 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-8df26cb1-82cf-478e-b116-f79e70d94067 tempest-VolumesGetTest-1984201126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.530s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:48:14 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-8df26cb1-82cf-478e-b116-f79e70d94067 tempest-VolumesGetTest-1984201126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:48:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-186317824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6f83b2b-5122-4073-8935-55d628b7a1ff,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1f6a1c00cee34650b3106442f2443249',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:48:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:48:06Z,use_quota=True,user_id='0b750a9ac0d643ab979b6125b2297eb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:48:14 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-8df26cb1-82cf-478e-b116-f79e70d94067 tempest-VolumesGetTest-1984201126 None] Creating volume a6f83b2b-5122-4073-8935-55d628b7a1ff {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:48:14 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-8df26cb1-82cf-478e-b116-f79e70d94067 tempest-VolumesGetTest-1984201126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:48:14 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-8df26cb1-82cf-478e-b116-f79e70d94067 tempest-VolumesGetTest-1984201126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:48:14 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-8df26cb1-82cf-478e-b116-f79e70d94067 tempest-VolumesGetTest-1984201126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:48:14 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-8df26cb1-82cf-478e-b116-f79e70d94067 tempest-VolumesGetTest-1984201126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:48:14 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-8df26cb1-82cf-478e-b116-f79e70d94067 tempest-VolumesGetTest-1984201126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:48:14 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-8df26cb1-82cf-478e-b116-f79e70d94067 tempest-VolumesGetTest-1984201126 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:48:14 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-8df26cb1-82cf-478e-b116-f79e70d94067 tempest-VolumesGetTest-1984201126 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:48:14 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8df26cb1-82cf-478e-b116-f79e70d94067 tempest-VolumesGetTest-1984201126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a6f83b2b-5122-4073-8935-55d628b7a1ff 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:14 devstack sudo[97959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a6f83b2b-5122-4073-8935-55d628b7a1ff 1073741824 Sep 25 11:48:14 devstack sudo[97959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:14 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b2accffa-56f2-46d6-9971-631b3b0466fb tempest-VolumesTransfersV357Test-1096093527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1860a25e-8fdf-4634-85e8-f38509c79f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e59b78a-fbbf-4d90-8a4b-430d3d1e2d70', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:48:14 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b2accffa-56f2-46d6-9971-631b3b0466fb tempest-VolumesTransfersV357Test-1096093527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04e895d9-c602-46c1-ac8a-096a80cf1267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:48:14 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-b2accffa-56f2-46d6-9971-631b3b0466fb tempest-VolumesTransfersV357Test-1096093527 None] Volume volume-7e59b78a-fbbf-4d90-8a4b-430d3d1e2d70 (7e59b78a-fbbf-4d90-8a4b-430d3d1e2d70): created successfully Sep 25 11:48:14 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b2accffa-56f2-46d6-9971-631b3b0466fb tempest-VolumesTransfersV357Test-1096093527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04e895d9-c602-46c1-ac8a-096a80cf1267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:48:14 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b2accffa-56f2-46d6-9971-631b3b0466fb tempest-VolumesTransfersV357Test-1096093527 None] Flow 'volume_create_manager' (3ea82e56-8b8e-4f22-a4c1-258aa73c2662) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:48:14 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-b2accffa-56f2-46d6-9971-631b3b0466fb tempest-VolumesTransfersV357Test-1096093527 None] Created volume successfully. Sep 25 11:48:15 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-2581fcea-12cf-4764-ac3e-56efce342b62 tempest-GroupsV314Test-1916189067 None] Acquiring lock "cinder-quobyte-6601d7f0-f9d3-47bc-b03d-f606cdfc348e" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:48:15 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-2581fcea-12cf-4764-ac3e-56efce342b62 tempest-GroupsV314Test-1916189067 None] Lock "cinder-quobyte-6601d7f0-f9d3-47bc-b03d-f606cdfc348e" acquired by "delete_volume" :: waited 0.040s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:48:15 devstack sudo[97959]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:15 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8df26cb1-82cf-478e-b116-f79e70d94067 tempest-VolumesGetTest-1984201126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a6f83b2b-5122-4073-8935-55d628b7a1ff 1073741824" returned: 0 in 0.850s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:15 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5eba591-e093-4a82-bafa-5637af3d036c]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:48:15 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2581fcea-12cf-4764-ac3e-56efce342b62 tempest-GroupsV314Test-1916189067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6601d7f0-f9d3-47bc-b03d-f606cdfc348e {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:15 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8df26cb1-82cf-478e-b116-f79e70d94067 tempest-VolumesGetTest-1984201126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a6f83b2b-5122-4073-8935-55d628b7a1ff {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:15 devstack sudo[97981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a6f83b2b-5122-4073-8935-55d628b7a1ff Sep 25 11:48:15 devstack sudo[97981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:15 devstack sudo[97980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6601d7f0-f9d3-47bc-b03d-f606cdfc348e Sep 25 11:48:15 devstack sudo[97980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:15 devstack sudo[97981]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:15 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8df26cb1-82cf-478e-b116-f79e70d94067 tempest-VolumesGetTest-1984201126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a6f83b2b-5122-4073-8935-55d628b7a1ff" returned: 0 in 0.620s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:15 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-8df26cb1-82cf-478e-b116-f79e70d94067 tempest-VolumesGetTest-1984201126 None] <== create_volume: return (1618ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:48:15 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-8df26cb1-82cf-478e-b116-f79e70d94067 tempest-VolumesGetTest-1984201126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.627s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:48:15 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8df26cb1-82cf-478e-b116-f79e70d94067 tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98dfc9a0-23cb-433d-b61b-3232bdb04a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6f83b2b-5122-4073-8935-55d628b7a1ff', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:48:15 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8df26cb1-82cf-478e-b116-f79e70d94067 tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daef010b-dbd5-4e79-ba56-d3793b4f4d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:48:15 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-8df26cb1-82cf-478e-b116-f79e70d94067 tempest-VolumesGetTest-1984201126 None] Volume volume-a6f83b2b-5122-4073-8935-55d628b7a1ff (a6f83b2b-5122-4073-8935-55d628b7a1ff): created successfully Sep 25 11:48:15 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8df26cb1-82cf-478e-b116-f79e70d94067 tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daef010b-dbd5-4e79-ba56-d3793b4f4d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:48:15 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8df26cb1-82cf-478e-b116-f79e70d94067 tempest-VolumesGetTest-1984201126 None] Flow 'volume_create_manager' (dc4a4d66-3d94-47b7-8e94-6afd14e8843f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:48:15 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-8df26cb1-82cf-478e-b116-f79e70d94067 tempest-VolumesGetTest-1984201126 None] Created volume successfully. Sep 25 11:48:16 devstack sudo[97980]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:16 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2581fcea-12cf-4764-ac3e-56efce342b62 tempest-GroupsV314Test-1916189067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6601d7f0-f9d3-47bc-b03d-f606cdfc348e" returned: 0 in 1.191s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:16 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2581fcea-12cf-4764-ac3e-56efce342b62 tempest-GroupsV314Test-1916189067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6601d7f0-f9d3-47bc-b03d-f606cdfc348e {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:16 devstack sudo[97996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6601d7f0-f9d3-47bc-b03d-f606cdfc348e Sep 25 11:48:16 devstack sudo[97996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:16 devstack sudo[97996]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:16 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2581fcea-12cf-4764-ac3e-56efce342b62 tempest-GroupsV314Test-1916189067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6601d7f0-f9d3-47bc-b03d-f606cdfc348e" returned: 0 in 0.560s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:16 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-2581fcea-12cf-4764-ac3e-56efce342b62 tempest-GroupsV314Test-1916189067 None] Lock "cinder-quobyte-6601d7f0-f9d3-47bc-b03d-f606cdfc348e" released by "delete_volume" :: held 1.904s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:48:17 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-2581fcea-12cf-4764-ac3e-56efce342b62 tempest-GroupsV314Test-1916189067 None] Created reservations ['8cfba952-9ca2-43ab-9bf7-0e3094d0bae6'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:48:17 devstack cinder-volume[86984]: WARNING cinder.quota [None req-2581fcea-12cf-4764-ac3e-56efce342b62 tempest-GroupsV314Test-1916189067 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1636197669 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1636197669, it is now deprecated. Please use the default quota class for default quota. Sep 25 11:48:17 devstack cinder-volume[86984]: WARNING cinder.quota [None req-2581fcea-12cf-4764-ac3e-56efce342b62 tempest-GroupsV314Test-1916189067 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1636197669 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1636197669, it is now deprecated. Please use the default quota class for default quota. Sep 25 11:48:17 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-6a90dc22-1a4c-4e9a-b8aa-b5f9c4d66555 tempest-VolumesTransfersV357Test-591231793 None] Transfer volume completed successfully. Sep 25 11:48:17 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-2581fcea-12cf-4764-ac3e-56efce342b62 tempest-GroupsV314Test-1916189067 None] Created reservations ['15335733-b1e6-45d9-bf01-af2a6b6f64aa', '400bcd94-8c65-4a9b-bbc9-0b6a8cfa33ac', 'ac14b76a-4f89-4fa3-bdee-9da271ad62f5', '9cd01f6b-f964-46d9-8f76-4fc35fc62c13'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:48:17 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f1370562-3c1a-47ff-af78-ca4ef0fc12cf tempest-VolumesActionsTest-794756051 None] Acquiring lock "cinder-1a630d61-19c6-487b-abd2-6c3a21b3d7fe" by "attach_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:48:17 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f1370562-3c1a-47ff-af78-ca4ef0fc12cf tempest-VolumesActionsTest-794756051 None] Lock "cinder-1a630d61-19c6-487b-abd2-6c3a21b3d7fe" acquired by "attach_volume" :: waited 0.046s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:48:17 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-2581fcea-12cf-4764-ac3e-56efce342b62 tempest-GroupsV314Test-1916189067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:48:17 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-2581fcea-12cf-4764-ac3e-56efce342b62 tempest-GroupsV314Test-1916189067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:48:17 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-2581fcea-12cf-4764-ac3e-56efce342b62 tempest-GroupsV314Test-1916189067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:48:17 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-2581fcea-12cf-4764-ac3e-56efce342b62 tempest-GroupsV314Test-1916189067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:48:17 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-2581fcea-12cf-4764-ac3e-56efce342b62 tempest-GroupsV314Test-1916189067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:48:17 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2581fcea-12cf-4764-ac3e-56efce342b62 tempest-GroupsV314Test-1916189067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:17 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-f1370562-3c1a-47ff-af78-ca4ef0fc12cf tempest-VolumesActionsTest-794756051 None] Attaching volume 1a630d61-19c6-487b-abd2-6c3a21b3d7fe to instance e96e1e34-44c8-4437-a481-27058a629356 at mountpoint /dev/vdb on host None. Sep 25 11:48:17 devstack sudo[97999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:48:17 devstack sudo[97999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:17 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-f1370562-3c1a-47ff-af78-ca4ef0fc12cf tempest-VolumesActionsTest-794756051 None] Attach volume completed successfully. Sep 25 11:48:17 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f1370562-3c1a-47ff-af78-ca4ef0fc12cf tempest-VolumesActionsTest-794756051 None] Lock "cinder-1a630d61-19c6-487b-abd2-6c3a21b3d7fe" released by "attach_volume" :: held 0.321s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:48:18 devstack sudo[97999]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2581fcea-12cf-4764-ac3e-56efce342b62 tempest-GroupsV314Test-1916189067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.702s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:18 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-2581fcea-12cf-4764-ac3e-56efce342b62 tempest-GroupsV314Test-1916189067 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:48:18 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-2581fcea-12cf-4764-ac3e-56efce342b62 tempest-GroupsV314Test-1916189067 None] Delete group completed successfully. Sep 25 11:48:18 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-7e334835-5052-4f2a-9588-cc8dd18ffd7f tempest-VolumesTransfersV357Test-1815265755 None] Acquiring lock "cinder-7e59b78a-fbbf-4d90-8a4b-430d3d1e2d70-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:48:18 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-0c23bab1-d657-47ad-aa83-af8c09e04066 tempest-VolumesActionsTest-794756051 None] Acquiring lock "cinder-1a630d61-19c6-487b-abd2-6c3a21b3d7fe-detach_volume" by "detach_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:48:18 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-7e334835-5052-4f2a-9588-cc8dd18ffd7f tempest-VolumesTransfersV357Test-1815265755 None] Lock "cinder-7e59b78a-fbbf-4d90-8a4b-430d3d1e2d70-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:48:18 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-0c23bab1-d657-47ad-aa83-af8c09e04066 tempest-VolumesActionsTest-794756051 None] Lock "cinder-1a630d61-19c6-487b-abd2-6c3a21b3d7fe-detach_volume" acquired by "detach_volume" :: waited 0.043s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:48:18 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-0c23bab1-d657-47ad-aa83-af8c09e04066 tempest-VolumesActionsTest-794756051 None] Detaching volume 1a630d61-19c6-487b-abd2-6c3a21b3d7fe from instance e96e1e34-44c8-4437-a481-27058a629356. Sep 25 11:48:18 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-7e334835-5052-4f2a-9588-cc8dd18ffd7f tempest-VolumesTransfersV357Test-1815265755 None] Acquiring lock "cinder-quobyte-7e59b78a-fbbf-4d90-8a4b-430d3d1e2d70" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:48:18 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-7e334835-5052-4f2a-9588-cc8dd18ffd7f tempest-VolumesTransfersV357Test-1815265755 None] Lock "cinder-quobyte-7e59b78a-fbbf-4d90-8a4b-430d3d1e2d70" acquired by "delete_volume" :: waited 0.063s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:48:18 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-0c23bab1-d657-47ad-aa83-af8c09e04066 tempest-VolumesActionsTest-794756051 None] Detach volume completed successfully. Sep 25 11:48:18 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[7663ad92-7329-42f0-9f44-c191719c751d]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:48:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7e334835-5052-4f2a-9588-cc8dd18ffd7f tempest-VolumesTransfersV357Test-1815265755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7e59b78a-fbbf-4d90-8a4b-430d3d1e2d70 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:19 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-0c23bab1-d657-47ad-aa83-af8c09e04066 tempest-VolumesActionsTest-794756051 None] Lock "cinder-1a630d61-19c6-487b-abd2-6c3a21b3d7fe-detach_volume" released by "detach_volume" :: held 0.272s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:48:19 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b35b540-3948-4a90-b608-b82cdab02fc0 tempest-VolumesGetTest-1984201126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:48:19 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2b35b540-3948-4a90-b608-b82cdab02fc0 tempest-VolumesGetTest-1984201126 None] Flow 'volume_create_manager' (441add32-9f3b-4791-aa8f-d3229744b2fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:48:19 devstack sudo[98002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7e59b78a-fbbf-4d90-8a4b-430d3d1e2d70 Sep 25 11:48:19 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2b35b540-3948-4a90-b608-b82cdab02fc0 tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e67ce84c-ab32-4cb4-9aba-7347141cc581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:48:19 devstack sudo[98002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:19 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2b35b540-3948-4a90-b608-b82cdab02fc0 tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e67ce84c-ab32-4cb4-9aba-7347141cc581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:48:18Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2053343355',display_name='tempest-VolumesGetTest-Volume-1913451470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dc13e80-ddfc-4755-8a3b-a128cc34368c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f6a1c00cee34650b3106442f2443249',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:48:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:48:19Z,use_quota=True,user_id='0b750a9ac0d643ab979b6125b2297eb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:48:19 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2b35b540-3948-4a90-b608-b82cdab02fc0 tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (788c68eb-6dbf-4c5d-b108-fed352505659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:48:19 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2b35b540-3948-4a90-b608-b82cdab02fc0 tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (788c68eb-6dbf-4c5d-b108-fed352505659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:48:19 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2b35b540-3948-4a90-b608-b82cdab02fc0 tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (192885aa-4450-42df-9f40-f885cd0eb896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:48:19 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2b35b540-3948-4a90-b608-b82cdab02fc0 tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (192885aa-4450-42df-9f40-f885cd0eb896) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1dc13e80-ddfc-4755-8a3b-a128cc34368c', 'volume_name': 'volume-1dc13e80-ddfc-4755-8a3b-a128cc34368c', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:48:19 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2b35b540-3948-4a90-b608-b82cdab02fc0 tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cdd1f9d-ba1a-42ce-abc9-35d73e6be5d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:48:19 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2b35b540-3948-4a90-b608-b82cdab02fc0 tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cdd1f9d-ba1a-42ce-abc9-35d73e6be5d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:48:19 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2b35b540-3948-4a90-b608-b82cdab02fc0 tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ac4481b-7816-4e6d-8114-17c7cb6e9b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:48:19 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-2b35b540-3948-4a90-b608-b82cdab02fc0 tempest-VolumesGetTest-1984201126 None] Volume 1dc13e80-ddfc-4755-8a3b-a128cc34368c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1dc13e80-ddfc-4755-8a3b-a128cc34368c', 'volume_size': 1} Sep 25 11:48:19 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-2b35b540-3948-4a90-b608-b82cdab02fc0 tempest-VolumesGetTest-1984201126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:48:19 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-2b35b540-3948-4a90-b608-b82cdab02fc0 tempest-VolumesGetTest-1984201126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:48:19 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-2b35b540-3948-4a90-b608-b82cdab02fc0 tempest-VolumesGetTest-1984201126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:48:18Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2053343355',display_name='tempest-VolumesGetTest-Volume-1913451470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dc13e80-ddfc-4755-8a3b-a128cc34368c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f6a1c00cee34650b3106442f2443249',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:48:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:48:19Z,use_quota=True,user_id='0b750a9ac0d643ab979b6125b2297eb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:48:19 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-2b35b540-3948-4a90-b608-b82cdab02fc0 tempest-VolumesGetTest-1984201126 None] Creating volume 1dc13e80-ddfc-4755-8a3b-a128cc34368c {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:48:19 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-2b35b540-3948-4a90-b608-b82cdab02fc0 tempest-VolumesGetTest-1984201126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:48:19 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-2b35b540-3948-4a90-b608-b82cdab02fc0 tempest-VolumesGetTest-1984201126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:48:19 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-2b35b540-3948-4a90-b608-b82cdab02fc0 tempest-VolumesGetTest-1984201126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:48:19 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-2b35b540-3948-4a90-b608-b82cdab02fc0 tempest-VolumesGetTest-1984201126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:48:19 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-2b35b540-3948-4a90-b608-b82cdab02fc0 tempest-VolumesGetTest-1984201126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:48:19 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-2b35b540-3948-4a90-b608-b82cdab02fc0 tempest-VolumesGetTest-1984201126 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:48:19 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-2b35b540-3948-4a90-b608-b82cdab02fc0 tempest-VolumesGetTest-1984201126 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:48:19 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2b35b540-3948-4a90-b608-b82cdab02fc0 tempest-VolumesGetTest-1984201126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1dc13e80-ddfc-4755-8a3b-a128cc34368c 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:19 devstack sudo[98004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1dc13e80-ddfc-4755-8a3b-a128cc34368c 1073741824 Sep 25 11:48:19 devstack sudo[98004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:19 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-947afd91-e821-437a-8440-43863552f657 tempest-GroupsV314Test-1916189067 None] Acquiring lock "cinder-quobyte-8c5f54b9-adce-4a49-86de-be12cc986fa4" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:48:19 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-947afd91-e821-437a-8440-43863552f657 tempest-GroupsV314Test-1916189067 None] Lock "cinder-quobyte-8c5f54b9-adce-4a49-86de-be12cc986fa4" acquired by "delete_volume" :: waited 0.075s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:48:19 devstack sudo[98002]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:19 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7e334835-5052-4f2a-9588-cc8dd18ffd7f tempest-VolumesTransfersV357Test-1815265755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7e59b78a-fbbf-4d90-8a4b-430d3d1e2d70" returned: 0 in 0.938s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:19 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7e334835-5052-4f2a-9588-cc8dd18ffd7f tempest-VolumesTransfersV357Test-1815265755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7e59b78a-fbbf-4d90-8a4b-430d3d1e2d70 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:19 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[241b3701-aba8-49c6-be72-017b8db53cba]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:48:19 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-947afd91-e821-437a-8440-43863552f657 tempest-GroupsV314Test-1916189067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8c5f54b9-adce-4a49-86de-be12cc986fa4 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:19 devstack sudo[98011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7e59b78a-fbbf-4d90-8a4b-430d3d1e2d70 Sep 25 11:48:19 devstack sudo[98011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:20 devstack sudo[98012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8c5f54b9-adce-4a49-86de-be12cc986fa4 Sep 25 11:48:20 devstack sudo[98012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:20 devstack sudo[98011]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7e334835-5052-4f2a-9588-cc8dd18ffd7f tempest-VolumesTransfersV357Test-1815265755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7e59b78a-fbbf-4d90-8a4b-430d3d1e2d70" returned: 0 in 0.484s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:20 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-7e334835-5052-4f2a-9588-cc8dd18ffd7f tempest-VolumesTransfersV357Test-1815265755 None] Lock "cinder-quobyte-7e59b78a-fbbf-4d90-8a4b-430d3d1e2d70" released by "delete_volume" :: held 1.533s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:48:20 devstack sudo[98004]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2b35b540-3948-4a90-b608-b82cdab02fc0 tempest-VolumesGetTest-1984201126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1dc13e80-ddfc-4755-8a3b-a128cc34368c 1073741824" returned: 0 in 1.078s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2b35b540-3948-4a90-b608-b82cdab02fc0 tempest-VolumesGetTest-1984201126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1dc13e80-ddfc-4755-8a3b-a128cc34368c {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:20 devstack sudo[98033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1dc13e80-ddfc-4755-8a3b-a128cc34368c Sep 25 11:48:20 devstack sudo[98033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:20 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-7e334835-5052-4f2a-9588-cc8dd18ffd7f tempest-VolumesTransfersV357Test-1815265755 None] Created reservations ['9e0cfe48-ba70-46ac-969e-42be7bcdcb58', '424d289f-1f74-44e7-9d51-cb893e029076', '93f890b5-0abc-4263-8183-c88c3cf67649', '37f68a15-8c46-4f3d-9b7b-58d67b4e00cd'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:48:20 devstack sudo[98012]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-947afd91-e821-437a-8440-43863552f657 tempest-GroupsV314Test-1916189067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8c5f54b9-adce-4a49-86de-be12cc986fa4" returned: 0 in 0.921s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-947afd91-e821-437a-8440-43863552f657 tempest-GroupsV314Test-1916189067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8c5f54b9-adce-4a49-86de-be12cc986fa4 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-7e334835-5052-4f2a-9588-cc8dd18ffd7f tempest-VolumesTransfersV357Test-1815265755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:48:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-7e334835-5052-4f2a-9588-cc8dd18ffd7f tempest-VolumesTransfersV357Test-1815265755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:48:20 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-7e334835-5052-4f2a-9588-cc8dd18ffd7f tempest-VolumesTransfersV357Test-1815265755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:48:20 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-7e334835-5052-4f2a-9588-cc8dd18ffd7f tempest-VolumesTransfersV357Test-1815265755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:48:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-7e334835-5052-4f2a-9588-cc8dd18ffd7f tempest-VolumesTransfersV357Test-1815265755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:48:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7e334835-5052-4f2a-9588-cc8dd18ffd7f tempest-VolumesTransfersV357Test-1815265755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:20 devstack sudo[98045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8c5f54b9-adce-4a49-86de-be12cc986fa4 Sep 25 11:48:20 devstack sudo[98045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:20 devstack sudo[98048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:48:20 devstack sudo[98048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:21 devstack sudo[98033]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:21 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2b35b540-3948-4a90-b608-b82cdab02fc0 tempest-VolumesGetTest-1984201126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1dc13e80-ddfc-4755-8a3b-a128cc34368c" returned: 0 in 0.550s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:21 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-2b35b540-3948-4a90-b608-b82cdab02fc0 tempest-VolumesGetTest-1984201126 None] <== create_volume: return (1745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:48:21 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-2b35b540-3948-4a90-b608-b82cdab02fc0 tempest-VolumesGetTest-1984201126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.751s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:48:21 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2b35b540-3948-4a90-b608-b82cdab02fc0 tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ac4481b-7816-4e6d-8114-17c7cb6e9b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1dc13e80-ddfc-4755-8a3b-a128cc34368c', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:48:21 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2b35b540-3948-4a90-b608-b82cdab02fc0 tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02389015-fc41-47ee-9eb1-8632c729fdc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:48:21 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-2b35b540-3948-4a90-b608-b82cdab02fc0 tempest-VolumesGetTest-1984201126 None] Volume volume-1dc13e80-ddfc-4755-8a3b-a128cc34368c (1dc13e80-ddfc-4755-8a3b-a128cc34368c): created successfully Sep 25 11:48:21 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2b35b540-3948-4a90-b608-b82cdab02fc0 tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02389015-fc41-47ee-9eb1-8632c729fdc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:48:21 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2b35b540-3948-4a90-b608-b82cdab02fc0 tempest-VolumesGetTest-1984201126 None] Flow 'volume_create_manager' (441add32-9f3b-4791-aa8f-d3229744b2fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:48:21 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-2b35b540-3948-4a90-b608-b82cdab02fc0 tempest-VolumesGetTest-1984201126 None] Created volume successfully. Sep 25 11:48:21 devstack sudo[98045]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:21 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-947afd91-e821-437a-8440-43863552f657 tempest-GroupsV314Test-1916189067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8c5f54b9-adce-4a49-86de-be12cc986fa4" returned: 0 in 0.577s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:21 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-947afd91-e821-437a-8440-43863552f657 tempest-GroupsV314Test-1916189067 None] Lock "cinder-quobyte-8c5f54b9-adce-4a49-86de-be12cc986fa4" released by "delete_volume" :: held 1.699s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:48:21 devstack sudo[98048]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:21 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7e334835-5052-4f2a-9588-cc8dd18ffd7f tempest-VolumesTransfersV357Test-1815265755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.636s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:21 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-7e334835-5052-4f2a-9588-cc8dd18ffd7f tempest-VolumesTransfersV357Test-1815265755 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:48:21 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-7e334835-5052-4f2a-9588-cc8dd18ffd7f tempest-VolumesTransfersV357Test-1815265755 None] Deleted volume successfully. Sep 25 11:48:21 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-7e334835-5052-4f2a-9588-cc8dd18ffd7f tempest-VolumesTransfersV357Test-1815265755 None] Lock "cinder-7e59b78a-fbbf-4d90-8a4b-430d3d1e2d70-delete_volume" released by "delete_volume" :: held 2.865s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:48:21 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-947afd91-e821-437a-8440-43863552f657 tempest-GroupsV314Test-1916189067 None] Created reservations ['6adc0bcf-1abd-43bf-abb1-5da897c637f3'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:48:21 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-947afd91-e821-437a-8440-43863552f657 tempest-GroupsV314Test-1916189067 None] Created reservations ['9e87d473-45c1-42e4-b444-3f99d3f6990b', 'b99ca2ef-f4bc-4720-ae4c-40a5b98d7afb', '9c025920-ee58-43dd-93b2-8825a1cf028f', '898810d1-3dbd-4584-8be4-05ef3c14c6fc'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:48:21 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-947afd91-e821-437a-8440-43863552f657 tempest-GroupsV314Test-1916189067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:48:21 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-947afd91-e821-437a-8440-43863552f657 tempest-GroupsV314Test-1916189067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:48:21 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-947afd91-e821-437a-8440-43863552f657 tempest-GroupsV314Test-1916189067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:48:21 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-947afd91-e821-437a-8440-43863552f657 tempest-GroupsV314Test-1916189067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:48:21 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-947afd91-e821-437a-8440-43863552f657 tempest-GroupsV314Test-1916189067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:48:21 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-947afd91-e821-437a-8440-43863552f657 tempest-GroupsV314Test-1916189067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:22 devstack sudo[98054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:48:22 devstack sudo[98054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:22 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-501814f8-8062-4fb6-8b18-f6e066dac8e0 tempest-VolumesTransfersV357Test-1096093527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:48:22 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-501814f8-8062-4fb6-8b18-f6e066dac8e0 tempest-VolumesTransfersV357Test-1096093527 None] Flow 'volume_create_manager' (2abeec12-a67c-423e-b679-3be050cf5ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:48:22 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-501814f8-8062-4fb6-8b18-f6e066dac8e0 tempest-VolumesTransfersV357Test-1096093527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e2c7e5f-f14e-4da4-aeb5-11583733210e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:48:22 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-501814f8-8062-4fb6-8b18-f6e066dac8e0 tempest-VolumesTransfersV357Test-1096093527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e2c7e5f-f14e-4da4-aeb5-11583733210e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:48:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-382895169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21058a10-464b-4fa8-bcb8-9b03cf9068de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7def1c172ada45e0ad991b90554cb856',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:48:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:48:22Z,use_quota=True,user_id='7bfce17528e14f10b764b46184e1d808',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:48:22 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-501814f8-8062-4fb6-8b18-f6e066dac8e0 tempest-VolumesTransfersV357Test-1096093527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f331eb4-0a95-49e1-9780-5363ee1337d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:48:22 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-501814f8-8062-4fb6-8b18-f6e066dac8e0 tempest-VolumesTransfersV357Test-1096093527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f331eb4-0a95-49e1-9780-5363ee1337d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:48:22 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-501814f8-8062-4fb6-8b18-f6e066dac8e0 tempest-VolumesTransfersV357Test-1096093527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64a94a47-9e7f-4923-a112-5cf285291b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:48:22 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-501814f8-8062-4fb6-8b18-f6e066dac8e0 tempest-VolumesTransfersV357Test-1096093527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64a94a47-9e7f-4923-a112-5cf285291b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21058a10-464b-4fa8-bcb8-9b03cf9068de', 'volume_name': 'volume-21058a10-464b-4fa8-bcb8-9b03cf9068de', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:48:22 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-501814f8-8062-4fb6-8b18-f6e066dac8e0 tempest-VolumesTransfersV357Test-1096093527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5353a2a-0056-4c42-9a18-e21953a368b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:48:22 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-501814f8-8062-4fb6-8b18-f6e066dac8e0 tempest-VolumesTransfersV357Test-1096093527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5353a2a-0056-4c42-9a18-e21953a368b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:48:22 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-501814f8-8062-4fb6-8b18-f6e066dac8e0 tempest-VolumesTransfersV357Test-1096093527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee78e7be-d17d-4256-80d9-ea974088f894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:48:22 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-501814f8-8062-4fb6-8b18-f6e066dac8e0 tempest-VolumesTransfersV357Test-1096093527 None] Volume 21058a10-464b-4fa8-bcb8-9b03cf9068de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21058a10-464b-4fa8-bcb8-9b03cf9068de', 'volume_size': 1} Sep 25 11:48:22 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-501814f8-8062-4fb6-8b18-f6e066dac8e0 tempest-VolumesTransfersV357Test-1096093527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:48:22 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-501814f8-8062-4fb6-8b18-f6e066dac8e0 tempest-VolumesTransfersV357Test-1096093527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:48:22 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-501814f8-8062-4fb6-8b18-f6e066dac8e0 tempest-VolumesTransfersV357Test-1096093527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:48:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-382895169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21058a10-464b-4fa8-bcb8-9b03cf9068de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7def1c172ada45e0ad991b90554cb856',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:48:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:48:22Z,use_quota=True,user_id='7bfce17528e14f10b764b46184e1d808',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:48:22 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-501814f8-8062-4fb6-8b18-f6e066dac8e0 tempest-VolumesTransfersV357Test-1096093527 None] Creating volume 21058a10-464b-4fa8-bcb8-9b03cf9068de {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:48:22 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-501814f8-8062-4fb6-8b18-f6e066dac8e0 tempest-VolumesTransfersV357Test-1096093527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:48:22 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-501814f8-8062-4fb6-8b18-f6e066dac8e0 tempest-VolumesTransfersV357Test-1096093527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:48:22 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-501814f8-8062-4fb6-8b18-f6e066dac8e0 tempest-VolumesTransfersV357Test-1096093527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:48:22 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-501814f8-8062-4fb6-8b18-f6e066dac8e0 tempest-VolumesTransfersV357Test-1096093527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:48:22 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-501814f8-8062-4fb6-8b18-f6e066dac8e0 tempest-VolumesTransfersV357Test-1096093527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:48:22 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-501814f8-8062-4fb6-8b18-f6e066dac8e0 tempest-VolumesTransfersV357Test-1096093527 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:48:22 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-501814f8-8062-4fb6-8b18-f6e066dac8e0 tempest-VolumesTransfersV357Test-1096093527 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:48:22 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-501814f8-8062-4fb6-8b18-f6e066dac8e0 tempest-VolumesTransfersV357Test-1096093527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-21058a10-464b-4fa8-bcb8-9b03cf9068de 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:22 devstack sudo[98058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-21058a10-464b-4fa8-bcb8-9b03cf9068de 1073741824 Sep 25 11:48:22 devstack sudo[98058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:22 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-db28dc2b-1027-47f1-9a0f-79e0be63799d tempest-VolumesGetTest-1984201126 None] Acquiring lock "cinder-1dc13e80-ddfc-4755-8a3b-a128cc34368c-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:48:22 devstack sudo[98054]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:22 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-947afd91-e821-437a-8440-43863552f657 tempest-GroupsV314Test-1916189067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.685s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:22 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-947afd91-e821-437a-8440-43863552f657 tempest-GroupsV314Test-1916189067 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:48:22 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-947afd91-e821-437a-8440-43863552f657 tempest-GroupsV314Test-1916189067 None] Delete group completed successfully. Sep 25 11:48:22 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-db28dc2b-1027-47f1-9a0f-79e0be63799d tempest-VolumesGetTest-1984201126 None] Lock "cinder-1dc13e80-ddfc-4755-8a3b-a128cc34368c-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:48:22 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-db28dc2b-1027-47f1-9a0f-79e0be63799d tempest-VolumesGetTest-1984201126 None] Acquiring lock "cinder-quobyte-1dc13e80-ddfc-4755-8a3b-a128cc34368c" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:48:22 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-db28dc2b-1027-47f1-9a0f-79e0be63799d tempest-VolumesGetTest-1984201126 None] Lock "cinder-quobyte-1dc13e80-ddfc-4755-8a3b-a128cc34368c" acquired by "delete_volume" :: waited 0.031s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:48:22 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34c636b-f024-4068-8635-9719120d8c94]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:48:22 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-db28dc2b-1027-47f1-9a0f-79e0be63799d tempest-VolumesGetTest-1984201126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1dc13e80-ddfc-4755-8a3b-a128cc34368c {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:22 devstack sudo[98064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1dc13e80-ddfc-4755-8a3b-a128cc34368c Sep 25 11:48:22 devstack sudo[98064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:23 devstack sudo[98058]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-501814f8-8062-4fb6-8b18-f6e066dac8e0 tempest-VolumesTransfersV357Test-1096093527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-21058a10-464b-4fa8-bcb8-9b03cf9068de 1073741824" returned: 0 in 0.936s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-501814f8-8062-4fb6-8b18-f6e066dac8e0 tempest-VolumesTransfersV357Test-1096093527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-21058a10-464b-4fa8-bcb8-9b03cf9068de {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:23 devstack sudo[98067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-21058a10-464b-4fa8-bcb8-9b03cf9068de Sep 25 11:48:23 devstack sudo[98067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:23 devstack sudo[98064]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-db28dc2b-1027-47f1-9a0f-79e0be63799d tempest-VolumesGetTest-1984201126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1dc13e80-ddfc-4755-8a3b-a128cc34368c" returned: 0 in 0.814s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-db28dc2b-1027-47f1-9a0f-79e0be63799d tempest-VolumesGetTest-1984201126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1dc13e80-ddfc-4755-8a3b-a128cc34368c {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:23 devstack sudo[98072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1dc13e80-ddfc-4755-8a3b-a128cc34368c Sep 25 11:48:23 devstack sudo[98072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:23 devstack sudo[98067]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-501814f8-8062-4fb6-8b18-f6e066dac8e0 tempest-VolumesTransfersV357Test-1096093527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-21058a10-464b-4fa8-bcb8-9b03cf9068de" returned: 0 in 0.460s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:23 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-501814f8-8062-4fb6-8b18-f6e066dac8e0 tempest-VolumesTransfersV357Test-1096093527 None] <== create_volume: return (1534ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:48:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-501814f8-8062-4fb6-8b18-f6e066dac8e0 tempest-VolumesTransfersV357Test-1096093527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.546s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:48:23 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-501814f8-8062-4fb6-8b18-f6e066dac8e0 tempest-VolumesTransfersV357Test-1096093527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee78e7be-d17d-4256-80d9-ea974088f894) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21058a10-464b-4fa8-bcb8-9b03cf9068de', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:48:23 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-501814f8-8062-4fb6-8b18-f6e066dac8e0 tempest-VolumesTransfersV357Test-1096093527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ef9b500-f6ae-4b36-b5f5-d6793e921c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:48:23 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-501814f8-8062-4fb6-8b18-f6e066dac8e0 tempest-VolumesTransfersV357Test-1096093527 None] Volume volume-21058a10-464b-4fa8-bcb8-9b03cf9068de (21058a10-464b-4fa8-bcb8-9b03cf9068de): created successfully Sep 25 11:48:23 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-501814f8-8062-4fb6-8b18-f6e066dac8e0 tempest-VolumesTransfersV357Test-1096093527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ef9b500-f6ae-4b36-b5f5-d6793e921c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:48:23 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-501814f8-8062-4fb6-8b18-f6e066dac8e0 tempest-VolumesTransfersV357Test-1096093527 None] Flow 'volume_create_manager' (2abeec12-a67c-423e-b679-3be050cf5ffb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:48:23 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-501814f8-8062-4fb6-8b18-f6e066dac8e0 tempest-VolumesTransfersV357Test-1096093527 None] Created volume successfully. Sep 25 11:48:24 devstack sudo[98072]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:24 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-db28dc2b-1027-47f1-9a0f-79e0be63799d tempest-VolumesGetTest-1984201126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1dc13e80-ddfc-4755-8a3b-a128cc34368c" returned: 0 in 0.429s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:24 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-db28dc2b-1027-47f1-9a0f-79e0be63799d tempest-VolumesGetTest-1984201126 None] Lock "cinder-quobyte-1dc13e80-ddfc-4755-8a3b-a128cc34368c" released by "delete_volume" :: held 1.318s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:48:24 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-db28dc2b-1027-47f1-9a0f-79e0be63799d tempest-VolumesGetTest-1984201126 None] Created reservations ['90d5cd07-20f5-46e4-89b4-ee7ee3a44829', '3419ae9e-803e-42ca-8395-4faff38e56c2', 'd21dec12-793b-43ef-a118-3837e06f7264', '330f7c34-3554-4761-aa13-c0124cef41ec'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:48:24 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-db28dc2b-1027-47f1-9a0f-79e0be63799d tempest-VolumesGetTest-1984201126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:48:24 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-db28dc2b-1027-47f1-9a0f-79e0be63799d tempest-VolumesGetTest-1984201126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:48:24 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-db28dc2b-1027-47f1-9a0f-79e0be63799d tempest-VolumesGetTest-1984201126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:48:24 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-db28dc2b-1027-47f1-9a0f-79e0be63799d tempest-VolumesGetTest-1984201126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:48:24 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-db28dc2b-1027-47f1-9a0f-79e0be63799d tempest-VolumesGetTest-1984201126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:48:24 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-db28dc2b-1027-47f1-9a0f-79e0be63799d tempest-VolumesGetTest-1984201126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:24 devstack sudo[98076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:48:24 devstack sudo[98076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:24 devstack sudo[98076]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:24 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-db28dc2b-1027-47f1-9a0f-79e0be63799d tempest-VolumesGetTest-1984201126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.411s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:24 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-db28dc2b-1027-47f1-9a0f-79e0be63799d tempest-VolumesGetTest-1984201126 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:48:24 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-db28dc2b-1027-47f1-9a0f-79e0be63799d tempest-VolumesGetTest-1984201126 None] Deleted volume successfully. Sep 25 11:48:24 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-db28dc2b-1027-47f1-9a0f-79e0be63799d tempest-VolumesGetTest-1984201126 None] Lock "cinder-1dc13e80-ddfc-4755-8a3b-a128cc34368c-delete_volume" released by "delete_volume" :: held 2.077s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:48:24 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f217c693-6407-492b-838b-ee9f5ffe56c0 tempest-VolumesTransfersV357Test-1815265755 None] Acquiring lock "cinder-21058a10-464b-4fa8-bcb8-9b03cf9068de-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:48:24 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f217c693-6407-492b-838b-ee9f5ffe56c0 tempest-VolumesTransfersV357Test-1815265755 None] Lock "cinder-21058a10-464b-4fa8-bcb8-9b03cf9068de-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:48:24 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f217c693-6407-492b-838b-ee9f5ffe56c0 tempest-VolumesTransfersV357Test-1815265755 None] Acquiring lock "cinder-quobyte-21058a10-464b-4fa8-bcb8-9b03cf9068de" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:48:25 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f217c693-6407-492b-838b-ee9f5ffe56c0 tempest-VolumesTransfersV357Test-1815265755 None] Lock "cinder-quobyte-21058a10-464b-4fa8-bcb8-9b03cf9068de" acquired by "delete_volume" :: waited 0.026s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:48:25 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[86510570-72f1-4349-a2fc-401dd125792e]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:48:25 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f217c693-6407-492b-838b-ee9f5ffe56c0 tempest-VolumesTransfersV357Test-1815265755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-21058a10-464b-4fa8-bcb8-9b03cf9068de {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:25 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-17efe20b-d966-4f58-8c9e-a2744dfa6a9f tempest-VolumesGetTest-1984201126 None] Acquiring lock "cinder-a6f83b2b-5122-4073-8935-55d628b7a1ff-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:48:25 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-17efe20b-d966-4f58-8c9e-a2744dfa6a9f tempest-VolumesGetTest-1984201126 None] Lock "cinder-a6f83b2b-5122-4073-8935-55d628b7a1ff-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:48:25 devstack sudo[98079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-21058a10-464b-4fa8-bcb8-9b03cf9068de Sep 25 11:48:25 devstack sudo[98079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:25 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-17efe20b-d966-4f58-8c9e-a2744dfa6a9f tempest-VolumesGetTest-1984201126 None] Acquiring lock "cinder-quobyte-a6f83b2b-5122-4073-8935-55d628b7a1ff" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:48:25 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-17efe20b-d966-4f58-8c9e-a2744dfa6a9f tempest-VolumesGetTest-1984201126 None] Lock "cinder-quobyte-a6f83b2b-5122-4073-8935-55d628b7a1ff" acquired by "delete_volume" :: waited 0.023s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:48:25 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[9046d2fd-832f-4622-8dbb-ad2f3d6483fc]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:48:25 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-17efe20b-d966-4f58-8c9e-a2744dfa6a9f tempest-VolumesGetTest-1984201126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a6f83b2b-5122-4073-8935-55d628b7a1ff {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:25 devstack sudo[98081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a6f83b2b-5122-4073-8935-55d628b7a1ff Sep 25 11:48:25 devstack sudo[98081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:25 devstack sudo[98079]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:25 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f217c693-6407-492b-838b-ee9f5ffe56c0 tempest-VolumesTransfersV357Test-1815265755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-21058a10-464b-4fa8-bcb8-9b03cf9068de" returned: 0 in 0.715s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:25 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f217c693-6407-492b-838b-ee9f5ffe56c0 tempest-VolumesTransfersV357Test-1815265755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-21058a10-464b-4fa8-bcb8-9b03cf9068de {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:25 devstack sudo[98086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-21058a10-464b-4fa8-bcb8-9b03cf9068de Sep 25 11:48:25 devstack sudo[98086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:26 devstack sudo[98086]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:26 devstack sudo[98081]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:26 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f217c693-6407-492b-838b-ee9f5ffe56c0 tempest-VolumesTransfersV357Test-1815265755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-21058a10-464b-4fa8-bcb8-9b03cf9068de" returned: 0 in 0.521s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:26 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-17efe20b-d966-4f58-8c9e-a2744dfa6a9f tempest-VolumesGetTest-1984201126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a6f83b2b-5122-4073-8935-55d628b7a1ff" returned: 0 in 0.902s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:26 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-17efe20b-d966-4f58-8c9e-a2744dfa6a9f tempest-VolumesGetTest-1984201126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a6f83b2b-5122-4073-8935-55d628b7a1ff {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:26 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f217c693-6407-492b-838b-ee9f5ffe56c0 tempest-VolumesTransfersV357Test-1815265755 None] Lock "cinder-quobyte-21058a10-464b-4fa8-bcb8-9b03cf9068de" released by "delete_volume" :: held 1.363s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:48:26 devstack sudo[98092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a6f83b2b-5122-4073-8935-55d628b7a1ff Sep 25 11:48:26 devstack sudo[98092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:26 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-f217c693-6407-492b-838b-ee9f5ffe56c0 tempest-VolumesTransfersV357Test-1815265755 None] Created reservations ['5ede63ba-77b4-4a24-aeaf-f56b2867497f', '5f36bc91-0a58-479b-aeaa-5ae1eca5556b', 'f16091ae-1e01-4816-b768-804617fe1d47', '80ec2688-7fe5-4c5a-a32c-c79cfc2acc6f'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:48:26 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f217c693-6407-492b-838b-ee9f5ffe56c0 tempest-VolumesTransfersV357Test-1815265755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:48:26 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f217c693-6407-492b-838b-ee9f5ffe56c0 tempest-VolumesTransfersV357Test-1815265755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:48:26 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-f217c693-6407-492b-838b-ee9f5ffe56c0 tempest-VolumesTransfersV357Test-1815265755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:48:26 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-f217c693-6407-492b-838b-ee9f5ffe56c0 tempest-VolumesTransfersV357Test-1815265755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:48:26 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f217c693-6407-492b-838b-ee9f5ffe56c0 tempest-VolumesTransfersV357Test-1815265755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:48:26 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f217c693-6407-492b-838b-ee9f5ffe56c0 tempest-VolumesTransfersV357Test-1815265755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:26 devstack sudo[98094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:48:26 devstack sudo[98094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:26 devstack sudo[98092]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:26 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-17efe20b-d966-4f58-8c9e-a2744dfa6a9f tempest-VolumesGetTest-1984201126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a6f83b2b-5122-4073-8935-55d628b7a1ff" returned: 0 in 0.540s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:26 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-17efe20b-d966-4f58-8c9e-a2744dfa6a9f tempest-VolumesGetTest-1984201126 None] Lock "cinder-quobyte-a6f83b2b-5122-4073-8935-55d628b7a1ff" released by "delete_volume" :: held 1.542s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:48:26 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-17efe20b-d966-4f58-8c9e-a2744dfa6a9f tempest-VolumesGetTest-1984201126 None] Created reservations ['b6c300ad-bdba-4728-a6fc-5396f6d8af16', 'b59b105d-8e51-4367-9e55-d9648def23bb', '88e2bddd-d8b7-47b5-a3a2-14ccfdbe347d', '23888fc4-daa1-4649-a80b-e4d7515cc024'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:48:27 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-17efe20b-d966-4f58-8c9e-a2744dfa6a9f tempest-VolumesGetTest-1984201126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:48:27 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-17efe20b-d966-4f58-8c9e-a2744dfa6a9f tempest-VolumesGetTest-1984201126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:48:27 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-17efe20b-d966-4f58-8c9e-a2744dfa6a9f tempest-VolumesGetTest-1984201126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:48:27 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-17efe20b-d966-4f58-8c9e-a2744dfa6a9f tempest-VolumesGetTest-1984201126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:48:27 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-17efe20b-d966-4f58-8c9e-a2744dfa6a9f tempest-VolumesGetTest-1984201126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:48:27 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-17efe20b-d966-4f58-8c9e-a2744dfa6a9f tempest-VolumesGetTest-1984201126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:27 devstack sudo[98094]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:27 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f217c693-6407-492b-838b-ee9f5ffe56c0 tempest-VolumesTransfersV357Test-1815265755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.486s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:27 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-f217c693-6407-492b-838b-ee9f5ffe56c0 tempest-VolumesTransfersV357Test-1815265755 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:48:27 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-f217c693-6407-492b-838b-ee9f5ffe56c0 tempest-VolumesTransfersV357Test-1815265755 None] Deleted volume successfully. Sep 25 11:48:27 devstack sudo[98098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:48:27 devstack sudo[98098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:27 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f217c693-6407-492b-838b-ee9f5ffe56c0 tempest-VolumesTransfersV357Test-1815265755 None] Lock "cinder-21058a10-464b-4fa8-bcb8-9b03cf9068de-delete_volume" released by "delete_volume" :: held 2.370s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:48:27 devstack sudo[98098]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:27 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-17efe20b-d966-4f58-8c9e-a2744dfa6a9f tempest-VolumesGetTest-1984201126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.563s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:27 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-17efe20b-d966-4f58-8c9e-a2744dfa6a9f tempest-VolumesGetTest-1984201126 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:48:27 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-17efe20b-d966-4f58-8c9e-a2744dfa6a9f tempest-VolumesGetTest-1984201126 None] Deleted volume successfully. Sep 25 11:48:27 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-17efe20b-d966-4f58-8c9e-a2744dfa6a9f tempest-VolumesGetTest-1984201126 None] Lock "cinder-a6f83b2b-5122-4073-8935-55d628b7a1ff-delete_volume" released by "delete_volume" :: held 2.563s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:48:28 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-de18d62f-e681-407e-b96e-407bb17e7adf tempest-VolumesActionsTest-794756051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:48:28 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-de18d62f-e681-407e-b96e-407bb17e7adf tempest-VolumesActionsTest-794756051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:48:28 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[60fb9a53-2a29-4c70-9e91-39677483e984]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:48:28 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-de18d62f-e681-407e-b96e-407bb17e7adf tempest-VolumesActionsTest-794756051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a630d61-19c6-487b-abd2-6c3a21b3d7fe {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:28 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f7b8f9d-97b6-4f27-885b-289a043264a4 tempest-VolumesGetTest-1984201126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:48:28 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6f7b8f9d-97b6-4f27-885b-289a043264a4 tempest-VolumesGetTest-1984201126 None] Flow 'volume_create_manager' (a2c5a9e2-513f-4ad6-b273-d7c0871c8597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:48:28 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6f7b8f9d-97b6-4f27-885b-289a043264a4 tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7ee4477-1685-4f3d-8ce5-cdc4ec291474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:48:28 devstack sudo[98102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a630d61-19c6-487b-abd2-6c3a21b3d7fe Sep 25 11:48:28 devstack sudo[98102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:28 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6f7b8f9d-97b6-4f27-885b-289a043264a4 tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7ee4477-1685-4f3d-8ce5-cdc4ec291474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:48:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1931300986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6a05b7d-2488-4b77-9202-0018e6006417,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f6a1c00cee34650b3106442f2443249',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:48:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:48:29Z,use_quota=True,user_id='0b750a9ac0d643ab979b6125b2297eb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:48:28 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6f7b8f9d-97b6-4f27-885b-289a043264a4 tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (619f3c4c-e315-4ded-b08e-5370bf10c2e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:48:28 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6f7b8f9d-97b6-4f27-885b-289a043264a4 tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (619f3c4c-e315-4ded-b08e-5370bf10c2e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:48:28 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6f7b8f9d-97b6-4f27-885b-289a043264a4 tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d75d9ae-c8d5-463a-a3b1-3f48b69e634f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:48:28 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6f7b8f9d-97b6-4f27-885b-289a043264a4 tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d75d9ae-c8d5-463a-a3b1-3f48b69e634f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6a05b7d-2488-4b77-9202-0018e6006417', 'volume_name': 'volume-c6a05b7d-2488-4b77-9202-0018e6006417', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:48:28 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6f7b8f9d-97b6-4f27-885b-289a043264a4 tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b65c6ff2-ea9e-404a-9d1b-5d0719bde7cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:48:28 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6f7b8f9d-97b6-4f27-885b-289a043264a4 tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b65c6ff2-ea9e-404a-9d1b-5d0719bde7cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:48:28 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6f7b8f9d-97b6-4f27-885b-289a043264a4 tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (570f352e-701d-4645-a251-386dab3b198a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:48:28 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-6f7b8f9d-97b6-4f27-885b-289a043264a4 tempest-VolumesGetTest-1984201126 None] Volume c6a05b7d-2488-4b77-9202-0018e6006417: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6a05b7d-2488-4b77-9202-0018e6006417', 'volume_size': 1} Sep 25 11:48:28 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-6f7b8f9d-97b6-4f27-885b-289a043264a4 tempest-VolumesGetTest-1984201126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:48:29 devstack sudo[98102]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:29 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-de18d62f-e681-407e-b96e-407bb17e7adf tempest-VolumesActionsTest-794756051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a630d61-19c6-487b-abd2-6c3a21b3d7fe" returned: 0 in 0.613s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:29 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc43e3e-f70f-48fb-ada1-1e1737a57773]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:48:29 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-de18d62f-e681-407e-b96e-407bb17e7adf tempest-VolumesActionsTest-794756051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a630d61-19c6-487b-abd2-6c3a21b3d7fe {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:29 devstack sudo[98107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a630d61-19c6-487b-abd2-6c3a21b3d7fe Sep 25 11:48:29 devstack sudo[98107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:29 devstack sudo[98107]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:29 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-de18d62f-e681-407e-b96e-407bb17e7adf tempest-VolumesActionsTest-794756051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a630d61-19c6-487b-abd2-6c3a21b3d7fe" returned: 0 in 0.591s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:29 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-de18d62f-e681-407e-b96e-407bb17e7adf tempest-VolumesActionsTest-794756051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a630d61-19c6-487b-abd2-6c3a21b3d7fe /opt/stack/data/cinder/conversion/1a630d61-19c6-487b-abd2-6c3a21b3d7fe.temp_image.37e219d3-4b32-4799-b839-64314fed5a4aajc90c7u.img {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:29 devstack sudo[98112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a630d61-19c6-487b-abd2-6c3a21b3d7fe /opt/stack/data/cinder/conversion/1a630d61-19c6-487b-abd2-6c3a21b3d7fe.temp_image.37e219d3-4b32-4799-b839-64314fed5a4aajc90c7u.img Sep 25 11:48:29 devstack sudo[98112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:38 devstack cinder-volume[86984]: DEBUG oslo_service.periodic_task [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:48:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:48:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:48:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:48:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:48:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:48:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:38 devstack cinder-volume[86984]: DEBUG dbcounter [-] [86984] Writing DB stats cinder:UPDATE=65,cinder:SELECT=59,cinder:INSERT=13,cinder:DELETE=2 {{(pid=86984) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:48:38 devstack cinder-volume[86984]: DEBUG dbcounter [-] [86984] Writing DB stats cinder:SELECT=51,cinder:UPDATE=80,cinder:INSERT=19,cinder:DELETE=6 {{(pid=86984) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:48:38 devstack sudo[98136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:48:38 devstack sudo[98136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:39 devstack sudo[98136]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 1.086s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:39 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:48:39 devstack cinder-volume[86984]: DEBUG oslo_service.periodic_task [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running periodic task VolumeManager._thread_info {{(pid=86984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:48:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] thread count: 28 {{(pid=86984) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 11:48:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] thread info: [<_MainThread(MainThread, started 132046492332160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86984) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 11:48:40 devstack sudo[98112]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:40 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-de18d62f-e681-407e-b96e-407bb17e7adf tempest-VolumesActionsTest-794756051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a630d61-19c6-487b-abd2-6c3a21b3d7fe /opt/stack/data/cinder/conversion/1a630d61-19c6-487b-abd2-6c3a21b3d7fe.temp_image.37e219d3-4b32-4799-b839-64314fed5a4aajc90c7u.img" returned: 0 in 11.221s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:41 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[93095c39-bb35-4e51-897f-47fbaf402446]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:48:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-de18d62f-e681-407e-b96e-407bb17e7adf tempest-VolumesActionsTest-794756051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a630d61-19c6-487b-abd2-6c3a21b3d7fe {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:48:41 devstack sudo[98139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a630d61-19c6-487b-abd2-6c3a21b3d7fe Sep 25 11:48:41 devstack sudo[98139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:48:41 devstack sudo[98139]: pam_unix(sudo:session): session closed for user root Sep 25 11:48:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-de18d62f-e681-407e-b96e-407bb17e7adf tempest-VolumesActionsTest-794756051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a630d61-19c6-487b-abd2-6c3a21b3d7fe" returned: 0 in 0.840s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:48:41 devstack cinder-volume[86984]: DEBUG cinder.image.image_utils [None req-de18d62f-e681-407e-b96e-407bb17e7adf tempest-VolumesActionsTest-794756051 None] Image conversion details: src /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a630d61-19c6-487b-abd2-6c3a21b3d7fe, size 1024.00 MB, duration 11.22 sec, destination /opt/stack/data/cinder/conversion/1a630d61-19c6-487b-abd2-6c3a21b3d7fe.temp_image.37e219d3-4b32-4799-b839-64314fed5a4aajc90c7u.img {{(pid=86984) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 11:48:41 devstack cinder-volume[86984]: INFO cinder.image.image_utils [None req-de18d62f-e681-407e-b96e-407bb17e7adf tempest-VolumesActionsTest-794756051 None] Converted 1024.00 MB image at 91.25 MB/s Sep 25 11:48:41 devstack cinder-volume[86984]: DEBUG cinder.image.image_utils [None req-de18d62f-e681-407e-b96e-407bb17e7adf tempest-VolumesActionsTest-794756051 None] 37e219d3-4b32-4799-b839-64314fed5a4a was raw, no need to convert to raw {{(pid=86984) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 25 11:48:43 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-afb42d06-376c-4002-8f3f-3c7018a63869 tempest-VolumesCloneTest-1869848950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:48:43 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-afb42d06-376c-4002-8f3f-3c7018a63869 tempest-VolumesCloneTest-1869848950 None] Flow 'volume_create_manager' (57074302-85f0-4313-bb3d-23db56760cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:48:43 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-afb42d06-376c-4002-8f3f-3c7018a63869 tempest-VolumesCloneTest-1869848950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66eb3726-c118-4142-8aeb-ff4d2b1b06e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:48:43 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-afb42d06-376c-4002-8f3f-3c7018a63869 tempest-VolumesCloneTest-1869848950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66eb3726-c118-4142-8aeb-ff4d2b1b06e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:48:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-225224318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4e3fc9c-c4cd-444f-9010-b71478d214b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63fea6c99966410ab0916c802a95c0a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:48:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:48:43Z,use_quota=True,user_id='4ceca8203a914493a1b1ed3000993cab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:48:43 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-afb42d06-376c-4002-8f3f-3c7018a63869 tempest-VolumesCloneTest-1869848950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fce3e36-27ff-4e15-a78b-101b567095cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:48:43 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-afb42d06-376c-4002-8f3f-3c7018a63869 tempest-VolumesCloneTest-1869848950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fce3e36-27ff-4e15-a78b-101b567095cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:48:43 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-afb42d06-376c-4002-8f3f-3c7018a63869 tempest-VolumesCloneTest-1869848950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b699413-260d-4526-8185-9100f55be744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:48:43 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-afb42d06-376c-4002-8f3f-3c7018a63869 tempest-VolumesCloneTest-1869848950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b699413-260d-4526-8185-9100f55be744) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4e3fc9c-c4cd-444f-9010-b71478d214b4', 'volume_name': 'volume-d4e3fc9c-c4cd-444f-9010-b71478d214b4', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:48:43 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-afb42d06-376c-4002-8f3f-3c7018a63869 tempest-VolumesCloneTest-1869848950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b339b6ba-93b2-425f-9561-0e4a52018e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:48:43 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-afb42d06-376c-4002-8f3f-3c7018a63869 tempest-VolumesCloneTest-1869848950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b339b6ba-93b2-425f-9561-0e4a52018e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:48:43 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-afb42d06-376c-4002-8f3f-3c7018a63869 tempest-VolumesCloneTest-1869848950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad02175b-ca69-4ef9-a5c2-edc359b75e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:48:43 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-afb42d06-376c-4002-8f3f-3c7018a63869 tempest-VolumesCloneTest-1869848950 None] Volume d4e3fc9c-c4cd-444f-9010-b71478d214b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4e3fc9c-c4cd-444f-9010-b71478d214b4', 'volume_size': 1} Sep 25 11:48:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-afb42d06-376c-4002-8f3f-3c7018a63869 tempest-VolumesCloneTest-1869848950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:48:49 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f324e1b-8796-45ee-ac91-f17f07b03b12 tempest-VolumeQuotasAdminTestJSON-1873760781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:48:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-5f324e1b-8796-45ee-ac91-f17f07b03b12 tempest-VolumeQuotasAdminTestJSON-1873760781 None] Flow 'volume_create_manager' (d73dfc63-a38b-46f6-bdb2-baf3c78ddee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:48:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-5f324e1b-8796-45ee-ac91-f17f07b03b12 tempest-VolumeQuotasAdminTestJSON-1873760781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (843a0174-3f85-4d0f-8f4c-ad30a790eac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:48:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-5f324e1b-8796-45ee-ac91-f17f07b03b12 tempest-VolumeQuotasAdminTestJSON-1873760781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (843a0174-3f85-4d0f-8f4c-ad30a790eac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:48:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-548070051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0acdac7-179c-4d17-94e6-9457141e0897,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6c60536389d4c54af025549eb2f6a3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:48:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:48:50Z,use_quota=True,user_id='f3a94755efbd42ba8e09fd02eaf50990',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:48:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-5f324e1b-8796-45ee-ac91-f17f07b03b12 tempest-VolumeQuotasAdminTestJSON-1873760781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d7f4607-777a-4bd2-b385-3a2f850b7369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:48:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-5f324e1b-8796-45ee-ac91-f17f07b03b12 tempest-VolumeQuotasAdminTestJSON-1873760781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d7f4607-777a-4bd2-b385-3a2f850b7369) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:48:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-5f324e1b-8796-45ee-ac91-f17f07b03b12 tempest-VolumeQuotasAdminTestJSON-1873760781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94fa4926-de83-4558-806e-fcf045943dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:48:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-5f324e1b-8796-45ee-ac91-f17f07b03b12 tempest-VolumeQuotasAdminTestJSON-1873760781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94fa4926-de83-4558-806e-fcf045943dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0acdac7-179c-4d17-94e6-9457141e0897', 'volume_name': 'volume-f0acdac7-179c-4d17-94e6-9457141e0897', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:48:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-5f324e1b-8796-45ee-ac91-f17f07b03b12 tempest-VolumeQuotasAdminTestJSON-1873760781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (589bc609-773a-4c8c-afb6-1291eae1b20f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:48:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-5f324e1b-8796-45ee-ac91-f17f07b03b12 tempest-VolumeQuotasAdminTestJSON-1873760781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (589bc609-773a-4c8c-afb6-1291eae1b20f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:48:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-5f324e1b-8796-45ee-ac91-f17f07b03b12 tempest-VolumeQuotasAdminTestJSON-1873760781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afb6322f-19c9-4484-968c-b49b45db5e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:48:49 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-5f324e1b-8796-45ee-ac91-f17f07b03b12 tempest-VolumeQuotasAdminTestJSON-1873760781 None] Volume f0acdac7-179c-4d17-94e6-9457141e0897: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0acdac7-179c-4d17-94e6-9457141e0897', 'volume_size': 1} Sep 25 11:48:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-5f324e1b-8796-45ee-ac91-f17f07b03b12 tempest-VolumeQuotasAdminTestJSON-1873760781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:48:59 devstack cinder-volume[86984]: DEBUG dbcounter [-] [86984] Writing DB stats cinder:SELECT=3 {{(pid=86984) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:48:59 devstack cinder-volume[86984]: DEBUG dbcounter [-] [86984] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=86984) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:49:04 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-de18d62f-e681-407e-b96e-407bb17e7adf tempest-VolumesActionsTest-794756051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 36.324s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:49:04 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-de18d62f-e681-407e-b96e-407bb17e7adf tempest-VolumesActionsTest-794756051 None] Uploaded volume to glance image-id: 37e219d3-4b32-4799-b839-64314fed5a4a. {{(pid=86984) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 25 11:49:04 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-6f7b8f9d-97b6-4f27-885b-289a043264a4 tempest-VolumesGetTest-1984201126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 36.011s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:49:04 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-6f7b8f9d-97b6-4f27-885b-289a043264a4 tempest-VolumesGetTest-1984201126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:48:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1931300986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6a05b7d-2488-4b77-9202-0018e6006417,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f6a1c00cee34650b3106442f2443249',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:48:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:48:29Z,use_quota=True,user_id='0b750a9ac0d643ab979b6125b2297eb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:49:04 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-6f7b8f9d-97b6-4f27-885b-289a043264a4 tempest-VolumesGetTest-1984201126 None] Creating volume c6a05b7d-2488-4b77-9202-0018e6006417 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:49:04 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-6f7b8f9d-97b6-4f27-885b-289a043264a4 tempest-VolumesGetTest-1984201126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:49:04 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-6f7b8f9d-97b6-4f27-885b-289a043264a4 tempest-VolumesGetTest-1984201126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:49:04 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-6f7b8f9d-97b6-4f27-885b-289a043264a4 tempest-VolumesGetTest-1984201126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:49:04 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-6f7b8f9d-97b6-4f27-885b-289a043264a4 tempest-VolumesGetTest-1984201126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:49:04 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-6f7b8f9d-97b6-4f27-885b-289a043264a4 tempest-VolumesGetTest-1984201126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:49:04 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-6f7b8f9d-97b6-4f27-885b-289a043264a4 tempest-VolumesGetTest-1984201126 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:49:04 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-6f7b8f9d-97b6-4f27-885b-289a043264a4 tempest-VolumesGetTest-1984201126 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:49:04 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6f7b8f9d-97b6-4f27-885b-289a043264a4 tempest-VolumesGetTest-1984201126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c6a05b7d-2488-4b77-9202-0018e6006417 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:04 devstack sudo[98183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c6a05b7d-2488-4b77-9202-0018e6006417 1073741824 Sep 25 11:49:04 devstack sudo[98183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:04 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-de18d62f-e681-407e-b96e-407bb17e7adf tempest-VolumesActionsTest-794756051 None] Copy volume to image completed successfully. Sep 25 11:49:05 devstack sudo[98183]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6f7b8f9d-97b6-4f27-885b-289a043264a4 tempest-VolumesGetTest-1984201126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c6a05b7d-2488-4b77-9202-0018e6006417 1073741824" returned: 0 in 0.486s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6f7b8f9d-97b6-4f27-885b-289a043264a4 tempest-VolumesGetTest-1984201126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c6a05b7d-2488-4b77-9202-0018e6006417 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:05 devstack sudo[98189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c6a05b7d-2488-4b77-9202-0018e6006417 Sep 25 11:49:05 devstack sudo[98189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:05 devstack sudo[98189]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6f7b8f9d-97b6-4f27-885b-289a043264a4 tempest-VolumesGetTest-1984201126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c6a05b7d-2488-4b77-9202-0018e6006417" returned: 0 in 0.264s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:05 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-6f7b8f9d-97b6-4f27-885b-289a043264a4 tempest-VolumesGetTest-1984201126 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:49:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-6f7b8f9d-97b6-4f27-885b-289a043264a4 tempest-VolumesGetTest-1984201126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:49:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-afb42d06-376c-4002-8f3f-3c7018a63869 tempest-VolumesCloneTest-1869848950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 21.996s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:49:05 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-afb42d06-376c-4002-8f3f-3c7018a63869 tempest-VolumesCloneTest-1869848950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:48:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-225224318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4e3fc9c-c4cd-444f-9010-b71478d214b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63fea6c99966410ab0916c802a95c0a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:48:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:48:43Z,use_quota=True,user_id='4ceca8203a914493a1b1ed3000993cab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:49:05 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-afb42d06-376c-4002-8f3f-3c7018a63869 tempest-VolumesCloneTest-1869848950 None] Creating volume d4e3fc9c-c4cd-444f-9010-b71478d214b4 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:49:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-afb42d06-376c-4002-8f3f-3c7018a63869 tempest-VolumesCloneTest-1869848950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:49:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-afb42d06-376c-4002-8f3f-3c7018a63869 tempest-VolumesCloneTest-1869848950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:49:05 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-afb42d06-376c-4002-8f3f-3c7018a63869 tempest-VolumesCloneTest-1869848950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:49:05 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-afb42d06-376c-4002-8f3f-3c7018a63869 tempest-VolumesCloneTest-1869848950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:49:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-afb42d06-376c-4002-8f3f-3c7018a63869 tempest-VolumesCloneTest-1869848950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:49:05 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-afb42d06-376c-4002-8f3f-3c7018a63869 tempest-VolumesCloneTest-1869848950 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:49:05 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-afb42d06-376c-4002-8f3f-3c7018a63869 tempest-VolumesCloneTest-1869848950 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:49:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-afb42d06-376c-4002-8f3f-3c7018a63869 tempest-VolumesCloneTest-1869848950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-d4e3fc9c-c4cd-444f-9010-b71478d214b4 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:05 devstack sudo[98192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-d4e3fc9c-c4cd-444f-9010-b71478d214b4 1073741824 Sep 25 11:49:05 devstack sudo[98192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:05 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6f7b8f9d-97b6-4f27-885b-289a043264a4 tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (570f352e-701d-4645-a251-386dab3b198a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6a05b7d-2488-4b77-9202-0018e6006417', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:49:05 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6f7b8f9d-97b6-4f27-885b-289a043264a4 tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26d4d137-cad1-4b38-a49e-62dd2ba2b94a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:49:05 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-6f7b8f9d-97b6-4f27-885b-289a043264a4 tempest-VolumesGetTest-1984201126 None] Volume volume-c6a05b7d-2488-4b77-9202-0018e6006417 (c6a05b7d-2488-4b77-9202-0018e6006417): created successfully Sep 25 11:49:05 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6f7b8f9d-97b6-4f27-885b-289a043264a4 tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26d4d137-cad1-4b38-a49e-62dd2ba2b94a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:49:05 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6f7b8f9d-97b6-4f27-885b-289a043264a4 tempest-VolumesGetTest-1984201126 None] Flow 'volume_create_manager' (a2c5a9e2-513f-4ad6-b273-d7c0871c8597) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:49:05 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-6f7b8f9d-97b6-4f27-885b-289a043264a4 tempest-VolumesGetTest-1984201126 None] Created volume successfully. Sep 25 11:49:06 devstack sudo[98192]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-afb42d06-376c-4002-8f3f-3c7018a63869 tempest-VolumesCloneTest-1869848950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-d4e3fc9c-c4cd-444f-9010-b71478d214b4 1073741824" returned: 0 in 0.569s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-afb42d06-376c-4002-8f3f-3c7018a63869 tempest-VolumesCloneTest-1869848950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-d4e3fc9c-c4cd-444f-9010-b71478d214b4 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:06 devstack sudo[98198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-d4e3fc9c-c4cd-444f-9010-b71478d214b4 Sep 25 11:49:06 devstack sudo[98198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:06 devstack sudo[98198]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-afb42d06-376c-4002-8f3f-3c7018a63869 tempest-VolumesCloneTest-1869848950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-d4e3fc9c-c4cd-444f-9010-b71478d214b4" returned: 0 in 0.357s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:06 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-afb42d06-376c-4002-8f3f-3c7018a63869 tempest-VolumesCloneTest-1869848950 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:49:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-afb42d06-376c-4002-8f3f-3c7018a63869 tempest-VolumesCloneTest-1869848950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:49:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-5f324e1b-8796-45ee-ac91-f17f07b03b12 tempest-VolumeQuotasAdminTestJSON-1873760781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.772s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:49:06 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-5f324e1b-8796-45ee-ac91-f17f07b03b12 tempest-VolumeQuotasAdminTestJSON-1873760781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:48:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-548070051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0acdac7-179c-4d17-94e6-9457141e0897,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6c60536389d4c54af025549eb2f6a3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:48:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:48:50Z,use_quota=True,user_id='f3a94755efbd42ba8e09fd02eaf50990',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:49:06 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-5f324e1b-8796-45ee-ac91-f17f07b03b12 tempest-VolumeQuotasAdminTestJSON-1873760781 None] Creating volume f0acdac7-179c-4d17-94e6-9457141e0897 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:49:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-5f324e1b-8796-45ee-ac91-f17f07b03b12 tempest-VolumeQuotasAdminTestJSON-1873760781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:49:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-5f324e1b-8796-45ee-ac91-f17f07b03b12 tempest-VolumeQuotasAdminTestJSON-1873760781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:49:06 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-5f324e1b-8796-45ee-ac91-f17f07b03b12 tempest-VolumeQuotasAdminTestJSON-1873760781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:49:06 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-5f324e1b-8796-45ee-ac91-f17f07b03b12 tempest-VolumeQuotasAdminTestJSON-1873760781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:49:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-5f324e1b-8796-45ee-ac91-f17f07b03b12 tempest-VolumeQuotasAdminTestJSON-1873760781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:49:06 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-5f324e1b-8796-45ee-ac91-f17f07b03b12 tempest-VolumeQuotasAdminTestJSON-1873760781 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:49:06 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-5f324e1b-8796-45ee-ac91-f17f07b03b12 tempest-VolumeQuotasAdminTestJSON-1873760781 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:49:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-5f324e1b-8796-45ee-ac91-f17f07b03b12 tempest-VolumeQuotasAdminTestJSON-1873760781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f0acdac7-179c-4d17-94e6-9457141e0897 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:06 devstack sudo[98201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f0acdac7-179c-4d17-94e6-9457141e0897 1073741824 Sep 25 11:49:06 devstack sudo[98201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:06 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-afb42d06-376c-4002-8f3f-3c7018a63869 tempest-VolumesCloneTest-1869848950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad02175b-ca69-4ef9-a5c2-edc359b75e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4e3fc9c-c4cd-444f-9010-b71478d214b4', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:49:06 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-afb42d06-376c-4002-8f3f-3c7018a63869 tempest-VolumesCloneTest-1869848950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3507c8f1-4480-4254-bc2e-b0e52a72374e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:49:06 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-afb42d06-376c-4002-8f3f-3c7018a63869 tempest-VolumesCloneTest-1869848950 None] Volume volume-d4e3fc9c-c4cd-444f-9010-b71478d214b4 (d4e3fc9c-c4cd-444f-9010-b71478d214b4): created successfully Sep 25 11:49:06 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-afb42d06-376c-4002-8f3f-3c7018a63869 tempest-VolumesCloneTest-1869848950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3507c8f1-4480-4254-bc2e-b0e52a72374e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:49:06 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-afb42d06-376c-4002-8f3f-3c7018a63869 tempest-VolumesCloneTest-1869848950 None] Flow 'volume_create_manager' (57074302-85f0-4313-bb3d-23db56760cbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:49:06 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-afb42d06-376c-4002-8f3f-3c7018a63869 tempest-VolumesCloneTest-1869848950 None] Created volume successfully. Sep 25 11:49:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-5574b8b9-d5e3-4f71-9b4c-406b4da85a99 tempest-VolumesActionsTest-794756051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:49:07 devstack sudo[98201]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:07 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdceb626-c19e-41f7-955d-3766e74d91da tempest-VolumesGetTest-1984201126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:49:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-5f324e1b-8796-45ee-ac91-f17f07b03b12 tempest-VolumeQuotasAdminTestJSON-1873760781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f0acdac7-179c-4d17-94e6-9457141e0897 1073741824" returned: 0 in 0.814s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:07 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cdceb626-c19e-41f7-955d-3766e74d91da tempest-VolumesGetTest-1984201126 None] Flow 'volume_create_manager' (cf75101d-5ea9-4b07-97e3-ef464575e91d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:49:07 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cdceb626-c19e-41f7-955d-3766e74d91da tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a41ecc28-0893-453f-b7c1-680f99bfc0b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:49:07 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cdceb626-c19e-41f7-955d-3766e74d91da tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a41ecc28-0893-453f-b7c1-680f99bfc0b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:49:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-178013770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af6c9c54-3776-4200-93bc-2a8b4f0b7ed0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1f6a1c00cee34650b3106442f2443249',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:49:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=c6a05b7d-2488-4b77-9202-0018e6006417,status='creating',terminated_at=None,updated_at=2026-09-25T09:49:07Z,use_quota=True,user_id='0b750a9ac0d643ab979b6125b2297eb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:49:07 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cdceb626-c19e-41f7-955d-3766e74d91da tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a46321e7-0e14-4245-a627-b3864d3ce1f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:49:07 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cdceb626-c19e-41f7-955d-3766e74d91da tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a46321e7-0e14-4245-a627-b3864d3ce1f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:49:07 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cdceb626-c19e-41f7-955d-3766e74d91da tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47a9c8fb-8376-44f1-898a-0ed0dea58177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:49:07 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cdceb626-c19e-41f7-955d-3766e74d91da tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47a9c8fb-8376-44f1-898a-0ed0dea58177) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'af6c9c54-3776-4200-93bc-2a8b4f0b7ed0', 'volume_name': 'volume-af6c9c54-3776-4200-93bc-2a8b4f0b7ed0', 'volume_size': 1, 'source_volid': 'c6a05b7d-2488-4b77-9202-0018e6006417', 'source_volstatus': 'available'}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:49:07 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cdceb626-c19e-41f7-955d-3766e74d91da tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (831c5761-8a08-44f8-af5e-b9a2bc53b2e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:49:07 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cdceb626-c19e-41f7-955d-3766e74d91da tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (831c5761-8a08-44f8-af5e-b9a2bc53b2e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:49:07 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cdceb626-c19e-41f7-955d-3766e74d91da tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0217a672-928a-4c93-b9b5-1cca79ac258c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:49:07 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-cdceb626-c19e-41f7-955d-3766e74d91da tempest-VolumesGetTest-1984201126 None] Volume af6c9c54-3776-4200-93bc-2a8b4f0b7ed0: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-af6c9c54-3776-4200-93bc-2a8b4f0b7ed0', 'volume_size': 1, 'source_volid': 'c6a05b7d-2488-4b77-9202-0018e6006417', 'source_volstatus': 'available'} Sep 25 11:49:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-5f324e1b-8796-45ee-ac91-f17f07b03b12 tempest-VolumeQuotasAdminTestJSON-1873760781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f0acdac7-179c-4d17-94e6-9457141e0897 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-cdceb626-c19e-41f7-955d-3766e74d91da tempest-VolumesGetTest-1984201126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:49:07 devstack sudo[98206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f0acdac7-179c-4d17-94e6-9457141e0897 Sep 25 11:49:07 devstack sudo[98206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:07 devstack sudo[98206]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-5f324e1b-8796-45ee-ac91-f17f07b03b12 tempest-VolumeQuotasAdminTestJSON-1873760781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f0acdac7-179c-4d17-94e6-9457141e0897" returned: 0 in 0.317s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:07 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-5f324e1b-8796-45ee-ac91-f17f07b03b12 tempest-VolumeQuotasAdminTestJSON-1873760781 None] <== create_volume: return (1279ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:49:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-5f324e1b-8796-45ee-ac91-f17f07b03b12 tempest-VolumeQuotasAdminTestJSON-1873760781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.282s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:49:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-5574b8b9-d5e3-4f71-9b4c-406b4da85a99 tempest-VolumesActionsTest-794756051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.013s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:49:07 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-5f324e1b-8796-45ee-ac91-f17f07b03b12 tempest-VolumeQuotasAdminTestJSON-1873760781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afb6322f-19c9-4484-968c-b49b45db5e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0acdac7-179c-4d17-94e6-9457141e0897', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:49:07 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-5f324e1b-8796-45ee-ac91-f17f07b03b12 tempest-VolumeQuotasAdminTestJSON-1873760781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3431adee-2bb3-4592-a099-f6342f4e5aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:49:07 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4dc221-3bd2-48f1-a794-66c28a672c8c]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:49:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-5574b8b9-d5e3-4f71-9b4c-406b4da85a99 tempest-VolumesActionsTest-794756051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a630d61-19c6-487b-abd2-6c3a21b3d7fe {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:07 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-5f324e1b-8796-45ee-ac91-f17f07b03b12 tempest-VolumeQuotasAdminTestJSON-1873760781 None] Volume volume-f0acdac7-179c-4d17-94e6-9457141e0897 (f0acdac7-179c-4d17-94e6-9457141e0897): created successfully Sep 25 11:49:07 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-5f324e1b-8796-45ee-ac91-f17f07b03b12 tempest-VolumeQuotasAdminTestJSON-1873760781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3431adee-2bb3-4592-a099-f6342f4e5aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:49:07 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-5f324e1b-8796-45ee-ac91-f17f07b03b12 tempest-VolumeQuotasAdminTestJSON-1873760781 None] Flow 'volume_create_manager' (d73dfc63-a38b-46f6-bdb2-baf3c78ddee7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:49:08 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-5f324e1b-8796-45ee-ac91-f17f07b03b12 tempest-VolumeQuotasAdminTestJSON-1873760781 None] Created volume successfully. Sep 25 11:49:08 devstack sudo[98209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a630d61-19c6-487b-abd2-6c3a21b3d7fe Sep 25 11:49:08 devstack sudo[98209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:08 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc28c4c4-7c0d-4ec9-9e21-11e47efbde52 tempest-VolumesCloneTest-1869848950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:49:08 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-bc28c4c4-7c0d-4ec9-9e21-11e47efbde52 tempest-VolumesCloneTest-1869848950 None] Flow 'volume_create_manager' (bfeead75-8e3b-448a-b983-934684ebe123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:49:08 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-bc28c4c4-7c0d-4ec9-9e21-11e47efbde52 tempest-VolumesCloneTest-1869848950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c11e586b-f428-4059-a1e0-eb77b709cc29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:49:08 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-bc28c4c4-7c0d-4ec9-9e21-11e47efbde52 tempest-VolumesCloneTest-1869848950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c11e586b-f428-4059-a1e0-eb77b709cc29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:49:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-988759876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e37b0e85-8d94-4d64-bc7a-e8cc4ca2175e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63fea6c99966410ab0916c802a95c0a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:49:08Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=d4e3fc9c-c4cd-444f-9010-b71478d214b4,status='creating',terminated_at=None,updated_at=2026-09-25T09:49:08Z,use_quota=True,user_id='4ceca8203a914493a1b1ed3000993cab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:49:08 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-bc28c4c4-7c0d-4ec9-9e21-11e47efbde52 tempest-VolumesCloneTest-1869848950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd8beaa1-8eb3-4141-a566-45674cc3c12d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:49:08 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-bc28c4c4-7c0d-4ec9-9e21-11e47efbde52 tempest-VolumesCloneTest-1869848950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd8beaa1-8eb3-4141-a566-45674cc3c12d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:49:08 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-bc28c4c4-7c0d-4ec9-9e21-11e47efbde52 tempest-VolumesCloneTest-1869848950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0017f043-92c1-412c-9591-ae8c8be33228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:49:08 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-cb81852c-e0a7-4222-ba6f-8116ee49c241 tempest-VolumeQuotasAdminTestJSON-1873760781 None] Acquiring lock "cinder-f0acdac7-179c-4d17-94e6-9457141e0897-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:49:08 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-bc28c4c4-7c0d-4ec9-9e21-11e47efbde52 tempest-VolumesCloneTest-1869848950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0017f043-92c1-412c-9591-ae8c8be33228) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'e37b0e85-8d94-4d64-bc7a-e8cc4ca2175e', 'volume_name': 'volume-e37b0e85-8d94-4d64-bc7a-e8cc4ca2175e', 'volume_size': 2, 'source_volid': 'd4e3fc9c-c4cd-444f-9010-b71478d214b4', 'source_volstatus': 'available'}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:49:08 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-bc28c4c4-7c0d-4ec9-9e21-11e47efbde52 tempest-VolumesCloneTest-1869848950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccc8373d-a9aa-43f4-9390-c3b9e49985a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:49:08 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-bc28c4c4-7c0d-4ec9-9e21-11e47efbde52 tempest-VolumesCloneTest-1869848950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccc8373d-a9aa-43f4-9390-c3b9e49985a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:49:08 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-bc28c4c4-7c0d-4ec9-9e21-11e47efbde52 tempest-VolumesCloneTest-1869848950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d602690c-e1de-47ae-baf9-8445adafdf05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:49:08 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-bc28c4c4-7c0d-4ec9-9e21-11e47efbde52 tempest-VolumesCloneTest-1869848950 None] Volume e37b0e85-8d94-4d64-bc7a-e8cc4ca2175e: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-e37b0e85-8d94-4d64-bc7a-e8cc4ca2175e', 'volume_size': 2, 'source_volid': 'd4e3fc9c-c4cd-444f-9010-b71478d214b4', 'source_volstatus': 'available'} Sep 25 11:49:08 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-cb81852c-e0a7-4222-ba6f-8116ee49c241 tempest-VolumeQuotasAdminTestJSON-1873760781 None] Lock "cinder-f0acdac7-179c-4d17-94e6-9457141e0897-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:49:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-bc28c4c4-7c0d-4ec9-9e21-11e47efbde52 tempest-VolumesCloneTest-1869848950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:49:08 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-cb81852c-e0a7-4222-ba6f-8116ee49c241 tempest-VolumeQuotasAdminTestJSON-1873760781 None] Acquiring lock "cinder-quobyte-f0acdac7-179c-4d17-94e6-9457141e0897" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:49:08 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-cb81852c-e0a7-4222-ba6f-8116ee49c241 tempest-VolumeQuotasAdminTestJSON-1873760781 None] Lock "cinder-quobyte-f0acdac7-179c-4d17-94e6-9457141e0897" acquired by "delete_volume" :: waited 0.020s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:49:08 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a0a305e-691e-4b6c-9d23-454685ac760f]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:49:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cb81852c-e0a7-4222-ba6f-8116ee49c241 tempest-VolumeQuotasAdminTestJSON-1873760781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f0acdac7-179c-4d17-94e6-9457141e0897 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:08 devstack sudo[98209]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-5574b8b9-d5e3-4f71-9b4c-406b4da85a99 tempest-VolumesActionsTest-794756051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a630d61-19c6-487b-abd2-6c3a21b3d7fe" returned: 0 in 0.517s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:08 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[706e6b8f-7488-421d-8202-c9beab99f5d7]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:49:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-5574b8b9-d5e3-4f71-9b4c-406b4da85a99 tempest-VolumesActionsTest-794756051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a630d61-19c6-487b-abd2-6c3a21b3d7fe {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:08 devstack sudo[98214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f0acdac7-179c-4d17-94e6-9457141e0897 Sep 25 11:49:08 devstack sudo[98214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:08 devstack sudo[98215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a630d61-19c6-487b-abd2-6c3a21b3d7fe Sep 25 11:49:08 devstack sudo[98215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:08 devstack sudo[98214]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cb81852c-e0a7-4222-ba6f-8116ee49c241 tempest-VolumeQuotasAdminTestJSON-1873760781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f0acdac7-179c-4d17-94e6-9457141e0897" returned: 0 in 0.388s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cb81852c-e0a7-4222-ba6f-8116ee49c241 tempest-VolumeQuotasAdminTestJSON-1873760781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f0acdac7-179c-4d17-94e6-9457141e0897 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:08 devstack sudo[98221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f0acdac7-179c-4d17-94e6-9457141e0897 Sep 25 11:49:08 devstack sudo[98221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:08 devstack sudo[98215]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-5574b8b9-d5e3-4f71-9b4c-406b4da85a99 tempest-VolumesActionsTest-794756051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a630d61-19c6-487b-abd2-6c3a21b3d7fe" returned: 0 in 0.521s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-5574b8b9-d5e3-4f71-9b4c-406b4da85a99 tempest-VolumesActionsTest-794756051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a630d61-19c6-487b-abd2-6c3a21b3d7fe /opt/stack/data/cinder/conversion/1a630d61-19c6-487b-abd2-6c3a21b3d7fe.temp_image.ac980639-d21c-43a4-ac22-c01836007851buwax8vg.img {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:09 devstack sudo[98226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a630d61-19c6-487b-abd2-6c3a21b3d7fe /opt/stack/data/cinder/conversion/1a630d61-19c6-487b-abd2-6c3a21b3d7fe.temp_image.ac980639-d21c-43a4-ac22-c01836007851buwax8vg.img Sep 25 11:49:09 devstack sudo[98226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:09 devstack sudo[98221]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cb81852c-e0a7-4222-ba6f-8116ee49c241 tempest-VolumeQuotasAdminTestJSON-1873760781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f0acdac7-179c-4d17-94e6-9457141e0897" returned: 0 in 0.414s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:09 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-cb81852c-e0a7-4222-ba6f-8116ee49c241 tempest-VolumeQuotasAdminTestJSON-1873760781 None] Lock "cinder-quobyte-f0acdac7-179c-4d17-94e6-9457141e0897" released by "delete_volume" :: held 0.878s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:49:10 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-cb81852c-e0a7-4222-ba6f-8116ee49c241 tempest-VolumeQuotasAdminTestJSON-1873760781 None] Created reservations ['2cb2fe4e-8d42-402d-b1ef-6778e2ec470b', '5ce47079-636c-40ef-8388-c97d051353d3', '6cde4ed1-f9dd-4377-8957-9f2fd53d41e1', '9e67d81b-42b8-4791-92cf-535912dc185c'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:49:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-cb81852c-e0a7-4222-ba6f-8116ee49c241 tempest-VolumeQuotasAdminTestJSON-1873760781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:49:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-cb81852c-e0a7-4222-ba6f-8116ee49c241 tempest-VolumeQuotasAdminTestJSON-1873760781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:49:10 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-cb81852c-e0a7-4222-ba6f-8116ee49c241 tempest-VolumeQuotasAdminTestJSON-1873760781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:49:10 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-cb81852c-e0a7-4222-ba6f-8116ee49c241 tempest-VolumeQuotasAdminTestJSON-1873760781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:49:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-cb81852c-e0a7-4222-ba6f-8116ee49c241 tempest-VolumeQuotasAdminTestJSON-1873760781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:49:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cb81852c-e0a7-4222-ba6f-8116ee49c241 tempest-VolumeQuotasAdminTestJSON-1873760781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:10 devstack sudo[98239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:49:10 devstack sudo[98239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:11 devstack sudo[98239]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cb81852c-e0a7-4222-ba6f-8116ee49c241 tempest-VolumeQuotasAdminTestJSON-1873760781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.611s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:11 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-cb81852c-e0a7-4222-ba6f-8116ee49c241 tempest-VolumeQuotasAdminTestJSON-1873760781 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:49:11 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-cb81852c-e0a7-4222-ba6f-8116ee49c241 tempest-VolumeQuotasAdminTestJSON-1873760781 None] Deleted volume successfully. Sep 25 11:49:11 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-cb81852c-e0a7-4222-ba6f-8116ee49c241 tempest-VolumeQuotasAdminTestJSON-1873760781 None] Lock "cinder-f0acdac7-179c-4d17-94e6-9457141e0897-delete_volume" released by "delete_volume" :: held 2.884s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:49:11 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-8df7283a-ef64-447f-b22b-301d0232965f tempest-VolumeQuotasAdminTestJSON-1873760781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:49:11 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8df7283a-ef64-447f-b22b-301d0232965f tempest-VolumeQuotasAdminTestJSON-1873760781 None] Flow 'volume_create_manager' (268da360-2e2e-49d3-adca-0dd55dd63171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:49:11 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8df7283a-ef64-447f-b22b-301d0232965f tempest-VolumeQuotasAdminTestJSON-1873760781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dce38b51-1685-4bd5-b2a1-c2340242208f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:49:11 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8df7283a-ef64-447f-b22b-301d0232965f tempest-VolumeQuotasAdminTestJSON-1873760781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dce38b51-1685-4bd5-b2a1-c2340242208f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:49:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-862418557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87a24e90-fb7c-4805-ae65-71e0a9aab9aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6c60536389d4c54af025549eb2f6a3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:49:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:49:12Z,use_quota=True,user_id='f3a94755efbd42ba8e09fd02eaf50990',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:49:11 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8df7283a-ef64-447f-b22b-301d0232965f tempest-VolumeQuotasAdminTestJSON-1873760781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59ef05e4-27dc-4b96-a205-ff0ee095ecca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:49:11 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8df7283a-ef64-447f-b22b-301d0232965f tempest-VolumeQuotasAdminTestJSON-1873760781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59ef05e4-27dc-4b96-a205-ff0ee095ecca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:49:11 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8df7283a-ef64-447f-b22b-301d0232965f tempest-VolumeQuotasAdminTestJSON-1873760781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (210c6fa5-8ecd-4517-9da0-c294eeebc741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:49:11 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8df7283a-ef64-447f-b22b-301d0232965f tempest-VolumeQuotasAdminTestJSON-1873760781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (210c6fa5-8ecd-4517-9da0-c294eeebc741) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87a24e90-fb7c-4805-ae65-71e0a9aab9aa', 'volume_name': 'volume-87a24e90-fb7c-4805-ae65-71e0a9aab9aa', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:49:11 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8df7283a-ef64-447f-b22b-301d0232965f tempest-VolumeQuotasAdminTestJSON-1873760781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8127c36-53f5-40f0-8e5d-32ed99f7439b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:49:11 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8df7283a-ef64-447f-b22b-301d0232965f tempest-VolumeQuotasAdminTestJSON-1873760781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8127c36-53f5-40f0-8e5d-32ed99f7439b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:49:11 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8df7283a-ef64-447f-b22b-301d0232965f tempest-VolumeQuotasAdminTestJSON-1873760781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a54f705-41c7-4627-95c5-9bb237b65646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:49:11 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-8df7283a-ef64-447f-b22b-301d0232965f tempest-VolumeQuotasAdminTestJSON-1873760781 None] Volume 87a24e90-fb7c-4805-ae65-71e0a9aab9aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87a24e90-fb7c-4805-ae65-71e0a9aab9aa', 'volume_size': 1} Sep 25 11:49:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-8df7283a-ef64-447f-b22b-301d0232965f tempest-VolumeQuotasAdminTestJSON-1873760781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:49:16 devstack sudo[98226]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:16 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-5574b8b9-d5e3-4f71-9b4c-406b4da85a99 tempest-VolumesActionsTest-794756051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a630d61-19c6-487b-abd2-6c3a21b3d7fe /opt/stack/data/cinder/conversion/1a630d61-19c6-487b-abd2-6c3a21b3d7fe.temp_image.ac980639-d21c-43a4-ac22-c01836007851buwax8vg.img" returned: 0 in 7.680s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:16 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a42a35-a541-476f-9c66-c0bb95be161e]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:49:16 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-5574b8b9-d5e3-4f71-9b4c-406b4da85a99 tempest-VolumesActionsTest-794756051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a630d61-19c6-487b-abd2-6c3a21b3d7fe {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:16 devstack sudo[98244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a630d61-19c6-487b-abd2-6c3a21b3d7fe Sep 25 11:49:16 devstack sudo[98244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:17 devstack sudo[98244]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:17 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-5574b8b9-d5e3-4f71-9b4c-406b4da85a99 tempest-VolumesActionsTest-794756051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a630d61-19c6-487b-abd2-6c3a21b3d7fe" returned: 0 in 0.668s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:17 devstack cinder-volume[86984]: DEBUG cinder.image.image_utils [None req-5574b8b9-d5e3-4f71-9b4c-406b4da85a99 tempest-VolumesActionsTest-794756051 None] Image conversion details: src /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a630d61-19c6-487b-abd2-6c3a21b3d7fe, size 1024.00 MB, duration 7.68 sec, destination /opt/stack/data/cinder/conversion/1a630d61-19c6-487b-abd2-6c3a21b3d7fe.temp_image.ac980639-d21c-43a4-ac22-c01836007851buwax8vg.img {{(pid=86984) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 11:49:17 devstack cinder-volume[86984]: INFO cinder.image.image_utils [None req-5574b8b9-d5e3-4f71-9b4c-406b4da85a99 tempest-VolumesActionsTest-794756051 None] Converted 1024.00 MB image at 133.30 MB/s Sep 25 11:49:17 devstack cinder-volume[86984]: DEBUG cinder.image.image_utils [None req-5574b8b9-d5e3-4f71-9b4c-406b4da85a99 tempest-VolumesActionsTest-794756051 None] ac980639-d21c-43a4-ac22-c01836007851 was raw, converting to qcow2 {{(pid=86984) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Sep 25 11:49:17 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[668e2f74-5c26-45aa-b4b7-da55bdbfde34]: (4, 'raw') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:49:17 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-5574b8b9-d5e3-4f71-9b4c-406b4da85a99 tempest-VolumesActionsTest-794756051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/1a630d61-19c6-487b-abd2-6c3a21b3d7fe.temp_image.ac980639-d21c-43a4-ac22-c01836007851buwax8vg.img {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:17 devstack sudo[98251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/1a630d61-19c6-487b-abd2-6c3a21b3d7fe.temp_image.ac980639-d21c-43a4-ac22-c01836007851buwax8vg.img Sep 25 11:49:17 devstack sudo[98251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:17 devstack sudo[98251]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:17 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-5574b8b9-d5e3-4f71-9b4c-406b4da85a99 tempest-VolumesActionsTest-794756051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/1a630d61-19c6-487b-abd2-6c3a21b3d7fe.temp_image.ac980639-d21c-43a4-ac22-c01836007851buwax8vg.img" returned: 0 in 0.389s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:17 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-5574b8b9-d5e3-4f71-9b4c-406b4da85a99 tempest-VolumesActionsTest-794756051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/1a630d61-19c6-487b-abd2-6c3a21b3d7fe.temp_image.ac980639-d21c-43a4-ac22-c01836007851buwax8vg.img {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:17 devstack sudo[98255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/1a630d61-19c6-487b-abd2-6c3a21b3d7fe.temp_image.ac980639-d21c-43a4-ac22-c01836007851buwax8vg.img Sep 25 11:49:17 devstack sudo[98255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:18 devstack sudo[98255]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-5574b8b9-d5e3-4f71-9b4c-406b4da85a99 tempest-VolumesActionsTest-794756051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/1a630d61-19c6-487b-abd2-6c3a21b3d7fe.temp_image.ac980639-d21c-43a4-ac22-c01836007851buwax8vg.img" returned: 1 in 0.436s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-5574b8b9-d5e3-4f71-9b4c-406b4da85a99 tempest-VolumesActionsTest-794756051 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/1a630d61-19c6-487b-abd2-6c3a21b3d7fe.temp_image.ac980639-d21c-43a4-ac22-c01836007851buwax8vg.img' failed. Not Retrying. {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 11:49:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-5574b8b9-d5e3-4f71-9b4c-406b4da85a99 tempest-VolumesActionsTest-794756051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/1a630d61-19c6-487b-abd2-6c3a21b3d7fe.temp_image.ac980639-d21c-43a4-ac22-c01836007851buwax8vg.img /opt/stack/data/cinder/conversion/vol_upload_zkhcb9i1 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:18 devstack sudo[98260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/1a630d61-19c6-487b-abd2-6c3a21b3d7fe.temp_image.ac980639-d21c-43a4-ac22-c01836007851buwax8vg.img /opt/stack/data/cinder/conversion/vol_upload_zkhcb9i1 Sep 25 11:49:18 devstack sudo[98260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:18 devstack sudo[98260]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-5574b8b9-d5e3-4f71-9b4c-406b4da85a99 tempest-VolumesActionsTest-794756051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/1a630d61-19c6-487b-abd2-6c3a21b3d7fe.temp_image.ac980639-d21c-43a4-ac22-c01836007851buwax8vg.img /opt/stack/data/cinder/conversion/vol_upload_zkhcb9i1" returned: 0 in 0.401s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:18 devstack cinder-volume[86984]: DEBUG cinder.image.image_utils [None req-5574b8b9-d5e3-4f71-9b4c-406b4da85a99 tempest-VolumesActionsTest-794756051 None] Image conversion details: src /opt/stack/data/cinder/conversion/1a630d61-19c6-487b-abd2-6c3a21b3d7fe.temp_image.ac980639-d21c-43a4-ac22-c01836007851buwax8vg.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_zkhcb9i1 {{(pid=86984) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 11:49:18 devstack cinder-volume[86984]: INFO cinder.image.image_utils [None req-5574b8b9-d5e3-4f71-9b4c-406b4da85a99 tempest-VolumesActionsTest-794756051 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 25 11:49:18 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea723331-7b70-4327-bb45-618f783a0e8c]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:49:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-5574b8b9-d5e3-4f71-9b4c-406b4da85a99 tempest-VolumesActionsTest-794756051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_zkhcb9i1 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:18 devstack sudo[98266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_zkhcb9i1 Sep 25 11:49:18 devstack sudo[98266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:18 devstack sudo[98266]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-5574b8b9-d5e3-4f71-9b4c-406b4da85a99 tempest-VolumesActionsTest-794756051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_zkhcb9i1" returned: 0 in 0.343s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-5574b8b9-d5e3-4f71-9b4c-406b4da85a99 tempest-VolumesActionsTest-794756051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.814s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:49:20 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-5574b8b9-d5e3-4f71-9b4c-406b4da85a99 tempest-VolumesActionsTest-794756051 None] Uploaded volume to glance image-id: ac980639-d21c-43a4-ac22-c01836007851. {{(pid=86984) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 25 11:49:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-cdceb626-c19e-41f7-955d-3766e74d91da tempest-VolumesGetTest-1984201126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 13.131s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:49:20 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-cdceb626-c19e-41f7-955d-3766e74d91da tempest-VolumesGetTest-1984201126 None] Cloning volume c6a05b7d-2488-4b77-9202-0018e6006417 to volume af6c9c54-3776-4200-93bc-2a8b4f0b7ed0 Sep 25 11:49:20 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-5574b8b9-d5e3-4f71-9b4c-406b4da85a99 tempest-VolumesActionsTest-794756051 None] Copy volume to image completed successfully. Sep 25 11:49:20 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-cdceb626-c19e-41f7-955d-3766e74d91da tempest-VolumesGetTest-1984201126 None] Creating offline snapshot 491c9c1f-edca-4066-a3df-e1f0a9ce5366 of volume c6a05b7d-2488-4b77-9202-0018e6006417 {{(pid=86984) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:49:20 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[14617f27-5cf2-40dd-a6b2-376488b9761d]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:49:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cdceb626-c19e-41f7-955d-3766e74d91da tempest-VolumesGetTest-1984201126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c6a05b7d-2488-4b77-9202-0018e6006417 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:20 devstack sudo[98271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c6a05b7d-2488-4b77-9202-0018e6006417 Sep 25 11:49:20 devstack sudo[98271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:21 devstack sudo[98271]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:21 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cdceb626-c19e-41f7-955d-3766e74d91da tempest-VolumesGetTest-1984201126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c6a05b7d-2488-4b77-9202-0018e6006417" returned: 0 in 0.433s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:21 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cdceb626-c19e-41f7-955d-3766e74d91da tempest-VolumesGetTest-1984201126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c6a05b7d-2488-4b77-9202-0018e6006417,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c6a05b7d-2488-4b77-9202-0018e6006417.491c9c1f-edca-4066-a3df-e1f0a9ce5366 1G {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:21 devstack sudo[98276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c6a05b7d-2488-4b77-9202-0018e6006417,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c6a05b7d-2488-4b77-9202-0018e6006417.491c9c1f-edca-4066-a3df-e1f0a9ce5366 1G Sep 25 11:49:21 devstack sudo[98276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:21 devstack sudo[98276]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:21 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cdceb626-c19e-41f7-955d-3766e74d91da tempest-VolumesGetTest-1984201126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c6a05b7d-2488-4b77-9202-0018e6006417,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c6a05b7d-2488-4b77-9202-0018e6006417.491c9c1f-edca-4066-a3df-e1f0a9ce5366 1G" returned: 0 in 0.477s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:21 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cdceb626-c19e-41f7-955d-3766e74d91da tempest-VolumesGetTest-1984201126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6a05b7d-2488-4b77-9202-0018e6006417 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c6a05b7d-2488-4b77-9202-0018e6006417.491c9c1f-edca-4066-a3df-e1f0a9ce5366 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:21 devstack sudo[98282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6a05b7d-2488-4b77-9202-0018e6006417 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c6a05b7d-2488-4b77-9202-0018e6006417.491c9c1f-edca-4066-a3df-e1f0a9ce5366 Sep 25 11:49:21 devstack sudo[98282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:22 devstack sudo[98282]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:22 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cdceb626-c19e-41f7-955d-3766e74d91da tempest-VolumesGetTest-1984201126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6a05b7d-2488-4b77-9202-0018e6006417 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c6a05b7d-2488-4b77-9202-0018e6006417.491c9c1f-edca-4066-a3df-e1f0a9ce5366" returned: 0 in 0.420s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:22 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-cdceb626-c19e-41f7-955d-3766e74d91da tempest-VolumesGetTest-1984201126 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c6a05b7d-2488-4b77-9202-0018e6006417.491c9c1f-edca-4066-a3df-e1f0a9ce5366 is being set with open permissions: ugo+rw Sep 25 11:49:22 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cdceb626-c19e-41f7-955d-3766e74d91da tempest-VolumesGetTest-1984201126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c6a05b7d-2488-4b77-9202-0018e6006417.491c9c1f-edca-4066-a3df-e1f0a9ce5366 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:22 devstack sudo[98287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c6a05b7d-2488-4b77-9202-0018e6006417.491c9c1f-edca-4066-a3df-e1f0a9ce5366 Sep 25 11:49:22 devstack sudo[98287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:22 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-29be6b54-1a62-4a16-a363-6ad1aaac2fc4 tempest-VolumesActionsTest-794756051 None] Acquiring lock "cinder-1a630d61-19c6-487b-abd2-6c3a21b3d7fe-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:49:22 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-29be6b54-1a62-4a16-a363-6ad1aaac2fc4 tempest-VolumesActionsTest-794756051 None] Lock "cinder-1a630d61-19c6-487b-abd2-6c3a21b3d7fe-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:49:22 devstack sudo[98287]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:22 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cdceb626-c19e-41f7-955d-3766e74d91da tempest-VolumesGetTest-1984201126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c6a05b7d-2488-4b77-9202-0018e6006417.491c9c1f-edca-4066-a3df-e1f0a9ce5366" returned: 0 in 0.348s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:22 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-29be6b54-1a62-4a16-a363-6ad1aaac2fc4 tempest-VolumesActionsTest-794756051 None] Acquiring lock "cinder-quobyte-1a630d61-19c6-487b-abd2-6c3a21b3d7fe" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:49:22 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cdceb626-c19e-41f7-955d-3766e74d91da tempest-VolumesGetTest-1984201126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c6a05b7d-2488-4b77-9202-0018e6006417.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:22 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-29be6b54-1a62-4a16-a363-6ad1aaac2fc4 tempest-VolumesActionsTest-794756051 None] Lock "cinder-quobyte-1a630d61-19c6-487b-abd2-6c3a21b3d7fe" acquired by "delete_volume" :: waited 0.041s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:49:22 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51629d6-6047-468c-988e-c69fece5786b]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:49:22 devstack sudo[98290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c6a05b7d-2488-4b77-9202-0018e6006417.info Sep 25 11:49:22 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-29be6b54-1a62-4a16-a363-6ad1aaac2fc4 tempest-VolumesActionsTest-794756051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a630d61-19c6-487b-abd2-6c3a21b3d7fe {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:22 devstack sudo[98290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:22 devstack sudo[98292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a630d61-19c6-487b-abd2-6c3a21b3d7fe Sep 25 11:49:22 devstack sudo[98292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:22 devstack sudo[98290]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:22 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cdceb626-c19e-41f7-955d-3766e74d91da tempest-VolumesGetTest-1984201126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c6a05b7d-2488-4b77-9202-0018e6006417.info" returned: 0 in 0.359s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:22 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-cdceb626-c19e-41f7-955d-3766e74d91da tempest-VolumesGetTest-1984201126 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c6a05b7d-2488-4b77-9202-0018e6006417.info is being set with open permissions: ugo+rw Sep 25 11:49:22 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cdceb626-c19e-41f7-955d-3766e74d91da tempest-VolumesGetTest-1984201126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c6a05b7d-2488-4b77-9202-0018e6006417.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:22 devstack sudo[98295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c6a05b7d-2488-4b77-9202-0018e6006417.info Sep 25 11:49:22 devstack sudo[98295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:23 devstack sudo[98292]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-29be6b54-1a62-4a16-a363-6ad1aaac2fc4 tempest-VolumesActionsTest-794756051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a630d61-19c6-487b-abd2-6c3a21b3d7fe" returned: 0 in 0.437s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-29be6b54-1a62-4a16-a363-6ad1aaac2fc4 tempest-VolumesActionsTest-794756051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a630d61-19c6-487b-abd2-6c3a21b3d7fe {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:23 devstack sudo[98300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a630d61-19c6-487b-abd2-6c3a21b3d7fe Sep 25 11:49:23 devstack sudo[98300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:23 devstack sudo[98295]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cdceb626-c19e-41f7-955d-3766e74d91da tempest-VolumesGetTest-1984201126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c6a05b7d-2488-4b77-9202-0018e6006417.info" returned: 0 in 0.326s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:23 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-cdceb626-c19e-41f7-955d-3766e74d91da tempest-VolumesGetTest-1984201126 None] Acquiring lock "cinder-quobyte-af6c9c54-3776-4200-93bc-2a8b4f0b7ed0" by "_copy_volume_from_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:49:23 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-cdceb626-c19e-41f7-955d-3766e74d91da tempest-VolumesGetTest-1984201126 None] Lock "cinder-quobyte-af6c9c54-3776-4200-93bc-2a8b4f0b7ed0" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:49:23 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-cdceb626-c19e-41f7-955d-3766e74d91da tempest-VolumesGetTest-1984201126 None] snapshot: 491c9c1f-edca-4066-a3df-e1f0a9ce5366, volume: af6c9c54-3776-4200-93bc-2a8b4f0b7ed0, {{(pid=86984) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 11:49:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-cdceb626-c19e-41f7-955d-3766e74d91da tempest-VolumesGetTest-1984201126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:49:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-cdceb626-c19e-41f7-955d-3766e74d91da tempest-VolumesGetTest-1984201126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:49:23 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-cdceb626-c19e-41f7-955d-3766e74d91da tempest-VolumesGetTest-1984201126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:49:23 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-cdceb626-c19e-41f7-955d-3766e74d91da tempest-VolumesGetTest-1984201126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:49:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-cdceb626-c19e-41f7-955d-3766e74d91da tempest-VolumesGetTest-1984201126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:49:23 devstack sudo[98300]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-29be6b54-1a62-4a16-a363-6ad1aaac2fc4 tempest-VolumesActionsTest-794756051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a630d61-19c6-487b-abd2-6c3a21b3d7fe" returned: 0 in 0.304s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:23 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[be810297-5637-4354-8503-3f8e92d27302]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:49:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cdceb626-c19e-41f7-955d-3766e74d91da tempest-VolumesGetTest-1984201126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c6a05b7d-2488-4b77-9202-0018e6006417.491c9c1f-edca-4066-a3df-e1f0a9ce5366 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:23 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-29be6b54-1a62-4a16-a363-6ad1aaac2fc4 tempest-VolumesActionsTest-794756051 None] Lock "cinder-quobyte-1a630d61-19c6-487b-abd2-6c3a21b3d7fe" released by "delete_volume" :: held 0.800s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:49:23 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-29be6b54-1a62-4a16-a363-6ad1aaac2fc4 tempest-VolumesActionsTest-794756051 None] Created reservations ['639febad-9c8d-4831-958b-199bad307ca7', '41fe2536-7382-4f26-bb80-385af0e05c89', 'a6cd4797-eee8-482f-977e-5628f538ee08', '732e4083-d390-4add-83dc-2d6be9b45770'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:49:23 devstack sudo[98305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c6a05b7d-2488-4b77-9202-0018e6006417.491c9c1f-edca-4066-a3df-e1f0a9ce5366 Sep 25 11:49:23 devstack sudo[98305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-29be6b54-1a62-4a16-a363-6ad1aaac2fc4 tempest-VolumesActionsTest-794756051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:49:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-29be6b54-1a62-4a16-a363-6ad1aaac2fc4 tempest-VolumesActionsTest-794756051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:49:23 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-29be6b54-1a62-4a16-a363-6ad1aaac2fc4 tempest-VolumesActionsTest-794756051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:49:23 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-29be6b54-1a62-4a16-a363-6ad1aaac2fc4 tempest-VolumesActionsTest-794756051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:49:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-29be6b54-1a62-4a16-a363-6ad1aaac2fc4 tempest-VolumesActionsTest-794756051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:49:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-29be6b54-1a62-4a16-a363-6ad1aaac2fc4 tempest-VolumesActionsTest-794756051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:23 devstack sudo[98307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:49:23 devstack sudo[98307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:23 devstack sudo[98307]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-29be6b54-1a62-4a16-a363-6ad1aaac2fc4 tempest-VolumesActionsTest-794756051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.304s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:23 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-29be6b54-1a62-4a16-a363-6ad1aaac2fc4 tempest-VolumesActionsTest-794756051 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:49:23 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-29be6b54-1a62-4a16-a363-6ad1aaac2fc4 tempest-VolumesActionsTest-794756051 None] Deleted volume successfully. Sep 25 11:49:23 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-29be6b54-1a62-4a16-a363-6ad1aaac2fc4 tempest-VolumesActionsTest-794756051 None] Lock "cinder-1a630d61-19c6-487b-abd2-6c3a21b3d7fe-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:49:23 devstack sudo[98305]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cdceb626-c19e-41f7-955d-3766e74d91da tempest-VolumesGetTest-1984201126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c6a05b7d-2488-4b77-9202-0018e6006417.491c9c1f-edca-4066-a3df-e1f0a9ce5366" returned: 0 in 0.613s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:23 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-cdceb626-c19e-41f7-955d-3766e74d91da tempest-VolumesGetTest-1984201126 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6a05b7d-2488-4b77-9202-0018e6006417(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86984) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:49:23 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc980841-86e3-4288-a629-3b4c289d0710]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:49:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cdceb626-c19e-41f7-955d-3766e74d91da tempest-VolumesGetTest-1984201126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c6a05b7d-2488-4b77-9202-0018e6006417 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:24 devstack sudo[98313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c6a05b7d-2488-4b77-9202-0018e6006417 Sep 25 11:49:24 devstack sudo[98313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:24 devstack sudo[98313]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:24 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cdceb626-c19e-41f7-955d-3766e74d91da tempest-VolumesGetTest-1984201126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c6a05b7d-2488-4b77-9202-0018e6006417" returned: 0 in 0.500s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:24 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-cdceb626-c19e-41f7-955d-3766e74d91da tempest-VolumesGetTest-1984201126 None] will copy from snapshot at /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c6a05b7d-2488-4b77-9202-0018e6006417 {{(pid=86984) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 11:49:24 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-cdceb626-c19e-41f7-955d-3766e74d91da tempest-VolumesGetTest-1984201126 None] Creating direct copy from snapshot {{(pid=86984) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 11:49:24 devstack cinder-volume[86984]: DEBUG cinder.utils [None req-cdceb626-c19e-41f7-955d-3766e74d91da tempest-VolumesGetTest-1984201126 None] Path /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-af6c9c54-3776-4200-93bc-2a8b4f0b7ed0 not found in is_blk_device check {{(pid=86984) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 11:49:24 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cdceb626-c19e-41f7-955d-3766e74d91da tempest-VolumesGetTest-1984201126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c6a05b7d-2488-4b77-9202-0018e6006417 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-af6c9c54-3776-4200-93bc-2a8b4f0b7ed0 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:24 devstack sudo[98319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c6a05b7d-2488-4b77-9202-0018e6006417 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-af6c9c54-3776-4200-93bc-2a8b4f0b7ed0 Sep 25 11:49:24 devstack sudo[98319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:33 devstack cinder-volume[86984]: DEBUG dbcounter [-] [86984] Writing DB stats cinder:SELECT=19,cinder:UPDATE=27,cinder:INSERT=5,cinder:DELETE=2 {{(pid=86984) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:49:33 devstack sudo[98319]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:33 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cdceb626-c19e-41f7-955d-3766e74d91da tempest-VolumesGetTest-1984201126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c6a05b7d-2488-4b77-9202-0018e6006417 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-af6c9c54-3776-4200-93bc-2a8b4f0b7ed0" returned: 0 in 9.313s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:33 devstack cinder-volume[86984]: DEBUG cinder.image.image_utils [None req-cdceb626-c19e-41f7-955d-3766e74d91da tempest-VolumesGetTest-1984201126 None] Image conversion details: src /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c6a05b7d-2488-4b77-9202-0018e6006417, size 1024.00 MB, duration 9.31 sec, destination /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-af6c9c54-3776-4200-93bc-2a8b4f0b7ed0 {{(pid=86984) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 11:49:33 devstack cinder-volume[86984]: INFO cinder.image.image_utils [None req-cdceb626-c19e-41f7-955d-3766e74d91da tempest-VolumesGetTest-1984201126 None] Converted 1024.00 MB image at 109.94 MB/s Sep 25 11:49:33 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-cdceb626-c19e-41f7-955d-3766e74d91da tempest-VolumesGetTest-1984201126 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-af6c9c54-3776-4200-93bc-2a8b4f0b7ed0 is being set with open permissions: ugo+rw Sep 25 11:49:33 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cdceb626-c19e-41f7-955d-3766e74d91da tempest-VolumesGetTest-1984201126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-af6c9c54-3776-4200-93bc-2a8b4f0b7ed0 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:33 devstack sudo[98339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-af6c9c54-3776-4200-93bc-2a8b4f0b7ed0 Sep 25 11:49:33 devstack sudo[98339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:33 devstack cinder-volume[86984]: DEBUG dbcounter [-] [86984] Writing DB stats cinder:SELECT=26,cinder:INSERT=8,cinder:UPDATE=26,cinder:DELETE=3 {{(pid=86984) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:49:34 devstack sudo[98339]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:34 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cdceb626-c19e-41f7-955d-3766e74d91da tempest-VolumesGetTest-1984201126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-af6c9c54-3776-4200-93bc-2a8b4f0b7ed0" returned: 0 in 0.320s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:34 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-cdceb626-c19e-41f7-955d-3766e74d91da tempest-VolumesGetTest-1984201126 None] Lock "cinder-quobyte-af6c9c54-3776-4200-93bc-2a8b4f0b7ed0" released by "_copy_volume_from_snapshot" :: held 10.845s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:49:34 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-cdceb626-c19e-41f7-955d-3766e74d91da tempest-VolumesGetTest-1984201126 None] Acquiring lock "cinder-quobyte-491c9c1f-edca-4066-a3df-e1f0a9ce5366" by "_delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:49:34 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-cdceb626-c19e-41f7-955d-3766e74d91da tempest-VolumesGetTest-1984201126 None] Lock "cinder-quobyte-491c9c1f-edca-4066-a3df-e1f0a9ce5366" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:49:34 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-cdceb626-c19e-41f7-955d-3766e74d91da tempest-VolumesGetTest-1984201126 None] Deleting offline snapshot 491c9c1f-edca-4066-a3df-e1f0a9ce5366 of volume c6a05b7d-2488-4b77-9202-0018e6006417 {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:49:34 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-cdceb626-c19e-41f7-955d-3766e74d91da tempest-VolumesGetTest-1984201126 None] snapshot_file for this snap is: volume-c6a05b7d-2488-4b77-9202-0018e6006417.491c9c1f-edca-4066-a3df-e1f0a9ce5366 {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:49:34 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aec9457-db59-463c-a566-83d83c4630f3]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:49:34 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cdceb626-c19e-41f7-955d-3766e74d91da tempest-VolumesGetTest-1984201126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c6a05b7d-2488-4b77-9202-0018e6006417.491c9c1f-edca-4066-a3df-e1f0a9ce5366 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:34 devstack sudo[98342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c6a05b7d-2488-4b77-9202-0018e6006417.491c9c1f-edca-4066-a3df-e1f0a9ce5366 Sep 25 11:49:34 devstack sudo[98342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:34 devstack sudo[98342]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:34 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cdceb626-c19e-41f7-955d-3766e74d91da tempest-VolumesGetTest-1984201126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c6a05b7d-2488-4b77-9202-0018e6006417.491c9c1f-edca-4066-a3df-e1f0a9ce5366" returned: 0 in 0.657s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:34 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-cdceb626-c19e-41f7-955d-3766e74d91da tempest-VolumesGetTest-1984201126 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6a05b7d-2488-4b77-9202-0018e6006417(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86984) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:49:34 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc619f4-68bf-408e-bce4-9f9ff7129818]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:49:34 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cdceb626-c19e-41f7-955d-3766e74d91da tempest-VolumesGetTest-1984201126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c6a05b7d-2488-4b77-9202-0018e6006417 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:35 devstack sudo[98347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c6a05b7d-2488-4b77-9202-0018e6006417 Sep 25 11:49:35 devstack sudo[98347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:35 devstack sudo[98347]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:35 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cdceb626-c19e-41f7-955d-3766e74d91da tempest-VolumesGetTest-1984201126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c6a05b7d-2488-4b77-9202-0018e6006417" returned: 0 in 0.718s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:35 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cdceb626-c19e-41f7-955d-3766e74d91da tempest-VolumesGetTest-1984201126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c6a05b7d-2488-4b77-9202-0018e6006417.491c9c1f-edca-4066-a3df-e1f0a9ce5366 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:35 devstack sudo[98352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c6a05b7d-2488-4b77-9202-0018e6006417.491c9c1f-edca-4066-a3df-e1f0a9ce5366 Sep 25 11:49:35 devstack sudo[98352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:36 devstack sudo[98352]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:36 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cdceb626-c19e-41f7-955d-3766e74d91da tempest-VolumesGetTest-1984201126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c6a05b7d-2488-4b77-9202-0018e6006417.491c9c1f-edca-4066-a3df-e1f0a9ce5366" returned: 0 in 0.472s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:36 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cdceb626-c19e-41f7-955d-3766e74d91da tempest-VolumesGetTest-1984201126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c6a05b7d-2488-4b77-9202-0018e6006417.491c9c1f-edca-4066-a3df-e1f0a9ce5366 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:36 devstack sudo[98357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c6a05b7d-2488-4b77-9202-0018e6006417.491c9c1f-edca-4066-a3df-e1f0a9ce5366 Sep 25 11:49:36 devstack sudo[98357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:36 devstack sudo[98357]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:36 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cdceb626-c19e-41f7-955d-3766e74d91da tempest-VolumesGetTest-1984201126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c6a05b7d-2488-4b77-9202-0018e6006417.491c9c1f-edca-4066-a3df-e1f0a9ce5366" returned: 0 in 0.372s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:36 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-cdceb626-c19e-41f7-955d-3766e74d91da tempest-VolumesGetTest-1984201126 None] Lock "cinder-quobyte-491c9c1f-edca-4066-a3df-e1f0a9ce5366" released by "_delete_snapshot" :: held 2.394s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:49:36 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-cdceb626-c19e-41f7-955d-3766e74d91da tempest-VolumesGetTest-1984201126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.902s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:49:36 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-bc28c4c4-7c0d-4ec9-9e21-11e47efbde52 tempest-VolumesCloneTest-1869848950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 28.290s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:49:36 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-bc28c4c4-7c0d-4ec9-9e21-11e47efbde52 tempest-VolumesCloneTest-1869848950 None] Cloning volume d4e3fc9c-c4cd-444f-9010-b71478d214b4 to volume e37b0e85-8d94-4d64-bc7a-e8cc4ca2175e Sep 25 11:49:36 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cdceb626-c19e-41f7-955d-3766e74d91da tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0217a672-928a-4c93-b9b5-1cca79ac258c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af6c9c54-3776-4200-93bc-2a8b4f0b7ed0', 'volume_size': 1, 'source_volid': 'c6a05b7d-2488-4b77-9202-0018e6006417', 'source_volstatus': 'available'}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:49:36 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cdceb626-c19e-41f7-955d-3766e74d91da tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9d71739-8a02-432e-af94-8e9a3fa7cd6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:49:36 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-cdceb626-c19e-41f7-955d-3766e74d91da tempest-VolumesGetTest-1984201126 None] Volume volume-af6c9c54-3776-4200-93bc-2a8b4f0b7ed0 (af6c9c54-3776-4200-93bc-2a8b4f0b7ed0): created successfully Sep 25 11:49:36 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cdceb626-c19e-41f7-955d-3766e74d91da tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9d71739-8a02-432e-af94-8e9a3fa7cd6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:49:36 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cdceb626-c19e-41f7-955d-3766e74d91da tempest-VolumesGetTest-1984201126 None] Flow 'volume_create_manager' (cf75101d-5ea9-4b07-97e3-ef464575e91d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:49:36 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-bc28c4c4-7c0d-4ec9-9e21-11e47efbde52 tempest-VolumesCloneTest-1869848950 None] Creating offline snapshot 473e1578-b840-475c-a8a5-6b30ddf8e7b1 of volume d4e3fc9c-c4cd-444f-9010-b71478d214b4 {{(pid=86984) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:49:36 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-cdceb626-c19e-41f7-955d-3766e74d91da tempest-VolumesGetTest-1984201126 None] Created volume successfully. Sep 25 11:49:36 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b8a6ac-dd03-4392-ae0a-c712e63e7185]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:49:36 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-bc28c4c4-7c0d-4ec9-9e21-11e47efbde52 tempest-VolumesCloneTest-1869848950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-d4e3fc9c-c4cd-444f-9010-b71478d214b4 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:36 devstack sudo[98360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-d4e3fc9c-c4cd-444f-9010-b71478d214b4 Sep 25 11:49:36 devstack sudo[98360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:37 devstack sudo[98360]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:37 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-bc28c4c4-7c0d-4ec9-9e21-11e47efbde52 tempest-VolumesCloneTest-1869848950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-d4e3fc9c-c4cd-444f-9010-b71478d214b4" returned: 0 in 0.502s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:37 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-bc28c4c4-7c0d-4ec9-9e21-11e47efbde52 tempest-VolumesCloneTest-1869848950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-d4e3fc9c-c4cd-444f-9010-b71478d214b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-d4e3fc9c-c4cd-444f-9010-b71478d214b4.473e1578-b840-475c-a8a5-6b30ddf8e7b1 1G {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:37 devstack sudo[98365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-d4e3fc9c-c4cd-444f-9010-b71478d214b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-d4e3fc9c-c4cd-444f-9010-b71478d214b4.473e1578-b840-475c-a8a5-6b30ddf8e7b1 1G Sep 25 11:49:37 devstack sudo[98365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:38 devstack sudo[98365]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-bc28c4c4-7c0d-4ec9-9e21-11e47efbde52 tempest-VolumesCloneTest-1869848950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-d4e3fc9c-c4cd-444f-9010-b71478d214b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-d4e3fc9c-c4cd-444f-9010-b71478d214b4.473e1578-b840-475c-a8a5-6b30ddf8e7b1 1G" returned: 0 in 0.800s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-bc28c4c4-7c0d-4ec9-9e21-11e47efbde52 tempest-VolumesCloneTest-1869848950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4e3fc9c-c4cd-444f-9010-b71478d214b4 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-d4e3fc9c-c4cd-444f-9010-b71478d214b4.473e1578-b840-475c-a8a5-6b30ddf8e7b1 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:38 devstack sudo[98371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4e3fc9c-c4cd-444f-9010-b71478d214b4 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-d4e3fc9c-c4cd-444f-9010-b71478d214b4.473e1578-b840-475c-a8a5-6b30ddf8e7b1 Sep 25 11:49:38 devstack sudo[98371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:38 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-15fe01c8-5f3e-4fb1-8dd0-4f00fca056f4 tempest-VolumesCloneNegativeTest-1974123360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:49:38 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-15fe01c8-5f3e-4fb1-8dd0-4f00fca056f4 tempest-VolumesCloneNegativeTest-1974123360 None] Flow 'volume_create_manager' (3928081f-05f0-45e5-b105-fa2987567753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:49:38 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-15fe01c8-5f3e-4fb1-8dd0-4f00fca056f4 tempest-VolumesCloneNegativeTest-1974123360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb5d9a17-15e4-40df-a8e4-3d5a11b63aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:49:38 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-15fe01c8-5f3e-4fb1-8dd0-4f00fca056f4 tempest-VolumesCloneNegativeTest-1974123360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb5d9a17-15e4-40df-a8e4-3d5a11b63aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:49:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-833439550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=204012f5-079c-40c9-9bfb-f9c9c25f7613,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de158e1003b6496887b0baa564000906',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:49:38Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:49:38Z,use_quota=True,user_id='3bb4952b13294245aa54e6553066c66e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:49:38 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-15fe01c8-5f3e-4fb1-8dd0-4f00fca056f4 tempest-VolumesCloneNegativeTest-1974123360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b87411e-352f-4448-b0d1-ce0dd93420bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:49:38 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-15fe01c8-5f3e-4fb1-8dd0-4f00fca056f4 tempest-VolumesCloneNegativeTest-1974123360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b87411e-352f-4448-b0d1-ce0dd93420bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:49:38 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-15fe01c8-5f3e-4fb1-8dd0-4f00fca056f4 tempest-VolumesCloneNegativeTest-1974123360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8baec995-9066-429e-a2d4-1c168c7583fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:49:38 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-15fe01c8-5f3e-4fb1-8dd0-4f00fca056f4 tempest-VolumesCloneNegativeTest-1974123360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8baec995-9066-429e-a2d4-1c168c7583fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '204012f5-079c-40c9-9bfb-f9c9c25f7613', 'volume_name': 'volume-204012f5-079c-40c9-9bfb-f9c9c25f7613', 'volume_size': 2}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:49:38 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-15fe01c8-5f3e-4fb1-8dd0-4f00fca056f4 tempest-VolumesCloneNegativeTest-1974123360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7269fbee-24ec-411f-9053-2d5b2a8e8bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:49:38 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-15fe01c8-5f3e-4fb1-8dd0-4f00fca056f4 tempest-VolumesCloneNegativeTest-1974123360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7269fbee-24ec-411f-9053-2d5b2a8e8bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:49:38 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-15fe01c8-5f3e-4fb1-8dd0-4f00fca056f4 tempest-VolumesCloneNegativeTest-1974123360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f88a812d-30fa-4039-95f2-22656cba3e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:49:38 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-15fe01c8-5f3e-4fb1-8dd0-4f00fca056f4 tempest-VolumesCloneNegativeTest-1974123360 None] Volume 204012f5-079c-40c9-9bfb-f9c9c25f7613: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-204012f5-079c-40c9-9bfb-f9c9c25f7613', 'volume_size': 2} Sep 25 11:49:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-15fe01c8-5f3e-4fb1-8dd0-4f00fca056f4 tempest-VolumesCloneNegativeTest-1974123360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:49:38 devstack sudo[98371]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-bc28c4c4-7c0d-4ec9-9e21-11e47efbde52 tempest-VolumesCloneTest-1869848950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4e3fc9c-c4cd-444f-9010-b71478d214b4 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-d4e3fc9c-c4cd-444f-9010-b71478d214b4.473e1578-b840-475c-a8a5-6b30ddf8e7b1" returned: 0 in 0.525s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:38 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-bc28c4c4-7c0d-4ec9-9e21-11e47efbde52 tempest-VolumesCloneTest-1869848950 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-d4e3fc9c-c4cd-444f-9010-b71478d214b4.473e1578-b840-475c-a8a5-6b30ddf8e7b1 is being set with open permissions: ugo+rw Sep 25 11:49:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-bc28c4c4-7c0d-4ec9-9e21-11e47efbde52 tempest-VolumesCloneTest-1869848950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-d4e3fc9c-c4cd-444f-9010-b71478d214b4.473e1578-b840-475c-a8a5-6b30ddf8e7b1 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:38 devstack cinder-volume[86984]: DEBUG oslo_service.periodic_task [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:49:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:49:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:49:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:49:38 devstack sudo[98376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-d4e3fc9c-c4cd-444f-9010-b71478d214b4.473e1578-b840-475c-a8a5-6b30ddf8e7b1 Sep 25 11:49:38 devstack sudo[98376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:49:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:49:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:38 devstack sudo[98381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:49:38 devstack sudo[98381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:38 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe84ec46-fee4-4997-a14f-93ee8c41ea9a tempest-VolumesGetTest-1984201126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:49:38 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-fe84ec46-fee4-4997-a14f-93ee8c41ea9a tempest-VolumesGetTest-1984201126 None] Flow 'volume_create_manager' (cf0ce221-c949-45da-b6f2-113ac7fa40b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:49:38 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-fe84ec46-fee4-4997-a14f-93ee8c41ea9a tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dfda94d-5371-4747-966a-7e314e367aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:49:38 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-fe84ec46-fee4-4997-a14f-93ee8c41ea9a tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dfda94d-5371-4747-966a-7e314e367aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:49:38Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-15286572',display_name='tempest-VolumesGetTest-Volume-677897791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=256774d7-285f-44ef-9013-1be6caf2a6a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f6a1c00cee34650b3106442f2443249',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:49:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:49:39Z,use_quota=True,user_id='0b750a9ac0d643ab979b6125b2297eb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:49:38 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-fe84ec46-fee4-4997-a14f-93ee8c41ea9a tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55d93020-0168-4597-9f98-36ba72b7f486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:49:38 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-fe84ec46-fee4-4997-a14f-93ee8c41ea9a tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55d93020-0168-4597-9f98-36ba72b7f486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:49:38 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-fe84ec46-fee4-4997-a14f-93ee8c41ea9a tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3842eac4-ac82-489b-bfa6-a61f39e0b051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:49:38 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-fe84ec46-fee4-4997-a14f-93ee8c41ea9a tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3842eac4-ac82-489b-bfa6-a61f39e0b051) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '256774d7-285f-44ef-9013-1be6caf2a6a0', 'volume_name': 'volume-256774d7-285f-44ef-9013-1be6caf2a6a0', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:49:38 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-fe84ec46-fee4-4997-a14f-93ee8c41ea9a tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dc8e62f-91b4-40b1-b7d4-a4121bd3e052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:49:38 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-fe84ec46-fee4-4997-a14f-93ee8c41ea9a tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dc8e62f-91b4-40b1-b7d4-a4121bd3e052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:49:38 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-fe84ec46-fee4-4997-a14f-93ee8c41ea9a tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4573b20-8fb5-4276-8227-3a3203f1029e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:49:38 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-fe84ec46-fee4-4997-a14f-93ee8c41ea9a tempest-VolumesGetTest-1984201126 None] Volume 256774d7-285f-44ef-9013-1be6caf2a6a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-256774d7-285f-44ef-9013-1be6caf2a6a0', 'volume_size': 1} Sep 25 11:49:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-fe84ec46-fee4-4997-a14f-93ee8c41ea9a tempest-VolumesGetTest-1984201126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:49:38 devstack sudo[98376]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-bc28c4c4-7c0d-4ec9-9e21-11e47efbde52 tempest-VolumesCloneTest-1869848950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-d4e3fc9c-c4cd-444f-9010-b71478d214b4.473e1578-b840-475c-a8a5-6b30ddf8e7b1" returned: 0 in 0.327s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-bc28c4c4-7c0d-4ec9-9e21-11e47efbde52 tempest-VolumesCloneTest-1869848950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-d4e3fc9c-c4cd-444f-9010-b71478d214b4.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:38 devstack sudo[98381]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.343s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:38 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:49:38 devstack sudo[98388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-d4e3fc9c-c4cd-444f-9010-b71478d214b4.info Sep 25 11:49:38 devstack sudo[98388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:38 devstack cinder-volume[86984]: DEBUG oslo_service.periodic_task [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running periodic task VolumeManager._thread_info {{(pid=86984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:49:38 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] thread count: 28 {{(pid=86984) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 11:49:38 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] thread info: [<_MainThread(MainThread, started 132046492332160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86984) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 11:49:39 devstack sudo[98388]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-bc28c4c4-7c0d-4ec9-9e21-11e47efbde52 tempest-VolumesCloneTest-1869848950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-d4e3fc9c-c4cd-444f-9010-b71478d214b4.info" returned: 0 in 0.303s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:39 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-bc28c4c4-7c0d-4ec9-9e21-11e47efbde52 tempest-VolumesCloneTest-1869848950 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-d4e3fc9c-c4cd-444f-9010-b71478d214b4.info is being set with open permissions: ugo+rw Sep 25 11:49:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-bc28c4c4-7c0d-4ec9-9e21-11e47efbde52 tempest-VolumesCloneTest-1869848950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-d4e3fc9c-c4cd-444f-9010-b71478d214b4.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:39 devstack sudo[98391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-d4e3fc9c-c4cd-444f-9010-b71478d214b4.info Sep 25 11:49:39 devstack sudo[98391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:39 devstack sudo[98391]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-bc28c4c4-7c0d-4ec9-9e21-11e47efbde52 tempest-VolumesCloneTest-1869848950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-d4e3fc9c-c4cd-444f-9010-b71478d214b4.info" returned: 0 in 0.271s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:39 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-bc28c4c4-7c0d-4ec9-9e21-11e47efbde52 tempest-VolumesCloneTest-1869848950 None] Acquiring lock "cinder-quobyte-e37b0e85-8d94-4d64-bc7a-e8cc4ca2175e" by "_copy_volume_from_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:49:39 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-bc28c4c4-7c0d-4ec9-9e21-11e47efbde52 tempest-VolumesCloneTest-1869848950 None] Lock "cinder-quobyte-e37b0e85-8d94-4d64-bc7a-e8cc4ca2175e" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:49:39 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-bc28c4c4-7c0d-4ec9-9e21-11e47efbde52 tempest-VolumesCloneTest-1869848950 None] snapshot: 473e1578-b840-475c-a8a5-6b30ddf8e7b1, volume: e37b0e85-8d94-4d64-bc7a-e8cc4ca2175e, {{(pid=86984) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 11:49:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-bc28c4c4-7c0d-4ec9-9e21-11e47efbde52 tempest-VolumesCloneTest-1869848950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:49:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-bc28c4c4-7c0d-4ec9-9e21-11e47efbde52 tempest-VolumesCloneTest-1869848950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:49:39 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-bc28c4c4-7c0d-4ec9-9e21-11e47efbde52 tempest-VolumesCloneTest-1869848950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:49:39 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-bc28c4c4-7c0d-4ec9-9e21-11e47efbde52 tempest-VolumesCloneTest-1869848950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:49:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-bc28c4c4-7c0d-4ec9-9e21-11e47efbde52 tempest-VolumesCloneTest-1869848950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:49:39 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa186adc-7223-4509-986e-c4904405d4cd]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:49:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-bc28c4c4-7c0d-4ec9-9e21-11e47efbde52 tempest-VolumesCloneTest-1869848950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-d4e3fc9c-c4cd-444f-9010-b71478d214b4.473e1578-b840-475c-a8a5-6b30ddf8e7b1 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:39 devstack sudo[98394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-d4e3fc9c-c4cd-444f-9010-b71478d214b4.473e1578-b840-475c-a8a5-6b30ddf8e7b1 Sep 25 11:49:39 devstack sudo[98394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:40 devstack sudo[98394]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:40 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-bc28c4c4-7c0d-4ec9-9e21-11e47efbde52 tempest-VolumesCloneTest-1869848950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-d4e3fc9c-c4cd-444f-9010-b71478d214b4.473e1578-b840-475c-a8a5-6b30ddf8e7b1" returned: 0 in 0.458s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:40 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-bc28c4c4-7c0d-4ec9-9e21-11e47efbde52 tempest-VolumesCloneTest-1869848950 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4e3fc9c-c4cd-444f-9010-b71478d214b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86984) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:49:40 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ee57b5-b947-4106-aed3-6fc60f30eb26]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:49:40 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-bc28c4c4-7c0d-4ec9-9e21-11e47efbde52 tempest-VolumesCloneTest-1869848950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-d4e3fc9c-c4cd-444f-9010-b71478d214b4 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:40 devstack sudo[98399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-d4e3fc9c-c4cd-444f-9010-b71478d214b4 Sep 25 11:49:40 devstack sudo[98399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:40 devstack sudo[98399]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:40 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-bc28c4c4-7c0d-4ec9-9e21-11e47efbde52 tempest-VolumesCloneTest-1869848950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-d4e3fc9c-c4cd-444f-9010-b71478d214b4" returned: 0 in 0.429s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:40 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-bc28c4c4-7c0d-4ec9-9e21-11e47efbde52 tempest-VolumesCloneTest-1869848950 None] will copy from snapshot at /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-d4e3fc9c-c4cd-444f-9010-b71478d214b4 {{(pid=86984) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 11:49:40 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-bc28c4c4-7c0d-4ec9-9e21-11e47efbde52 tempest-VolumesCloneTest-1869848950 None] Creating direct copy from snapshot {{(pid=86984) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 11:49:40 devstack cinder-volume[86984]: DEBUG cinder.utils [None req-bc28c4c4-7c0d-4ec9-9e21-11e47efbde52 tempest-VolumesCloneTest-1869848950 None] Path /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-e37b0e85-8d94-4d64-bc7a-e8cc4ca2175e not found in is_blk_device check {{(pid=86984) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 11:49:40 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-bc28c4c4-7c0d-4ec9-9e21-11e47efbde52 tempest-VolumesCloneTest-1869848950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-d4e3fc9c-c4cd-444f-9010-b71478d214b4 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-e37b0e85-8d94-4d64-bc7a-e8cc4ca2175e {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:40 devstack sudo[98404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-d4e3fc9c-c4cd-444f-9010-b71478d214b4 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-e37b0e85-8d94-4d64-bc7a-e8cc4ca2175e Sep 25 11:49:40 devstack sudo[98404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:48 devstack sudo[98404]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-bc28c4c4-7c0d-4ec9-9e21-11e47efbde52 tempest-VolumesCloneTest-1869848950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-d4e3fc9c-c4cd-444f-9010-b71478d214b4 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-e37b0e85-8d94-4d64-bc7a-e8cc4ca2175e" returned: 0 in 7.652s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:48 devstack cinder-volume[86984]: DEBUG cinder.image.image_utils [None req-bc28c4c4-7c0d-4ec9-9e21-11e47efbde52 tempest-VolumesCloneTest-1869848950 None] Image conversion details: src /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-d4e3fc9c-c4cd-444f-9010-b71478d214b4, size 1024.00 MB, duration 7.65 sec, destination /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-e37b0e85-8d94-4d64-bc7a-e8cc4ca2175e {{(pid=86984) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 11:49:48 devstack cinder-volume[86984]: INFO cinder.image.image_utils [None req-bc28c4c4-7c0d-4ec9-9e21-11e47efbde52 tempest-VolumesCloneTest-1869848950 None] Converted 1024.00 MB image at 133.79 MB/s Sep 25 11:49:48 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-bc28c4c4-7c0d-4ec9-9e21-11e47efbde52 tempest-VolumesCloneTest-1869848950 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-e37b0e85-8d94-4d64-bc7a-e8cc4ca2175e is being set with open permissions: ugo+rw Sep 25 11:49:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-bc28c4c4-7c0d-4ec9-9e21-11e47efbde52 tempest-VolumesCloneTest-1869848950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-e37b0e85-8d94-4d64-bc7a-e8cc4ca2175e {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:48 devstack sudo[98456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-e37b0e85-8d94-4d64-bc7a-e8cc4ca2175e Sep 25 11:49:48 devstack sudo[98456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:48 devstack sudo[98456]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-bc28c4c4-7c0d-4ec9-9e21-11e47efbde52 tempest-VolumesCloneTest-1869848950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-e37b0e85-8d94-4d64-bc7a-e8cc4ca2175e" returned: 0 in 0.272s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:48 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-bc28c4c4-7c0d-4ec9-9e21-11e47efbde52 tempest-VolumesCloneTest-1869848950 None] Lock "cinder-quobyte-e37b0e85-8d94-4d64-bc7a-e8cc4ca2175e" released by "_copy_volume_from_snapshot" :: held 8.907s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:49:48 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-bc28c4c4-7c0d-4ec9-9e21-11e47efbde52 tempest-VolumesCloneTest-1869848950 None] Acquiring lock "cinder-quobyte-473e1578-b840-475c-a8a5-6b30ddf8e7b1" by "_delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:49:48 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-bc28c4c4-7c0d-4ec9-9e21-11e47efbde52 tempest-VolumesCloneTest-1869848950 None] Lock "cinder-quobyte-473e1578-b840-475c-a8a5-6b30ddf8e7b1" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:49:48 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-bc28c4c4-7c0d-4ec9-9e21-11e47efbde52 tempest-VolumesCloneTest-1869848950 None] Deleting offline snapshot 473e1578-b840-475c-a8a5-6b30ddf8e7b1 of volume d4e3fc9c-c4cd-444f-9010-b71478d214b4 {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:49:48 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-bc28c4c4-7c0d-4ec9-9e21-11e47efbde52 tempest-VolumesCloneTest-1869848950 None] snapshot_file for this snap is: volume-d4e3fc9c-c4cd-444f-9010-b71478d214b4.473e1578-b840-475c-a8a5-6b30ddf8e7b1 {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:49:48 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd23891-3d3c-4701-af7e-a044992fe143]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:49:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-bc28c4c4-7c0d-4ec9-9e21-11e47efbde52 tempest-VolumesCloneTest-1869848950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-d4e3fc9c-c4cd-444f-9010-b71478d214b4.473e1578-b840-475c-a8a5-6b30ddf8e7b1 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:48 devstack sudo[98459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-d4e3fc9c-c4cd-444f-9010-b71478d214b4.473e1578-b840-475c-a8a5-6b30ddf8e7b1 Sep 25 11:49:48 devstack sudo[98459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:48 devstack cinder-volume[86984]: DEBUG dbcounter [-] [86984] Writing DB stats cinder:UPDATE=4,cinder:SELECT=6,cinder:DELETE=1,cinder:INSERT=1 {{(pid=86984) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:49:48 devstack sudo[98459]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-bc28c4c4-7c0d-4ec9-9e21-11e47efbde52 tempest-VolumesCloneTest-1869848950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-d4e3fc9c-c4cd-444f-9010-b71478d214b4.473e1578-b840-475c-a8a5-6b30ddf8e7b1" returned: 0 in 0.434s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:48 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-bc28c4c4-7c0d-4ec9-9e21-11e47efbde52 tempest-VolumesCloneTest-1869848950 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4e3fc9c-c4cd-444f-9010-b71478d214b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86984) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:49:49 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87d658b-3f20-4a65-b556-a8f2f6803c9f]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:49:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-bc28c4c4-7c0d-4ec9-9e21-11e47efbde52 tempest-VolumesCloneTest-1869848950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-d4e3fc9c-c4cd-444f-9010-b71478d214b4 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:49 devstack sudo[98464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-d4e3fc9c-c4cd-444f-9010-b71478d214b4 Sep 25 11:49:49 devstack sudo[98464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:49 devstack sudo[98464]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-bc28c4c4-7c0d-4ec9-9e21-11e47efbde52 tempest-VolumesCloneTest-1869848950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-d4e3fc9c-c4cd-444f-9010-b71478d214b4" returned: 0 in 0.646s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-bc28c4c4-7c0d-4ec9-9e21-11e47efbde52 tempest-VolumesCloneTest-1869848950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-d4e3fc9c-c4cd-444f-9010-b71478d214b4.473e1578-b840-475c-a8a5-6b30ddf8e7b1 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:49 devstack sudo[98469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-d4e3fc9c-c4cd-444f-9010-b71478d214b4.473e1578-b840-475c-a8a5-6b30ddf8e7b1 Sep 25 11:49:49 devstack sudo[98469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:50 devstack sudo[98469]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-bc28c4c4-7c0d-4ec9-9e21-11e47efbde52 tempest-VolumesCloneTest-1869848950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-d4e3fc9c-c4cd-444f-9010-b71478d214b4.473e1578-b840-475c-a8a5-6b30ddf8e7b1" returned: 0 in 0.415s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-bc28c4c4-7c0d-4ec9-9e21-11e47efbde52 tempest-VolumesCloneTest-1869848950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-d4e3fc9c-c4cd-444f-9010-b71478d214b4.473e1578-b840-475c-a8a5-6b30ddf8e7b1 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:50 devstack sudo[98474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-d4e3fc9c-c4cd-444f-9010-b71478d214b4.473e1578-b840-475c-a8a5-6b30ddf8e7b1 Sep 25 11:49:50 devstack sudo[98474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:50 devstack sudo[98474]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-bc28c4c4-7c0d-4ec9-9e21-11e47efbde52 tempest-VolumesCloneTest-1869848950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-d4e3fc9c-c4cd-444f-9010-b71478d214b4.473e1578-b840-475c-a8a5-6b30ddf8e7b1" returned: 0 in 0.302s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:50 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-bc28c4c4-7c0d-4ec9-9e21-11e47efbde52 tempest-VolumesCloneTest-1869848950 None] Lock "cinder-quobyte-473e1578-b840-475c-a8a5-6b30ddf8e7b1" released by "_delete_snapshot" :: held 1.926s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:49:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-bc28c4c4-7c0d-4ec9-9e21-11e47efbde52 tempest-VolumesCloneTest-1869848950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.842s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:49:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-8df7283a-ef64-447f-b22b-301d0232965f tempest-VolumeQuotasAdminTestJSON-1873760781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 38.503s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:49:50 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-8df7283a-ef64-447f-b22b-301d0232965f tempest-VolumeQuotasAdminTestJSON-1873760781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:49:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-862418557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87a24e90-fb7c-4805-ae65-71e0a9aab9aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6c60536389d4c54af025549eb2f6a3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:49:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:49:12Z,use_quota=True,user_id='f3a94755efbd42ba8e09fd02eaf50990',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:49:50 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-8df7283a-ef64-447f-b22b-301d0232965f tempest-VolumeQuotasAdminTestJSON-1873760781 None] Creating volume 87a24e90-fb7c-4805-ae65-71e0a9aab9aa {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:49:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-8df7283a-ef64-447f-b22b-301d0232965f tempest-VolumeQuotasAdminTestJSON-1873760781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:49:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-8df7283a-ef64-447f-b22b-301d0232965f tempest-VolumeQuotasAdminTestJSON-1873760781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:49:50 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-8df7283a-ef64-447f-b22b-301d0232965f tempest-VolumeQuotasAdminTestJSON-1873760781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:49:50 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-8df7283a-ef64-447f-b22b-301d0232965f tempest-VolumeQuotasAdminTestJSON-1873760781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:49:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-8df7283a-ef64-447f-b22b-301d0232965f tempest-VolumeQuotasAdminTestJSON-1873760781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:49:50 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-8df7283a-ef64-447f-b22b-301d0232965f tempest-VolumeQuotasAdminTestJSON-1873760781 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:49:50 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-8df7283a-ef64-447f-b22b-301d0232965f tempest-VolumeQuotasAdminTestJSON-1873760781 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:49:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8df7283a-ef64-447f-b22b-301d0232965f tempest-VolumeQuotasAdminTestJSON-1873760781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-87a24e90-fb7c-4805-ae65-71e0a9aab9aa 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:50 devstack sudo[98477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-87a24e90-fb7c-4805-ae65-71e0a9aab9aa 1073741824 Sep 25 11:49:50 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-bc28c4c4-7c0d-4ec9-9e21-11e47efbde52 tempest-VolumesCloneTest-1869848950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d602690c-e1de-47ae-baf9-8445adafdf05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e37b0e85-8d94-4d64-bc7a-e8cc4ca2175e', 'volume_size': 2, 'source_volid': 'd4e3fc9c-c4cd-444f-9010-b71478d214b4', 'source_volstatus': 'available'}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:49:50 devstack sudo[98477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:50 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-bc28c4c4-7c0d-4ec9-9e21-11e47efbde52 tempest-VolumesCloneTest-1869848950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30c94df4-20e2-4a7f-bd26-61d251d8aba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:49:50 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-bc28c4c4-7c0d-4ec9-9e21-11e47efbde52 tempest-VolumesCloneTest-1869848950 None] Volume volume-e37b0e85-8d94-4d64-bc7a-e8cc4ca2175e (e37b0e85-8d94-4d64-bc7a-e8cc4ca2175e): created successfully Sep 25 11:49:50 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-bc28c4c4-7c0d-4ec9-9e21-11e47efbde52 tempest-VolumesCloneTest-1869848950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30c94df4-20e2-4a7f-bd26-61d251d8aba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:49:50 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-bc28c4c4-7c0d-4ec9-9e21-11e47efbde52 tempest-VolumesCloneTest-1869848950 None] Flow 'volume_create_manager' (bfeead75-8e3b-448a-b983-934684ebe123) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:49:50 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-bc28c4c4-7c0d-4ec9-9e21-11e47efbde52 tempest-VolumesCloneTest-1869848950 None] Created volume successfully. Sep 25 11:49:51 devstack sudo[98477]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8df7283a-ef64-447f-b22b-301d0232965f tempest-VolumeQuotasAdminTestJSON-1873760781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-87a24e90-fb7c-4805-ae65-71e0a9aab9aa 1073741824" returned: 0 in 0.533s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8df7283a-ef64-447f-b22b-301d0232965f tempest-VolumeQuotasAdminTestJSON-1873760781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-87a24e90-fb7c-4805-ae65-71e0a9aab9aa {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:51 devstack sudo[98483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-87a24e90-fb7c-4805-ae65-71e0a9aab9aa Sep 25 11:49:51 devstack sudo[98483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:51 devstack sudo[98483]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8df7283a-ef64-447f-b22b-301d0232965f tempest-VolumeQuotasAdminTestJSON-1873760781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-87a24e90-fb7c-4805-ae65-71e0a9aab9aa" returned: 0 in 0.296s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:51 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-8df7283a-ef64-447f-b22b-301d0232965f tempest-VolumeQuotasAdminTestJSON-1873760781 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:49:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-8df7283a-ef64-447f-b22b-301d0232965f tempest-VolumeQuotasAdminTestJSON-1873760781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:49:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-15fe01c8-5f3e-4fb1-8dd0-4f00fca056f4 tempest-VolumesCloneNegativeTest-1974123360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.951s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:49:51 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-15fe01c8-5f3e-4fb1-8dd0-4f00fca056f4 tempest-VolumesCloneNegativeTest-1974123360 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:49:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-833439550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=204012f5-079c-40c9-9bfb-f9c9c25f7613,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de158e1003b6496887b0baa564000906',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:49:38Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:49:38Z,use_quota=True,user_id='3bb4952b13294245aa54e6553066c66e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:49:51 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-15fe01c8-5f3e-4fb1-8dd0-4f00fca056f4 tempest-VolumesCloneNegativeTest-1974123360 None] Creating volume 204012f5-079c-40c9-9bfb-f9c9c25f7613 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:49:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-15fe01c8-5f3e-4fb1-8dd0-4f00fca056f4 tempest-VolumesCloneNegativeTest-1974123360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:49:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-15fe01c8-5f3e-4fb1-8dd0-4f00fca056f4 tempest-VolumesCloneNegativeTest-1974123360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:49:51 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-15fe01c8-5f3e-4fb1-8dd0-4f00fca056f4 tempest-VolumesCloneNegativeTest-1974123360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:49:51 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-15fe01c8-5f3e-4fb1-8dd0-4f00fca056f4 tempest-VolumesCloneNegativeTest-1974123360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:49:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-15fe01c8-5f3e-4fb1-8dd0-4f00fca056f4 tempest-VolumesCloneNegativeTest-1974123360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:49:51 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-15fe01c8-5f3e-4fb1-8dd0-4f00fca056f4 tempest-VolumesCloneNegativeTest-1974123360 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:49:51 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-15fe01c8-5f3e-4fb1-8dd0-4f00fca056f4 tempest-VolumesCloneNegativeTest-1974123360 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:49:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-15fe01c8-5f3e-4fb1-8dd0-4f00fca056f4 tempest-VolumesCloneNegativeTest-1974123360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-204012f5-079c-40c9-9bfb-f9c9c25f7613 2147483648 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:51 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8df7283a-ef64-447f-b22b-301d0232965f tempest-VolumeQuotasAdminTestJSON-1873760781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a54f705-41c7-4627-95c5-9bb237b65646) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87a24e90-fb7c-4805-ae65-71e0a9aab9aa', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:49:51 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8df7283a-ef64-447f-b22b-301d0232965f tempest-VolumeQuotasAdminTestJSON-1873760781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d747ffd2-9868-4f07-8122-a02dce373338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:49:51 devstack sudo[98486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-204012f5-079c-40c9-9bfb-f9c9c25f7613 2147483648 Sep 25 11:49:51 devstack sudo[98486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:51 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-8df7283a-ef64-447f-b22b-301d0232965f tempest-VolumeQuotasAdminTestJSON-1873760781 None] Volume volume-87a24e90-fb7c-4805-ae65-71e0a9aab9aa (87a24e90-fb7c-4805-ae65-71e0a9aab9aa): created successfully Sep 25 11:49:51 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8df7283a-ef64-447f-b22b-301d0232965f tempest-VolumeQuotasAdminTestJSON-1873760781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d747ffd2-9868-4f07-8122-a02dce373338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:49:51 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8df7283a-ef64-447f-b22b-301d0232965f tempest-VolumeQuotasAdminTestJSON-1873760781 None] Flow 'volume_create_manager' (268da360-2e2e-49d3-adca-0dd55dd63171) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:49:51 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-8df7283a-ef64-447f-b22b-301d0232965f tempest-VolumeQuotasAdminTestJSON-1873760781 None] Created volume successfully. Sep 25 11:49:51 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-99358135-940f-4dad-bc5e-9265c0e9eab5 tempest-VolumesCloneTest-1869848950 None] Acquiring lock "cinder-e37b0e85-8d94-4d64-bc7a-e8cc4ca2175e-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:49:51 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-99358135-940f-4dad-bc5e-9265c0e9eab5 tempest-VolumesCloneTest-1869848950 None] Lock "cinder-e37b0e85-8d94-4d64-bc7a-e8cc4ca2175e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:49:51 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-99358135-940f-4dad-bc5e-9265c0e9eab5 tempest-VolumesCloneTest-1869848950 None] Acquiring lock "cinder-quobyte-e37b0e85-8d94-4d64-bc7a-e8cc4ca2175e" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:49:51 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-99358135-940f-4dad-bc5e-9265c0e9eab5 tempest-VolumesCloneTest-1869848950 None] Lock "cinder-quobyte-e37b0e85-8d94-4d64-bc7a-e8cc4ca2175e" acquired by "delete_volume" :: waited 0.018s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:49:51 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e889f5-cddf-44e9-b5f4-f4259713dc57]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:49:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-99358135-940f-4dad-bc5e-9265c0e9eab5 tempest-VolumesCloneTest-1869848950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-e37b0e85-8d94-4d64-bc7a-e8cc4ca2175e {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:51 devstack sudo[98491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-e37b0e85-8d94-4d64-bc7a-e8cc4ca2175e Sep 25 11:49:51 devstack sudo[98491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:51 devstack sudo[98486]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-15fe01c8-5f3e-4fb1-8dd0-4f00fca056f4 tempest-VolumesCloneNegativeTest-1974123360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-204012f5-079c-40c9-9bfb-f9c9c25f7613 2147483648" returned: 0 in 0.633s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-15fe01c8-5f3e-4fb1-8dd0-4f00fca056f4 tempest-VolumesCloneNegativeTest-1974123360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-204012f5-079c-40c9-9bfb-f9c9c25f7613 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:52 devstack sudo[98494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-204012f5-079c-40c9-9bfb-f9c9c25f7613 Sep 25 11:49:52 devstack sudo[98494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:52 devstack sudo[98491]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-99358135-940f-4dad-bc5e-9265c0e9eab5 tempest-VolumesCloneTest-1869848950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-e37b0e85-8d94-4d64-bc7a-e8cc4ca2175e" returned: 0 in 0.460s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-99358135-940f-4dad-bc5e-9265c0e9eab5 tempest-VolumesCloneTest-1869848950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-e37b0e85-8d94-4d64-bc7a-e8cc4ca2175e {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:52 devstack sudo[98499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-e37b0e85-8d94-4d64-bc7a-e8cc4ca2175e Sep 25 11:49:52 devstack sudo[98499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:52 devstack sudo[98494]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-15fe01c8-5f3e-4fb1-8dd0-4f00fca056f4 tempest-VolumesCloneNegativeTest-1974123360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-204012f5-079c-40c9-9bfb-f9c9c25f7613" returned: 0 in 0.283s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:52 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-15fe01c8-5f3e-4fb1-8dd0-4f00fca056f4 tempest-VolumesCloneNegativeTest-1974123360 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:49:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-15fe01c8-5f3e-4fb1-8dd0-4f00fca056f4 tempest-VolumesCloneNegativeTest-1974123360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:49:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-fe84ec46-fee4-4997-a14f-93ee8c41ea9a tempest-VolumesGetTest-1984201126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.469s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:49:52 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-fe84ec46-fee4-4997-a14f-93ee8c41ea9a tempest-VolumesGetTest-1984201126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:49:38Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-15286572',display_name='tempest-VolumesGetTest-Volume-677897791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=256774d7-285f-44ef-9013-1be6caf2a6a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f6a1c00cee34650b3106442f2443249',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:49:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:49:39Z,use_quota=True,user_id='0b750a9ac0d643ab979b6125b2297eb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:49:52 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-fe84ec46-fee4-4997-a14f-93ee8c41ea9a tempest-VolumesGetTest-1984201126 None] Creating volume 256774d7-285f-44ef-9013-1be6caf2a6a0 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:49:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-fe84ec46-fee4-4997-a14f-93ee8c41ea9a tempest-VolumesGetTest-1984201126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:49:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-fe84ec46-fee4-4997-a14f-93ee8c41ea9a tempest-VolumesGetTest-1984201126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:49:52 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-fe84ec46-fee4-4997-a14f-93ee8c41ea9a tempest-VolumesGetTest-1984201126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:49:52 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-fe84ec46-fee4-4997-a14f-93ee8c41ea9a tempest-VolumesGetTest-1984201126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:49:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-fe84ec46-fee4-4997-a14f-93ee8c41ea9a tempest-VolumesGetTest-1984201126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:49:52 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-fe84ec46-fee4-4997-a14f-93ee8c41ea9a tempest-VolumesGetTest-1984201126 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:49:52 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-fe84ec46-fee4-4997-a14f-93ee8c41ea9a tempest-VolumesGetTest-1984201126 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:49:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-fe84ec46-fee4-4997-a14f-93ee8c41ea9a tempest-VolumesGetTest-1984201126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-256774d7-285f-44ef-9013-1be6caf2a6a0 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:52 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-15fe01c8-5f3e-4fb1-8dd0-4f00fca056f4 tempest-VolumesCloneNegativeTest-1974123360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f88a812d-30fa-4039-95f2-22656cba3e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-204012f5-079c-40c9-9bfb-f9c9c25f7613', 'volume_size': 2}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:49:52 devstack sudo[98502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-256774d7-285f-44ef-9013-1be6caf2a6a0 1073741824 Sep 25 11:49:52 devstack sudo[98502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:52 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-15fe01c8-5f3e-4fb1-8dd0-4f00fca056f4 tempest-VolumesCloneNegativeTest-1974123360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62205fd1-7e5b-4f4b-8363-28f0a0dc6d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:49:52 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-15fe01c8-5f3e-4fb1-8dd0-4f00fca056f4 tempest-VolumesCloneNegativeTest-1974123360 None] Volume volume-204012f5-079c-40c9-9bfb-f9c9c25f7613 (204012f5-079c-40c9-9bfb-f9c9c25f7613): created successfully Sep 25 11:49:52 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-15fe01c8-5f3e-4fb1-8dd0-4f00fca056f4 tempest-VolumesCloneNegativeTest-1974123360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62205fd1-7e5b-4f4b-8363-28f0a0dc6d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:49:52 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-15fe01c8-5f3e-4fb1-8dd0-4f00fca056f4 tempest-VolumesCloneNegativeTest-1974123360 None] Flow 'volume_create_manager' (3928081f-05f0-45e5-b105-fa2987567753) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:49:52 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-15fe01c8-5f3e-4fb1-8dd0-4f00fca056f4 tempest-VolumesCloneNegativeTest-1974123360 None] Created volume successfully. Sep 25 11:49:52 devstack sudo[98499]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-99358135-940f-4dad-bc5e-9265c0e9eab5 tempest-VolumesCloneTest-1869848950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-e37b0e85-8d94-4d64-bc7a-e8cc4ca2175e" returned: 0 in 0.299s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:52 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-99358135-940f-4dad-bc5e-9265c0e9eab5 tempest-VolumesCloneTest-1869848950 None] Lock "cinder-quobyte-e37b0e85-8d94-4d64-bc7a-e8cc4ca2175e" released by "delete_volume" :: held 0.822s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:49:52 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-99358135-940f-4dad-bc5e-9265c0e9eab5 tempest-VolumesCloneTest-1869848950 None] Created reservations ['d6f06724-265c-4ee4-a29e-609f6d4fa1e1', '2761d1c5-725a-4a2b-a120-166e8414ec98', '31497620-6a61-4a86-85b0-bfb6ce291089', '2d7f7cd4-6685-40e4-8678-3f79a9bbf69b'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:49:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-99358135-940f-4dad-bc5e-9265c0e9eab5 tempest-VolumesCloneTest-1869848950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:49:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-99358135-940f-4dad-bc5e-9265c0e9eab5 tempest-VolumesCloneTest-1869848950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:49:52 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-99358135-940f-4dad-bc5e-9265c0e9eab5 tempest-VolumesCloneTest-1869848950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:49:52 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-99358135-940f-4dad-bc5e-9265c0e9eab5 tempest-VolumesCloneTest-1869848950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:49:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-99358135-940f-4dad-bc5e-9265c0e9eab5 tempest-VolumesCloneTest-1869848950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:49:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-99358135-940f-4dad-bc5e-9265c0e9eab5 tempest-VolumesCloneTest-1869848950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:52 devstack sudo[98508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:49:52 devstack sudo[98508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:52 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e35d0d4c-99eb-4edd-8007-cbd1c191c293 tempest-VolumesCloneNegativeTest-1974123360 None] Acquiring lock "cinder-204012f5-079c-40c9-9bfb-f9c9c25f7613-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:49:52 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e35d0d4c-99eb-4edd-8007-cbd1c191c293 tempest-VolumesCloneNegativeTest-1974123360 None] Lock "cinder-204012f5-079c-40c9-9bfb-f9c9c25f7613-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:49:52 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e35d0d4c-99eb-4edd-8007-cbd1c191c293 tempest-VolumesCloneNegativeTest-1974123360 None] Acquiring lock "cinder-quobyte-204012f5-079c-40c9-9bfb-f9c9c25f7613" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:49:53 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-da450f65-ea8c-47aa-8d54-789d354af566 tempest-VolumesCloneTest-1869848950 None] Acquiring lock "cinder-d4e3fc9c-c4cd-444f-9010-b71478d214b4-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:49:53 devstack sudo[98502]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-fe84ec46-fee4-4997-a14f-93ee8c41ea9a tempest-VolumesGetTest-1984201126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-256774d7-285f-44ef-9013-1be6caf2a6a0 1073741824" returned: 0 in 0.709s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:53 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e35d0d4c-99eb-4edd-8007-cbd1c191c293 tempest-VolumesCloneNegativeTest-1974123360 None] Lock "cinder-quobyte-204012f5-079c-40c9-9bfb-f9c9c25f7613" acquired by "delete_volume" :: waited 0.064s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:49:53 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-da450f65-ea8c-47aa-8d54-789d354af566 tempest-VolumesCloneTest-1869848950 None] Lock "cinder-d4e3fc9c-c4cd-444f-9010-b71478d214b4-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:49:53 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f0a664-1279-4b89-8c7b-4ae5a519b6ab]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:49:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e35d0d4c-99eb-4edd-8007-cbd1c191c293 tempest-VolumesCloneNegativeTest-1974123360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-204012f5-079c-40c9-9bfb-f9c9c25f7613 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:53 devstack sudo[98508]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-99358135-940f-4dad-bc5e-9265c0e9eab5 tempest-VolumesCloneTest-1869848950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.403s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:53 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-99358135-940f-4dad-bc5e-9265c0e9eab5 tempest-VolumesCloneTest-1869848950 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:49:53 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-99358135-940f-4dad-bc5e-9265c0e9eab5 tempest-VolumesCloneTest-1869848950 None] Deleted volume successfully. Sep 25 11:49:53 devstack sudo[98513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-204012f5-079c-40c9-9bfb-f9c9c25f7613 Sep 25 11:49:53 devstack sudo[98513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-fe84ec46-fee4-4997-a14f-93ee8c41ea9a tempest-VolumesGetTest-1984201126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-256774d7-285f-44ef-9013-1be6caf2a6a0 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:53 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-da450f65-ea8c-47aa-8d54-789d354af566 tempest-VolumesCloneTest-1869848950 None] Acquiring lock "cinder-quobyte-d4e3fc9c-c4cd-444f-9010-b71478d214b4" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:49:53 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-da450f65-ea8c-47aa-8d54-789d354af566 tempest-VolumesCloneTest-1869848950 None] Lock "cinder-quobyte-d4e3fc9c-c4cd-444f-9010-b71478d214b4" acquired by "delete_volume" :: waited 0.026s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:49:53 devstack sudo[98515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-256774d7-285f-44ef-9013-1be6caf2a6a0 Sep 25 11:49:53 devstack sudo[98515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:53 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-99358135-940f-4dad-bc5e-9265c0e9eab5 tempest-VolumesCloneTest-1869848950 None] Lock "cinder-e37b0e85-8d94-4d64-bc7a-e8cc4ca2175e-delete_volume" released by "delete_volume" :: held 1.727s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:49:53 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[51885735-edde-410f-8c77-aa26cf02fc88]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:49:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-da450f65-ea8c-47aa-8d54-789d354af566 tempest-VolumesCloneTest-1869848950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-d4e3fc9c-c4cd-444f-9010-b71478d214b4 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:53 devstack sudo[98517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-d4e3fc9c-c4cd-444f-9010-b71478d214b4 Sep 25 11:49:53 devstack sudo[98517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:53 devstack sudo[98515]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-fe84ec46-fee4-4997-a14f-93ee8c41ea9a tempest-VolumesGetTest-1984201126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-256774d7-285f-44ef-9013-1be6caf2a6a0" returned: 0 in 0.356s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:53 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-fe84ec46-fee4-4997-a14f-93ee8c41ea9a tempest-VolumesGetTest-1984201126 None] <== create_volume: return (1272ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:49:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-fe84ec46-fee4-4997-a14f-93ee8c41ea9a tempest-VolumesGetTest-1984201126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.278s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:49:53 devstack sudo[98513]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e35d0d4c-99eb-4edd-8007-cbd1c191c293 tempest-VolumesCloneNegativeTest-1974123360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-204012f5-079c-40c9-9bfb-f9c9c25f7613" returned: 0 in 0.505s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e35d0d4c-99eb-4edd-8007-cbd1c191c293 tempest-VolumesCloneNegativeTest-1974123360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-204012f5-079c-40c9-9bfb-f9c9c25f7613 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:53 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-fe84ec46-fee4-4997-a14f-93ee8c41ea9a tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4573b20-8fb5-4276-8227-3a3203f1029e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-256774d7-285f-44ef-9013-1be6caf2a6a0', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:49:53 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-fe84ec46-fee4-4997-a14f-93ee8c41ea9a tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c7519b1-1aa0-4831-914a-e1f5f4fe45c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:49:53 devstack sudo[98523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-204012f5-079c-40c9-9bfb-f9c9c25f7613 Sep 25 11:49:53 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-fe84ec46-fee4-4997-a14f-93ee8c41ea9a tempest-VolumesGetTest-1984201126 None] Volume volume-256774d7-285f-44ef-9013-1be6caf2a6a0 (256774d7-285f-44ef-9013-1be6caf2a6a0): created successfully Sep 25 11:49:53 devstack sudo[98523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:53 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-fe84ec46-fee4-4997-a14f-93ee8c41ea9a tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c7519b1-1aa0-4831-914a-e1f5f4fe45c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:49:53 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-fe84ec46-fee4-4997-a14f-93ee8c41ea9a tempest-VolumesGetTest-1984201126 None] Flow 'volume_create_manager' (cf0ce221-c949-45da-b6f2-113ac7fa40b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:49:53 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-fe84ec46-fee4-4997-a14f-93ee8c41ea9a tempest-VolumesGetTest-1984201126 None] Created volume successfully. Sep 25 11:49:53 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-edebb0a3-3e71-4478-bdcd-21fc45f88fef tempest-VolumeQuotasAdminTestJSON-487105649 None] Transfer volume completed successfully. Sep 25 11:49:53 devstack sudo[98517]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-da450f65-ea8c-47aa-8d54-789d354af566 tempest-VolumesCloneTest-1869848950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-d4e3fc9c-c4cd-444f-9010-b71478d214b4" returned: 0 in 0.482s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-da450f65-ea8c-47aa-8d54-789d354af566 tempest-VolumesCloneTest-1869848950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-d4e3fc9c-c4cd-444f-9010-b71478d214b4 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:53 devstack sudo[98528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-d4e3fc9c-c4cd-444f-9010-b71478d214b4 Sep 25 11:49:53 devstack sudo[98528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:54 devstack sudo[98523]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e35d0d4c-99eb-4edd-8007-cbd1c191c293 tempest-VolumesCloneNegativeTest-1974123360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-204012f5-079c-40c9-9bfb-f9c9c25f7613" returned: 0 in 0.386s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:54 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e35d0d4c-99eb-4edd-8007-cbd1c191c293 tempest-VolumesCloneNegativeTest-1974123360 None] Lock "cinder-quobyte-204012f5-079c-40c9-9bfb-f9c9c25f7613" released by "delete_volume" :: held 0.986s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:49:54 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-e35d0d4c-99eb-4edd-8007-cbd1c191c293 tempest-VolumesCloneNegativeTest-1974123360 None] Created reservations ['471d4b12-0938-41a9-9c91-0d005e6e97f1', '91d9299a-2529-4efd-9d4f-320143049881', '3025fb93-9784-41d2-858d-d59f568d0894', '99764573-f7fb-4ae1-a835-01e290e46ddf'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:49:54 devstack sudo[98528]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-da450f65-ea8c-47aa-8d54-789d354af566 tempest-VolumesCloneTest-1869848950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-d4e3fc9c-c4cd-444f-9010-b71478d214b4" returned: 0 in 0.422s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-e35d0d4c-99eb-4edd-8007-cbd1c191c293 tempest-VolumesCloneNegativeTest-1974123360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:49:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-e35d0d4c-99eb-4edd-8007-cbd1c191c293 tempest-VolumesCloneNegativeTest-1974123360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:49:54 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-e35d0d4c-99eb-4edd-8007-cbd1c191c293 tempest-VolumesCloneNegativeTest-1974123360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:49:54 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-e35d0d4c-99eb-4edd-8007-cbd1c191c293 tempest-VolumesCloneNegativeTest-1974123360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:49:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-e35d0d4c-99eb-4edd-8007-cbd1c191c293 tempest-VolumesCloneNegativeTest-1974123360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:49:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e35d0d4c-99eb-4edd-8007-cbd1c191c293 tempest-VolumesCloneNegativeTest-1974123360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:54 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-da450f65-ea8c-47aa-8d54-789d354af566 tempest-VolumesCloneTest-1869848950 None] Lock "cinder-quobyte-d4e3fc9c-c4cd-444f-9010-b71478d214b4" released by "delete_volume" :: held 1.051s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:49:54 devstack sudo[98532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:49:54 devstack sudo[98532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:54 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-da450f65-ea8c-47aa-8d54-789d354af566 tempest-VolumesCloneTest-1869848950 None] Created reservations ['27815f22-4d46-466a-810a-6afc8cf1d229', '680c6c70-3b0c-4a28-b012-1ed97a544087', '03a7a8ff-229b-4e44-8ee0-bca20d50da49', '96ba125f-7b46-4c02-bbeb-3f3e95652866'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:49:54 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-9cc0bebb-8d3d-42d3-8a3d-3dc107416289 tempest-VolumesGetTest-1984201126 None] Acquiring lock "cinder-256774d7-285f-44ef-9013-1be6caf2a6a0-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:49:54 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-9cc0bebb-8d3d-42d3-8a3d-3dc107416289 tempest-VolumesGetTest-1984201126 None] Lock "cinder-256774d7-285f-44ef-9013-1be6caf2a6a0-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:49:54 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e9d14049-079d-4512-993e-7de85bdbca47 tempest-VolumeQuotasAdminTestJSON-489380791 None] Acquiring lock "cinder-87a24e90-fb7c-4805-ae65-71e0a9aab9aa-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:49:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-da450f65-ea8c-47aa-8d54-789d354af566 tempest-VolumesCloneTest-1869848950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:49:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-da450f65-ea8c-47aa-8d54-789d354af566 tempest-VolumesCloneTest-1869848950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:49:54 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-da450f65-ea8c-47aa-8d54-789d354af566 tempest-VolumesCloneTest-1869848950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:49:54 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-da450f65-ea8c-47aa-8d54-789d354af566 tempest-VolumesCloneTest-1869848950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:49:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-da450f65-ea8c-47aa-8d54-789d354af566 tempest-VolumesCloneTest-1869848950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:49:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-da450f65-ea8c-47aa-8d54-789d354af566 tempest-VolumesCloneTest-1869848950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:54 devstack sudo[98534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:49:54 devstack sudo[98534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:54 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-9cc0bebb-8d3d-42d3-8a3d-3dc107416289 tempest-VolumesGetTest-1984201126 None] Acquiring lock "cinder-quobyte-256774d7-285f-44ef-9013-1be6caf2a6a0" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:49:54 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e9d14049-079d-4512-993e-7de85bdbca47 tempest-VolumeQuotasAdminTestJSON-489380791 None] Lock "cinder-87a24e90-fb7c-4805-ae65-71e0a9aab9aa-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:49:54 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-9cc0bebb-8d3d-42d3-8a3d-3dc107416289 tempest-VolumesGetTest-1984201126 None] Lock "cinder-quobyte-256774d7-285f-44ef-9013-1be6caf2a6a0" acquired by "delete_volume" :: waited 0.025s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:49:54 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e9d14049-079d-4512-993e-7de85bdbca47 tempest-VolumeQuotasAdminTestJSON-489380791 None] Acquiring lock "cinder-quobyte-87a24e90-fb7c-4805-ae65-71e0a9aab9aa" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:49:54 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[7841cea5-4a07-47b1-9f39-e81cb13e5de6]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:49:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-9cc0bebb-8d3d-42d3-8a3d-3dc107416289 tempest-VolumesGetTest-1984201126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-256774d7-285f-44ef-9013-1be6caf2a6a0 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:54 devstack sudo[98532]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e35d0d4c-99eb-4edd-8007-cbd1c191c293 tempest-VolumesCloneNegativeTest-1974123360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.379s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:54 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-e35d0d4c-99eb-4edd-8007-cbd1c191c293 tempest-VolumesCloneNegativeTest-1974123360 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:49:54 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-e35d0d4c-99eb-4edd-8007-cbd1c191c293 tempest-VolumesCloneNegativeTest-1974123360 None] Deleted volume successfully. Sep 25 11:49:54 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e9d14049-079d-4512-993e-7de85bdbca47 tempest-VolumeQuotasAdminTestJSON-489380791 None] Lock "cinder-quobyte-87a24e90-fb7c-4805-ae65-71e0a9aab9aa" acquired by "delete_volume" :: waited 0.039s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:49:54 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ddd1b96-a962-4cf6-ad32-c8715386ed25]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:49:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e9d14049-079d-4512-993e-7de85bdbca47 tempest-VolumeQuotasAdminTestJSON-489380791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-87a24e90-fb7c-4805-ae65-71e0a9aab9aa {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:54 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e35d0d4c-99eb-4edd-8007-cbd1c191c293 tempest-VolumesCloneNegativeTest-1974123360 None] Lock "cinder-204012f5-079c-40c9-9bfb-f9c9c25f7613-delete_volume" released by "delete_volume" :: held 1.888s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:49:54 devstack sudo[98537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-256774d7-285f-44ef-9013-1be6caf2a6a0 Sep 25 11:49:54 devstack sudo[98537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:54 devstack sudo[98538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-87a24e90-fb7c-4805-ae65-71e0a9aab9aa Sep 25 11:49:54 devstack sudo[98538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:54 devstack sudo[98534]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-da450f65-ea8c-47aa-8d54-789d354af566 tempest-VolumesCloneTest-1869848950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.365s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:54 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-da450f65-ea8c-47aa-8d54-789d354af566 tempest-VolumesCloneTest-1869848950 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:49:54 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-da450f65-ea8c-47aa-8d54-789d354af566 tempest-VolumesCloneTest-1869848950 None] Deleted volume successfully. Sep 25 11:49:54 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-da450f65-ea8c-47aa-8d54-789d354af566 tempest-VolumesCloneTest-1869848950 None] Lock "cinder-d4e3fc9c-c4cd-444f-9010-b71478d214b4-delete_volume" released by "delete_volume" :: held 1.887s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:49:55 devstack sudo[98537]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-9cc0bebb-8d3d-42d3-8a3d-3dc107416289 tempest-VolumesGetTest-1984201126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-256774d7-285f-44ef-9013-1be6caf2a6a0" returned: 0 in 0.445s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-9cc0bebb-8d3d-42d3-8a3d-3dc107416289 tempest-VolumesGetTest-1984201126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-256774d7-285f-44ef-9013-1be6caf2a6a0 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:55 devstack sudo[98547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-256774d7-285f-44ef-9013-1be6caf2a6a0 Sep 25 11:49:55 devstack sudo[98547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:55 devstack sudo[98538]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e9d14049-079d-4512-993e-7de85bdbca47 tempest-VolumeQuotasAdminTestJSON-489380791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-87a24e90-fb7c-4805-ae65-71e0a9aab9aa" returned: 0 in 0.460s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e9d14049-079d-4512-993e-7de85bdbca47 tempest-VolumeQuotasAdminTestJSON-489380791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-87a24e90-fb7c-4805-ae65-71e0a9aab9aa {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:55 devstack sudo[98550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-87a24e90-fb7c-4805-ae65-71e0a9aab9aa Sep 25 11:49:55 devstack sudo[98550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:55 devstack sudo[98547]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-9cc0bebb-8d3d-42d3-8a3d-3dc107416289 tempest-VolumesGetTest-1984201126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-256774d7-285f-44ef-9013-1be6caf2a6a0" returned: 0 in 0.362s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:55 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-9cc0bebb-8d3d-42d3-8a3d-3dc107416289 tempest-VolumesGetTest-1984201126 None] Lock "cinder-quobyte-256774d7-285f-44ef-9013-1be6caf2a6a0" released by "delete_volume" :: held 0.878s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:49:55 devstack sudo[98550]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e9d14049-079d-4512-993e-7de85bdbca47 tempest-VolumeQuotasAdminTestJSON-489380791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-87a24e90-fb7c-4805-ae65-71e0a9aab9aa" returned: 0 in 0.331s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:55 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e9d14049-079d-4512-993e-7de85bdbca47 tempest-VolumeQuotasAdminTestJSON-489380791 None] Lock "cinder-quobyte-87a24e90-fb7c-4805-ae65-71e0a9aab9aa" released by "delete_volume" :: held 0.864s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:49:55 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-9cc0bebb-8d3d-42d3-8a3d-3dc107416289 tempest-VolumesGetTest-1984201126 None] Created reservations ['1abd6335-bee0-4bfc-8804-0dc3cdf1ca6b', '4a88d0ca-6ae0-40d1-859f-82d3293e4f54', '26ab37db-cd0b-41b7-990c-922e958f50e0', 'cc963bc5-22c4-4282-9f5f-4e525be9c158'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:49:55 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-e9d14049-079d-4512-993e-7de85bdbca47 tempest-VolumeQuotasAdminTestJSON-489380791 None] Created reservations ['ea94a997-22e7-4287-b8e5-fdc7c62dd631', '52c4c174-ed70-4cce-accb-34cc39efdcaa', '847cef63-a9e5-44fa-92fe-b1183144c2f4', '94c2b3c6-fbb2-425a-9e8a-baa4ec7a3ff6'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:49:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-9cc0bebb-8d3d-42d3-8a3d-3dc107416289 tempest-VolumesGetTest-1984201126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:49:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-9cc0bebb-8d3d-42d3-8a3d-3dc107416289 tempest-VolumesGetTest-1984201126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:49:55 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-9cc0bebb-8d3d-42d3-8a3d-3dc107416289 tempest-VolumesGetTest-1984201126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:49:55 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-9cc0bebb-8d3d-42d3-8a3d-3dc107416289 tempest-VolumesGetTest-1984201126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:49:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-9cc0bebb-8d3d-42d3-8a3d-3dc107416289 tempest-VolumesGetTest-1984201126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:49:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-9cc0bebb-8d3d-42d3-8a3d-3dc107416289 tempest-VolumesGetTest-1984201126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:55 devstack sudo[98554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:49:55 devstack sudo[98554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-e9d14049-079d-4512-993e-7de85bdbca47 tempest-VolumeQuotasAdminTestJSON-489380791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:49:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-e9d14049-079d-4512-993e-7de85bdbca47 tempest-VolumeQuotasAdminTestJSON-489380791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:49:55 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-e9d14049-079d-4512-993e-7de85bdbca47 tempest-VolumeQuotasAdminTestJSON-489380791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:49:55 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-e9d14049-079d-4512-993e-7de85bdbca47 tempest-VolumeQuotasAdminTestJSON-489380791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:49:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-e9d14049-079d-4512-993e-7de85bdbca47 tempest-VolumeQuotasAdminTestJSON-489380791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:49:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e9d14049-079d-4512-993e-7de85bdbca47 tempest-VolumeQuotasAdminTestJSON-489380791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:55 devstack sudo[98556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:49:55 devstack sudo[98556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:56 devstack sudo[98554]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:56 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-9cc0bebb-8d3d-42d3-8a3d-3dc107416289 tempest-VolumesGetTest-1984201126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.366s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:56 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-9cc0bebb-8d3d-42d3-8a3d-3dc107416289 tempest-VolumesGetTest-1984201126 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:49:56 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-9cc0bebb-8d3d-42d3-8a3d-3dc107416289 tempest-VolumesGetTest-1984201126 None] Deleted volume successfully. Sep 25 11:49:56 devstack sudo[98556]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:56 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e9d14049-079d-4512-993e-7de85bdbca47 tempest-VolumeQuotasAdminTestJSON-489380791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.323s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:56 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-e9d14049-079d-4512-993e-7de85bdbca47 tempest-VolumeQuotasAdminTestJSON-489380791 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:49:56 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-e9d14049-079d-4512-993e-7de85bdbca47 tempest-VolumeQuotasAdminTestJSON-489380791 None] Deleted volume successfully. Sep 25 11:49:56 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-9cc0bebb-8d3d-42d3-8a3d-3dc107416289 tempest-VolumesGetTest-1984201126 None] Lock "cinder-256774d7-285f-44ef-9013-1be6caf2a6a0-delete_volume" released by "delete_volume" :: held 1.747s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:49:56 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e9d14049-079d-4512-993e-7de85bdbca47 tempest-VolumeQuotasAdminTestJSON-489380791 None] Lock "cinder-87a24e90-fb7c-4805-ae65-71e0a9aab9aa-delete_volume" released by "delete_volume" :: held 1.647s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:49:56 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-12fb9349-2d44-403f-928b-7733a8fffe5a tempest-VolumesGetTest-1984201126 None] Acquiring lock "cinder-af6c9c54-3776-4200-93bc-2a8b4f0b7ed0-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:49:56 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-12fb9349-2d44-403f-928b-7733a8fffe5a tempest-VolumesGetTest-1984201126 None] Lock "cinder-af6c9c54-3776-4200-93bc-2a8b4f0b7ed0-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:49:57 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-12fb9349-2d44-403f-928b-7733a8fffe5a tempest-VolumesGetTest-1984201126 None] Acquiring lock "cinder-quobyte-af6c9c54-3776-4200-93bc-2a8b4f0b7ed0" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:49:57 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-12fb9349-2d44-403f-928b-7733a8fffe5a tempest-VolumesGetTest-1984201126 None] Lock "cinder-quobyte-af6c9c54-3776-4200-93bc-2a8b4f0b7ed0" acquired by "delete_volume" :: waited 0.051s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:49:57 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b3408f7-44b1-4118-bf12-8f3b556b1706]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:49:57 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-12fb9349-2d44-403f-928b-7733a8fffe5a tempest-VolumesGetTest-1984201126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-af6c9c54-3776-4200-93bc-2a8b4f0b7ed0 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:57 devstack sudo[98560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-af6c9c54-3776-4200-93bc-2a8b4f0b7ed0 Sep 25 11:49:57 devstack sudo[98560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:57 devstack sudo[98560]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:57 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-12fb9349-2d44-403f-928b-7733a8fffe5a tempest-VolumesGetTest-1984201126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-af6c9c54-3776-4200-93bc-2a8b4f0b7ed0" returned: 0 in 0.745s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:57 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-12fb9349-2d44-403f-928b-7733a8fffe5a tempest-VolumesGetTest-1984201126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-af6c9c54-3776-4200-93bc-2a8b4f0b7ed0 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:57 devstack sudo[98565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-af6c9c54-3776-4200-93bc-2a8b4f0b7ed0 Sep 25 11:49:57 devstack sudo[98565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:58 devstack sudo[98565]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:58 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-12fb9349-2d44-403f-928b-7733a8fffe5a tempest-VolumesGetTest-1984201126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-af6c9c54-3776-4200-93bc-2a8b4f0b7ed0" returned: 0 in 0.445s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:58 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-12fb9349-2d44-403f-928b-7733a8fffe5a tempest-VolumesGetTest-1984201126 None] Lock "cinder-quobyte-af6c9c54-3776-4200-93bc-2a8b4f0b7ed0" released by "delete_volume" :: held 1.286s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:49:58 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-12fb9349-2d44-403f-928b-7733a8fffe5a tempest-VolumesGetTest-1984201126 None] Created reservations ['851966fe-5d50-49ab-861b-432740c66aaa', '4fbdf456-f220-413b-ac6a-96a28d10a6dc', 'd2eb3e48-2974-4203-9978-18bba6a49125', 'f4307195-e136-4658-b4ec-c9c0c65f0bb5'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:49:58 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-12fb9349-2d44-403f-928b-7733a8fffe5a tempest-VolumesGetTest-1984201126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:49:58 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-12fb9349-2d44-403f-928b-7733a8fffe5a tempest-VolumesGetTest-1984201126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:49:58 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-12fb9349-2d44-403f-928b-7733a8fffe5a tempest-VolumesGetTest-1984201126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:49:58 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-12fb9349-2d44-403f-928b-7733a8fffe5a tempest-VolumesGetTest-1984201126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:49:58 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-12fb9349-2d44-403f-928b-7733a8fffe5a tempest-VolumesGetTest-1984201126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:49:58 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-12fb9349-2d44-403f-928b-7733a8fffe5a tempest-VolumesGetTest-1984201126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:58 devstack sudo[98568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:49:58 devstack sudo[98568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:49:59 devstack sudo[98568]: pam_unix(sudo:session): session closed for user root Sep 25 11:49:59 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-12fb9349-2d44-403f-928b-7733a8fffe5a tempest-VolumesGetTest-1984201126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.369s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:49:59 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-12fb9349-2d44-403f-928b-7733a8fffe5a tempest-VolumesGetTest-1984201126 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:49:59 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-12fb9349-2d44-403f-928b-7733a8fffe5a tempest-VolumesGetTest-1984201126 None] Deleted volume successfully. Sep 25 11:49:59 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-12fb9349-2d44-403f-928b-7733a8fffe5a tempest-VolumesGetTest-1984201126 None] Lock "cinder-af6c9c54-3776-4200-93bc-2a8b4f0b7ed0-delete_volume" released by "delete_volume" :: held 2.083s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:49:59 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-504e1acf-c980-4697-8f6c-84318e2a6981 tempest-VolumesGetTest-1984201126 None] Acquiring lock "cinder-c6a05b7d-2488-4b77-9202-0018e6006417-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:49:59 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-504e1acf-c980-4697-8f6c-84318e2a6981 tempest-VolumesGetTest-1984201126 None] Lock "cinder-c6a05b7d-2488-4b77-9202-0018e6006417-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:49:59 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-504e1acf-c980-4697-8f6c-84318e2a6981 tempest-VolumesGetTest-1984201126 None] Acquiring lock "cinder-quobyte-c6a05b7d-2488-4b77-9202-0018e6006417" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:49:59 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-504e1acf-c980-4697-8f6c-84318e2a6981 tempest-VolumesGetTest-1984201126 None] Lock "cinder-quobyte-c6a05b7d-2488-4b77-9202-0018e6006417" acquired by "delete_volume" :: waited 0.037s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:49:59 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ac683e-ee94-4c03-8d3f-d514965eae77]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:49:59 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-504e1acf-c980-4697-8f6c-84318e2a6981 tempest-VolumesGetTest-1984201126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c6a05b7d-2488-4b77-9202-0018e6006417 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:49:59 devstack sudo[98571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c6a05b7d-2488-4b77-9202-0018e6006417 Sep 25 11:49:59 devstack sudo[98571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:00 devstack sudo[98571]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:00 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-504e1acf-c980-4697-8f6c-84318e2a6981 tempest-VolumesGetTest-1984201126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c6a05b7d-2488-4b77-9202-0018e6006417" returned: 0 in 0.672s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:00 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-504e1acf-c980-4697-8f6c-84318e2a6981 tempest-VolumesGetTest-1984201126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c6a05b7d-2488-4b77-9202-0018e6006417 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:00 devstack sudo[98576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c6a05b7d-2488-4b77-9202-0018e6006417 Sep 25 11:50:00 devstack sudo[98576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:00 devstack sudo[98576]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:00 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-504e1acf-c980-4697-8f6c-84318e2a6981 tempest-VolumesGetTest-1984201126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c6a05b7d-2488-4b77-9202-0018e6006417" returned: 0 in 0.425s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:00 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-504e1acf-c980-4697-8f6c-84318e2a6981 tempest-VolumesGetTest-1984201126 None] Lock "cinder-quobyte-c6a05b7d-2488-4b77-9202-0018e6006417" released by "delete_volume" :: held 1.206s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:50:00 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-504e1acf-c980-4697-8f6c-84318e2a6981 tempest-VolumesGetTest-1984201126 None] Created reservations ['265a10e7-689d-4731-9d32-09f0a04df0a0', 'b29cb656-a466-4376-8371-1d8d6325a6f4', '3bb238f9-e90b-42a1-8d0f-bba7496b666d', '607876db-96b3-44fb-a3bb-d05f169d98c4'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:50:01 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-504e1acf-c980-4697-8f6c-84318e2a6981 tempest-VolumesGetTest-1984201126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:50:01 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-504e1acf-c980-4697-8f6c-84318e2a6981 tempest-VolumesGetTest-1984201126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:50:01 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-504e1acf-c980-4697-8f6c-84318e2a6981 tempest-VolumesGetTest-1984201126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:50:01 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-504e1acf-c980-4697-8f6c-84318e2a6981 tempest-VolumesGetTest-1984201126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:50:01 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-504e1acf-c980-4697-8f6c-84318e2a6981 tempest-VolumesGetTest-1984201126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:50:01 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-504e1acf-c980-4697-8f6c-84318e2a6981 tempest-VolumesGetTest-1984201126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:01 devstack sudo[98579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:50:01 devstack sudo[98579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:01 devstack sudo[98579]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:01 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-504e1acf-c980-4697-8f6c-84318e2a6981 tempest-VolumesGetTest-1984201126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.428s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:01 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-504e1acf-c980-4697-8f6c-84318e2a6981 tempest-VolumesGetTest-1984201126 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:50:01 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-504e1acf-c980-4697-8f6c-84318e2a6981 tempest-VolumesGetTest-1984201126 None] Deleted volume successfully. Sep 25 11:50:01 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-504e1acf-c980-4697-8f6c-84318e2a6981 tempest-VolumesGetTest-1984201126 None] Lock "cinder-c6a05b7d-2488-4b77-9202-0018e6006417-delete_volume" released by "delete_volume" :: held 2.083s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:50:03 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e1ddc5e-a426-4591-8ee4-8d24756c0fc7 tempest-VolumesGetTest-1984201126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:50:03 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3e1ddc5e-a426-4591-8ee4-8d24756c0fc7 tempest-VolumesGetTest-1984201126 None] Flow 'volume_create_manager' (362a5c58-df4b-4337-97c9-72edd372ab92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:50:03 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3e1ddc5e-a426-4591-8ee4-8d24756c0fc7 tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c94ebe1-dafe-4bc6-8f7d-8b516415b263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:50:03 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3e1ddc5e-a426-4591-8ee4-8d24756c0fc7 tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c94ebe1-dafe-4bc6-8f7d-8b516415b263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:50:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-73545110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c54c2a7e-520f-42bb-9ebe-177934e134d6,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1f6a1c00cee34650b3106442f2443249',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:50:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:50:03Z,use_quota=True,user_id='0b750a9ac0d643ab979b6125b2297eb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:50:03 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3e1ddc5e-a426-4591-8ee4-8d24756c0fc7 tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1447d18d-0cbc-4686-ad86-bbe4fb3110d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:50:03 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3e1ddc5e-a426-4591-8ee4-8d24756c0fc7 tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1447d18d-0cbc-4686-ad86-bbe4fb3110d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:50:03 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3e1ddc5e-a426-4591-8ee4-8d24756c0fc7 tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95f74e7d-dfb9-4470-92ab-097dcfc7e150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:50:03 devstack cinder-volume[86984]: DEBUG cinder.image.glance [None req-3e1ddc5e-a426-4591-8ee4-8d24756c0fc7 tempest-VolumesGetTest-1984201126 None] Creating Keystone auth plugin from conf {{(pid=86984) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 11:50:04 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf05be36-2c8f-4116-a479-645ab4d5add3 tempest-VolumesExtendTest-1555024739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:50:04 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cf05be36-2c8f-4116-a479-645ab4d5add3 tempest-VolumesExtendTest-1555024739 None] Flow 'volume_create_manager' (d22cf98a-5f03-402d-acb8-c860c03a5560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:50:04 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cf05be36-2c8f-4116-a479-645ab4d5add3 tempest-VolumesExtendTest-1555024739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8edc5356-5cba-4dbf-b565-3e102854ed69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:50:04 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3e1ddc5e-a426-4591-8ee4-8d24756c0fc7 tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95f74e7d-dfb9-4470-92ab-097dcfc7e150) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c54c2a7e-520f-42bb-9ebe-177934e134d6', 'volume_name': 'volume-c54c2a7e-520f-42bb-9ebe-177934e134d6', 'volume_size': 1, 'image_id': 'd93b0aa8-e297-4aff-bb90-fe80872f8b63', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d93b0aa8-e297-4aff-bb90-fe80872f8b63', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a57d184bdf174982a6b60117d6d4a5b4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd93b0aa8-e297-4aff-bb90-fe80872f8b63', 'created_at': datetime.datetime(2026, 9, 25, 9, 31, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 31, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d93b0aa8-e297-4aff-bb90-fe80872f8b63/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:50:04 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3e1ddc5e-a426-4591-8ee4-8d24756c0fc7 tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d79d74b-d9f7-433b-b010-ee0c00dd4b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:50:04 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3e1ddc5e-a426-4591-8ee4-8d24756c0fc7 tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d79d74b-d9f7-433b-b010-ee0c00dd4b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:50:04 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3e1ddc5e-a426-4591-8ee4-8d24756c0fc7 tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3bb8137-fbeb-41e1-a4e8-cd89cb36f695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:50:04 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-3e1ddc5e-a426-4591-8ee4-8d24756c0fc7 tempest-VolumesGetTest-1984201126 None] Volume c54c2a7e-520f-42bb-9ebe-177934e134d6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c54c2a7e-520f-42bb-9ebe-177934e134d6', 'volume_size': 1, 'image_id': 'd93b0aa8-e297-4aff-bb90-fe80872f8b63', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d93b0aa8-e297-4aff-bb90-fe80872f8b63', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a57d184bdf174982a6b60117d6d4a5b4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd93b0aa8-e297-4aff-bb90-fe80872f8b63', 'created_at': datetime.datetime(2026, 9, 25, 9, 31, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 31, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d93b0aa8-e297-4aff-bb90-fe80872f8b63/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 25 11:50:04 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e1ddc5e-a426-4591-8ee4-8d24756c0fc7 tempest-VolumesGetTest-1984201126 None] Trying to clone c54c2a7e-520f-42bb-9ebe-177934e134d6 from image d93b0aa8-e297-4aff-bb90-fe80872f8b63 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d93b0aa8-e297-4aff-bb90-fe80872f8b63', 'metadata': {}}]). {{(pid=86984) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 11:50:04 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cf05be36-2c8f-4116-a479-645ab4d5add3 tempest-VolumesExtendTest-1555024739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8edc5356-5cba-4dbf-b565-3e102854ed69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:50:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-267663630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa53a6f2-b200-4b80-a5c7-e69d2c43f3d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e8c0b73a2394f83b9a33ce4fc7d5647',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:50:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:50:04Z,use_quota=True,user_id='eec8353da35845d58105e31890f1f7c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:50:04 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cf05be36-2c8f-4116-a479-645ab4d5add3 tempest-VolumesExtendTest-1555024739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfc13700-c45f-4f37-b45c-5b9bd8e61f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:50:04 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cf05be36-2c8f-4116-a479-645ab4d5add3 tempest-VolumesExtendTest-1555024739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfc13700-c45f-4f37-b45c-5b9bd8e61f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:50:04 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cf05be36-2c8f-4116-a479-645ab4d5add3 tempest-VolumesExtendTest-1555024739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb4e1602-f9c8-49fd-aafa-14aafb41504c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:50:04 devstack cinder-volume[86984]: DEBUG cinder.image.glance [None req-cf05be36-2c8f-4116-a479-645ab4d5add3 tempest-VolumesExtendTest-1555024739 None] Creating Keystone auth plugin from conf {{(pid=86984) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 11:50:04 devstack cinder-volume[86984]: DEBUG cinder.image.image_utils [None req-3e1ddc5e-a426-4591-8ee4-8d24756c0fc7 tempest-VolumesGetTest-1984201126 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d93b0aa8-e297-4aff-bb90-fe80872f8b63_39hem8acdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86984) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 11:50:04 devstack cinder-volume[86984]: INFO cinder.image.image_utils [None req-3e1ddc5e-a426-4591-8ee4-8d24756c0fc7 tempest-VolumesGetTest-1984201126 None] Image download 20.69 MB at 20.69 MB/s Sep 25 11:50:04 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[87bb21a8-d36e-4727-bc79-8c22ae38d9c0]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:50:04 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3e1ddc5e-a426-4591-8ee4-8d24756c0fc7 tempest-VolumesGetTest-1984201126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d93b0aa8-e297-4aff-bb90-fe80872f8b63_39hem8acdevstack@QuobyteHD {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:05 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cf05be36-2c8f-4116-a479-645ab4d5add3 tempest-VolumesExtendTest-1555024739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb4e1602-f9c8-49fd-aafa-14aafb41504c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'aa53a6f2-b200-4b80-a5c7-e69d2c43f3d4', 'volume_name': 'volume-aa53a6f2-b200-4b80-a5c7-e69d2c43f3d4', 'volume_size': 1, 'image_id': 'd93b0aa8-e297-4aff-bb90-fe80872f8b63', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d93b0aa8-e297-4aff-bb90-fe80872f8b63', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a57d184bdf174982a6b60117d6d4a5b4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd93b0aa8-e297-4aff-bb90-fe80872f8b63', 'created_at': datetime.datetime(2026, 9, 25, 9, 31, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 31, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d93b0aa8-e297-4aff-bb90-fe80872f8b63/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:50:05 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cf05be36-2c8f-4116-a479-645ab4d5add3 tempest-VolumesExtendTest-1555024739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9f0137d-28b4-4d1a-9541-0be98713d7ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:50:05 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cf05be36-2c8f-4116-a479-645ab4d5add3 tempest-VolumesExtendTest-1555024739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9f0137d-28b4-4d1a-9541-0be98713d7ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:50:05 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cf05be36-2c8f-4116-a479-645ab4d5add3 tempest-VolumesExtendTest-1555024739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fa6c98a-59d2-4b52-96a4-e4ce9eba621c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:50:05 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-cf05be36-2c8f-4116-a479-645ab4d5add3 tempest-VolumesExtendTest-1555024739 None] Volume aa53a6f2-b200-4b80-a5c7-e69d2c43f3d4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-aa53a6f2-b200-4b80-a5c7-e69d2c43f3d4', 'volume_size': 1, 'image_id': 'd93b0aa8-e297-4aff-bb90-fe80872f8b63', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d93b0aa8-e297-4aff-bb90-fe80872f8b63', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a57d184bdf174982a6b60117d6d4a5b4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd93b0aa8-e297-4aff-bb90-fe80872f8b63', 'created_at': datetime.datetime(2026, 9, 25, 9, 31, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 31, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d93b0aa8-e297-4aff-bb90-fe80872f8b63/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 25 11:50:05 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf05be36-2c8f-4116-a479-645ab4d5add3 tempest-VolumesExtendTest-1555024739 None] Trying to clone aa53a6f2-b200-4b80-a5c7-e69d2c43f3d4 from image d93b0aa8-e297-4aff-bb90-fe80872f8b63 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d93b0aa8-e297-4aff-bb90-fe80872f8b63', 'metadata': {}}]). {{(pid=86984) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 11:50:05 devstack sudo[98584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d93b0aa8-e297-4aff-bb90-fe80872f8b63_39hem8acdevstack@QuobyteHD Sep 25 11:50:05 devstack sudo[98584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:05 devstack sudo[98584]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3e1ddc5e-a426-4591-8ee4-8d24756c0fc7 tempest-VolumesGetTest-1984201126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d93b0aa8-e297-4aff-bb90-fe80872f8b63_39hem8acdevstack@QuobyteHD" returned: 0 in 0.676s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:05 devstack cinder-volume[86984]: DEBUG cinder.image.image_utils [None req-3e1ddc5e-a426-4591-8ee4-8d24756c0fc7 tempest-VolumesGetTest-1984201126 None] Temporary image d93b0aa8-e297-4aff-bb90-fe80872f8b63 is fetched for user 0b750a9ac0d643ab979b6125b2297eb3. {{(pid=86984) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 11:50:05 devstack cinder-volume[86984]: DEBUG cinder.image.image_utils [None req-cf05be36-2c8f-4116-a479-645ab4d5add3 tempest-VolumesExtendTest-1555024739 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d93b0aa8-e297-4aff-bb90-fe80872f8b63_rx1uj36ddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86984) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 11:50:05 devstack cinder-volume[86984]: INFO cinder.image.image_utils [None req-cf05be36-2c8f-4116-a479-645ab4d5add3 tempest-VolumesExtendTest-1555024739 None] Image download 20.69 MB at 20.69 MB/s Sep 25 11:50:05 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[105318d0-aae7-4a0c-aef1-9f2fe3e67f0d]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:50:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cf05be36-2c8f-4116-a479-645ab4d5add3 tempest-VolumesExtendTest-1555024739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d93b0aa8-e297-4aff-bb90-fe80872f8b63_rx1uj36ddevstack@QuobyteHD {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:05 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[7702a925-21c5-4c40-8432-fade7587b200]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:50:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3e1ddc5e-a426-4591-8ee4-8d24756c0fc7 tempest-VolumesGetTest-1984201126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d93b0aa8-e297-4aff-bb90-fe80872f8b63_39hem8acdevstack@QuobyteHD {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:05 devstack sudo[98593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d93b0aa8-e297-4aff-bb90-fe80872f8b63_rx1uj36ddevstack@QuobyteHD Sep 25 11:50:05 devstack sudo[98593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:05 devstack sudo[98594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d93b0aa8-e297-4aff-bb90-fe80872f8b63_39hem8acdevstack@QuobyteHD Sep 25 11:50:05 devstack sudo[98594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:06 devstack sudo[98593]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cf05be36-2c8f-4116-a479-645ab4d5add3 tempest-VolumesExtendTest-1555024739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d93b0aa8-e297-4aff-bb90-fe80872f8b63_rx1uj36ddevstack@QuobyteHD" returned: 0 in 0.452s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:06 devstack cinder-volume[86984]: DEBUG cinder.image.image_utils [None req-cf05be36-2c8f-4116-a479-645ab4d5add3 tempest-VolumesExtendTest-1555024739 None] Temporary image d93b0aa8-e297-4aff-bb90-fe80872f8b63 is fetched for user eec8353da35845d58105e31890f1f7c6. {{(pid=86984) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 11:50:06 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[7447b926-0a51-4877-8006-b48b219eb842]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:50:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cf05be36-2c8f-4116-a479-645ab4d5add3 tempest-VolumesExtendTest-1555024739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d93b0aa8-e297-4aff-bb90-fe80872f8b63_rx1uj36ddevstack@QuobyteHD {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:06 devstack sudo[98594]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3e1ddc5e-a426-4591-8ee4-8d24756c0fc7 tempest-VolumesGetTest-1984201126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d93b0aa8-e297-4aff-bb90-fe80872f8b63_39hem8acdevstack@QuobyteHD" returned: 0 in 0.626s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3e1ddc5e-a426-4591-8ee4-8d24756c0fc7 tempest-VolumesGetTest-1984201126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:50:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3e1ddc5e-a426-4591-8ee4-8d24756c0fc7 tempest-VolumesGetTest-1984201126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:50:06 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3e1ddc5e-a426-4591-8ee4-8d24756c0fc7 tempest-VolumesGetTest-1984201126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:50:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-73545110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c54c2a7e-520f-42bb-9ebe-177934e134d6,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1f6a1c00cee34650b3106442f2443249',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:50:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:50:03Z,use_quota=True,user_id='0b750a9ac0d643ab979b6125b2297eb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:50:06 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-3e1ddc5e-a426-4591-8ee4-8d24756c0fc7 tempest-VolumesGetTest-1984201126 None] Creating volume c54c2a7e-520f-42bb-9ebe-177934e134d6 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:50:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3e1ddc5e-a426-4591-8ee4-8d24756c0fc7 tempest-VolumesGetTest-1984201126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:50:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3e1ddc5e-a426-4591-8ee4-8d24756c0fc7 tempest-VolumesGetTest-1984201126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:50:06 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3e1ddc5e-a426-4591-8ee4-8d24756c0fc7 tempest-VolumesGetTest-1984201126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:50:06 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3e1ddc5e-a426-4591-8ee4-8d24756c0fc7 tempest-VolumesGetTest-1984201126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:50:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3e1ddc5e-a426-4591-8ee4-8d24756c0fc7 tempest-VolumesGetTest-1984201126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:50:06 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3e1ddc5e-a426-4591-8ee4-8d24756c0fc7 tempest-VolumesGetTest-1984201126 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:50:06 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-3e1ddc5e-a426-4591-8ee4-8d24756c0fc7 tempest-VolumesGetTest-1984201126 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:50:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3e1ddc5e-a426-4591-8ee4-8d24756c0fc7 tempest-VolumesGetTest-1984201126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c54c2a7e-520f-42bb-9ebe-177934e134d6 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:06 devstack sudo[98605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c54c2a7e-520f-42bb-9ebe-177934e134d6 1073741824 Sep 25 11:50:06 devstack sudo[98605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:06 devstack sudo[98604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d93b0aa8-e297-4aff-bb90-fe80872f8b63_rx1uj36ddevstack@QuobyteHD Sep 25 11:50:06 devstack sudo[98604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:06 devstack sudo[98604]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cf05be36-2c8f-4116-a479-645ab4d5add3 tempest-VolumesExtendTest-1555024739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d93b0aa8-e297-4aff-bb90-fe80872f8b63_rx1uj36ddevstack@QuobyteHD" returned: 0 in 0.530s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-cf05be36-2c8f-4116-a479-645ab4d5add3 tempest-VolumesExtendTest-1555024739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:50:07 devstack sudo[98605]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3e1ddc5e-a426-4591-8ee4-8d24756c0fc7 tempest-VolumesGetTest-1984201126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c54c2a7e-520f-42bb-9ebe-177934e134d6 1073741824" returned: 0 in 0.751s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3e1ddc5e-a426-4591-8ee4-8d24756c0fc7 tempest-VolumesGetTest-1984201126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c54c2a7e-520f-42bb-9ebe-177934e134d6 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:07 devstack sudo[98617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c54c2a7e-520f-42bb-9ebe-177934e134d6 Sep 25 11:50:07 devstack sudo[98617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:07 devstack sudo[98617]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3e1ddc5e-a426-4591-8ee4-8d24756c0fc7 tempest-VolumesGetTest-1984201126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c54c2a7e-520f-42bb-9ebe-177934e134d6" returned: 0 in 0.430s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:07 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3e1ddc5e-a426-4591-8ee4-8d24756c0fc7 tempest-VolumesGetTest-1984201126 None] <== create_volume: return (1292ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:50:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3e1ddc5e-a426-4591-8ee4-8d24756c0fc7 tempest-VolumesGetTest-1984201126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.297s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:50:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-cf05be36-2c8f-4116-a479-645ab4d5add3 tempest-VolumesExtendTest-1555024739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.805s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:50:07 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-cf05be36-2c8f-4116-a479-645ab4d5add3 tempest-VolumesExtendTest-1555024739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:50:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-267663630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa53a6f2-b200-4b80-a5c7-e69d2c43f3d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e8c0b73a2394f83b9a33ce4fc7d5647',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:50:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:50:04Z,use_quota=True,user_id='eec8353da35845d58105e31890f1f7c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:50:07 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-cf05be36-2c8f-4116-a479-645ab4d5add3 tempest-VolumesExtendTest-1555024739 None] Creating volume aa53a6f2-b200-4b80-a5c7-e69d2c43f3d4 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:50:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-cf05be36-2c8f-4116-a479-645ab4d5add3 tempest-VolumesExtendTest-1555024739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:50:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-cf05be36-2c8f-4116-a479-645ab4d5add3 tempest-VolumesExtendTest-1555024739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:50:07 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-cf05be36-2c8f-4116-a479-645ab4d5add3 tempest-VolumesExtendTest-1555024739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:50:07 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-cf05be36-2c8f-4116-a479-645ab4d5add3 tempest-VolumesExtendTest-1555024739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:50:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-cf05be36-2c8f-4116-a479-645ab4d5add3 tempest-VolumesExtendTest-1555024739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:50:07 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-cf05be36-2c8f-4116-a479-645ab4d5add3 tempest-VolumesExtendTest-1555024739 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:50:07 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-cf05be36-2c8f-4116-a479-645ab4d5add3 tempest-VolumesExtendTest-1555024739 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:50:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cf05be36-2c8f-4116-a479-645ab4d5add3 tempest-VolumesExtendTest-1555024739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aa53a6f2-b200-4b80-a5c7-e69d2c43f3d4 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:07 devstack sudo[98620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aa53a6f2-b200-4b80-a5c7-e69d2c43f3d4 1073741824 Sep 25 11:50:07 devstack sudo[98620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:07 devstack cinder-volume[86984]: DEBUG cinder.volume.volume_utils [None req-3e1ddc5e-a426-4591-8ee4-8d24756c0fc7 tempest-VolumesGetTest-1984201126 None] Attempting download of d93b0aa8-e297-4aff-bb90-fe80872f8b63 ((None, [{'url': 'file:///opt/stack/data/glance/images/d93b0aa8-e297-4aff-bb90-fe80872f8b63', 'metadata': {}}])) to volume c54c2a7e-520f-42bb-9ebe-177934e134d6. {{(pid=86984) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 11:50:07 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e26a862-2229-4cbd-95b4-0584710fbb00]: (4, 'raw') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:50:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3e1ddc5e-a426-4591-8ee4-8d24756c0fc7 tempest-VolumesGetTest-1984201126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d93b0aa8-e297-4aff-bb90-fe80872f8b63_iq75uhdo {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:08 devstack sudo[98622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d93b0aa8-e297-4aff-bb90-fe80872f8b63_iq75uhdo Sep 25 11:50:08 devstack sudo[98622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:08 devstack sudo[98622]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3e1ddc5e-a426-4591-8ee4-8d24756c0fc7 tempest-VolumesGetTest-1984201126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d93b0aa8-e297-4aff-bb90-fe80872f8b63_iq75uhdo" returned: 0 in 0.557s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3e1ddc5e-a426-4591-8ee4-8d24756c0fc7 tempest-VolumesGetTest-1984201126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d93b0aa8-e297-4aff-bb90-fe80872f8b63_iq75uhdo {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:08 devstack sudo[98629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d93b0aa8-e297-4aff-bb90-fe80872f8b63_iq75uhdo Sep 25 11:50:08 devstack sudo[98629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:08 devstack sudo[98620]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cf05be36-2c8f-4116-a479-645ab4d5add3 tempest-VolumesExtendTest-1555024739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aa53a6f2-b200-4b80-a5c7-e69d2c43f3d4 1073741824" returned: 0 in 0.992s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cf05be36-2c8f-4116-a479-645ab4d5add3 tempest-VolumesExtendTest-1555024739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aa53a6f2-b200-4b80-a5c7-e69d2c43f3d4 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:08 devstack sudo[98631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aa53a6f2-b200-4b80-a5c7-e69d2c43f3d4 Sep 25 11:50:08 devstack sudo[98631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:09 devstack sudo[98629]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3e1ddc5e-a426-4591-8ee4-8d24756c0fc7 tempest-VolumesGetTest-1984201126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d93b0aa8-e297-4aff-bb90-fe80872f8b63_iq75uhdo" returned: 1 in 0.692s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3e1ddc5e-a426-4591-8ee4-8d24756c0fc7 tempest-VolumesGetTest-1984201126 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d93b0aa8-e297-4aff-bb90-fe80872f8b63_iq75uhdo' failed. Not Retrying. {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 11:50:09 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2484643-7f86-4983-a8d0-eee6a2a7dd5e]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:50:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3e1ddc5e-a426-4591-8ee4-8d24756c0fc7 tempest-VolumesGetTest-1984201126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d93b0aa8-e297-4aff-bb90-fe80872f8b63_39hem8acdevstack@QuobyteHD {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:09 devstack sudo[98631]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cf05be36-2c8f-4116-a479-645ab4d5add3 tempest-VolumesExtendTest-1555024739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aa53a6f2-b200-4b80-a5c7-e69d2c43f3d4" returned: 0 in 0.393s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:09 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-cf05be36-2c8f-4116-a479-645ab4d5add3 tempest-VolumesExtendTest-1555024739 None] <== create_volume: return (1493ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:50:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-cf05be36-2c8f-4116-a479-645ab4d5add3 tempest-VolumesExtendTest-1555024739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.500s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:50:09 devstack cinder-volume[86984]: DEBUG cinder.volume.volume_utils [None req-cf05be36-2c8f-4116-a479-645ab4d5add3 tempest-VolumesExtendTest-1555024739 None] Attempting download of d93b0aa8-e297-4aff-bb90-fe80872f8b63 ((None, [{'url': 'file:///opt/stack/data/glance/images/d93b0aa8-e297-4aff-bb90-fe80872f8b63', 'metadata': {}}])) to volume aa53a6f2-b200-4b80-a5c7-e69d2c43f3d4. {{(pid=86984) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 11:50:09 devstack sudo[98636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d93b0aa8-e297-4aff-bb90-fe80872f8b63_39hem8acdevstack@QuobyteHD Sep 25 11:50:09 devstack sudo[98636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:09 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[f97a50cb-f41f-4ed9-bf0d-a293db6d2c8b]: (4, 'raw') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:50:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cf05be36-2c8f-4116-a479-645ab4d5add3 tempest-VolumesExtendTest-1555024739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d93b0aa8-e297-4aff-bb90-fe80872f8b63_0wj4_ewt {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:09 devstack sudo[98638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d93b0aa8-e297-4aff-bb90-fe80872f8b63_0wj4_ewt Sep 25 11:50:09 devstack sudo[98638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:09 devstack sudo[98636]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3e1ddc5e-a426-4591-8ee4-8d24756c0fc7 tempest-VolumesGetTest-1984201126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d93b0aa8-e297-4aff-bb90-fe80872f8b63_39hem8acdevstack@QuobyteHD" returned: 0 in 0.672s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:09 devstack cinder-volume[86984]: DEBUG cinder.image.image_utils [None req-3e1ddc5e-a426-4591-8ee4-8d24756c0fc7 tempest-VolumesGetTest-1984201126 None] d93b0aa8-e297-4aff-bb90-fe80872f8b63 was qcow2, converting to qcow2 {{(pid=86984) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 11:50:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3e1ddc5e-a426-4591-8ee4-8d24756c0fc7 tempest-VolumesGetTest-1984201126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d93b0aa8-e297-4aff-bb90-fe80872f8b63_39hem8acdevstack@QuobyteHD /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c54c2a7e-520f-42bb-9ebe-177934e134d6 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:09 devstack sudo[98643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d93b0aa8-e297-4aff-bb90-fe80872f8b63_39hem8acdevstack@QuobyteHD /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c54c2a7e-520f-42bb-9ebe-177934e134d6 Sep 25 11:50:09 devstack sudo[98643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:09 devstack sudo[98638]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cf05be36-2c8f-4116-a479-645ab4d5add3 tempest-VolumesExtendTest-1555024739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d93b0aa8-e297-4aff-bb90-fe80872f8b63_0wj4_ewt" returned: 0 in 0.556s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cf05be36-2c8f-4116-a479-645ab4d5add3 tempest-VolumesExtendTest-1555024739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d93b0aa8-e297-4aff-bb90-fe80872f8b63_0wj4_ewt {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:10 devstack sudo[98647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d93b0aa8-e297-4aff-bb90-fe80872f8b63_0wj4_ewt Sep 25 11:50:10 devstack sudo[98647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:10 devstack sudo[98647]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cf05be36-2c8f-4116-a479-645ab4d5add3 tempest-VolumesExtendTest-1555024739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d93b0aa8-e297-4aff-bb90-fe80872f8b63_0wj4_ewt" returned: 1 in 0.754s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cf05be36-2c8f-4116-a479-645ab4d5add3 tempest-VolumesExtendTest-1555024739 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d93b0aa8-e297-4aff-bb90-fe80872f8b63_0wj4_ewt' failed. Not Retrying. {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 11:50:10 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1cacf6-5013-45fc-92bb-7c38b0b0845f]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:50:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cf05be36-2c8f-4116-a479-645ab4d5add3 tempest-VolumesExtendTest-1555024739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d93b0aa8-e297-4aff-bb90-fe80872f8b63_rx1uj36ddevstack@QuobyteHD {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:11 devstack sudo[98656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d93b0aa8-e297-4aff-bb90-fe80872f8b63_rx1uj36ddevstack@QuobyteHD Sep 25 11:50:11 devstack sudo[98656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:11 devstack sudo[98656]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cf05be36-2c8f-4116-a479-645ab4d5add3 tempest-VolumesExtendTest-1555024739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d93b0aa8-e297-4aff-bb90-fe80872f8b63_rx1uj36ddevstack@QuobyteHD" returned: 0 in 0.624s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:11 devstack cinder-volume[86984]: DEBUG cinder.image.image_utils [None req-cf05be36-2c8f-4116-a479-645ab4d5add3 tempest-VolumesExtendTest-1555024739 None] d93b0aa8-e297-4aff-bb90-fe80872f8b63 was qcow2, converting to qcow2 {{(pid=86984) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 11:50:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cf05be36-2c8f-4116-a479-645ab4d5add3 tempest-VolumesExtendTest-1555024739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d93b0aa8-e297-4aff-bb90-fe80872f8b63_rx1uj36ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aa53a6f2-b200-4b80-a5c7-e69d2c43f3d4 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:11 devstack sudo[98662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d93b0aa8-e297-4aff-bb90-fe80872f8b63_rx1uj36ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aa53a6f2-b200-4b80-a5c7-e69d2c43f3d4 Sep 25 11:50:11 devstack sudo[98662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:13 devstack sudo[98643]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:13 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3e1ddc5e-a426-4591-8ee4-8d24756c0fc7 tempest-VolumesGetTest-1984201126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d93b0aa8-e297-4aff-bb90-fe80872f8b63_39hem8acdevstack@QuobyteHD /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c54c2a7e-520f-42bb-9ebe-177934e134d6" returned: 0 in 3.260s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:13 devstack cinder-volume[86984]: DEBUG cinder.image.image_utils [None req-3e1ddc5e-a426-4591-8ee4-8d24756c0fc7 tempest-VolumesGetTest-1984201126 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d93b0aa8-e297-4aff-bb90-fe80872f8b63_39hem8acdevstack@QuobyteHD, size 112.00 MB, duration 3.26 sec, destination /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c54c2a7e-520f-42bb-9ebe-177934e134d6 {{(pid=86984) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 11:50:13 devstack cinder-volume[86984]: INFO cinder.image.image_utils [None req-3e1ddc5e-a426-4591-8ee4-8d24756c0fc7 tempest-VolumesGetTest-1984201126 None] Converted 112.00 MB image at 34.33 MB/s Sep 25 11:50:13 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3e1ddc5e-a426-4591-8ee4-8d24756c0fc7 tempest-VolumesGetTest-1984201126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c54c2a7e-520f-42bb-9ebe-177934e134d6 1G {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:13 devstack sudo[98669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c54c2a7e-520f-42bb-9ebe-177934e134d6 1G Sep 25 11:50:13 devstack sudo[98669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:13 devstack sudo[98669]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:13 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3e1ddc5e-a426-4591-8ee4-8d24756c0fc7 tempest-VolumesGetTest-1984201126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c54c2a7e-520f-42bb-9ebe-177934e134d6 1G" returned: 0 in 0.576s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:13 devstack cinder-volume[86984]: DEBUG cinder.volume.volume_utils [None req-3e1ddc5e-a426-4591-8ee4-8d24756c0fc7 tempest-VolumesGetTest-1984201126 None] Downloaded image d93b0aa8-e297-4aff-bb90-fe80872f8b63 ((None, [{'url': 'file:///opt/stack/data/glance/images/d93b0aa8-e297-4aff-bb90-fe80872f8b63', 'metadata': {}}])) to volume c54c2a7e-520f-42bb-9ebe-177934e134d6 successfully. {{(pid=86984) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 11:50:13 devstack cinder-volume[86984]: DEBUG cinder.image.image_utils [None req-3e1ddc5e-a426-4591-8ee4-8d24756c0fc7 tempest-VolumesGetTest-1984201126 None] Temporary image d93b0aa8-e297-4aff-bb90-fe80872f8b63 for user 0b750a9ac0d643ab979b6125b2297eb3 is deleted. {{(pid=86984) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 11:50:13 devstack cinder-volume[86984]: DEBUG cinder.volume.volume_utils [None req-3e1ddc5e-a426-4591-8ee4-8d24756c0fc7 tempest-VolumesGetTest-1984201126 None] Marking volume c54c2a7e-520f-42bb-9ebe-177934e134d6 as bootable. {{(pid=86984) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 11:50:13 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e1ddc5e-a426-4591-8ee4-8d24756c0fc7 tempest-VolumesGetTest-1984201126 None] Copying metadata from image d93b0aa8-e297-4aff-bb90-fe80872f8b63 to c54c2a7e-520f-42bb-9ebe-177934e134d6. {{(pid=86984) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 11:50:13 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e1ddc5e-a426-4591-8ee4-8d24756c0fc7 tempest-VolumesGetTest-1984201126 None] Creating volume glance metadata for volume c54c2a7e-520f-42bb-9ebe-177934e134d6 backed by image d93b0aa8-e297-4aff-bb90-fe80872f8b63 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd93b0aa8-e297-4aff-bb90-fe80872f8b63', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86984) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 11:50:13 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3e1ddc5e-a426-4591-8ee4-8d24756c0fc7 tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3bb8137-fbeb-41e1-a4e8-cd89cb36f695) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c54c2a7e-520f-42bb-9ebe-177934e134d6', 'volume_size': 1, 'image_id': 'd93b0aa8-e297-4aff-bb90-fe80872f8b63', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d93b0aa8-e297-4aff-bb90-fe80872f8b63', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a57d184bdf174982a6b60117d6d4a5b4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd93b0aa8-e297-4aff-bb90-fe80872f8b63', 'created_at': datetime.datetime(2026, 9, 25, 9, 31, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 31, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d93b0aa8-e297-4aff-bb90-fe80872f8b63/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:50:13 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3e1ddc5e-a426-4591-8ee4-8d24756c0fc7 tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b8ccc92-d7f0-419b-884f-0eafd4cd1fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:50:13 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-3e1ddc5e-a426-4591-8ee4-8d24756c0fc7 tempest-VolumesGetTest-1984201126 None] Volume volume-c54c2a7e-520f-42bb-9ebe-177934e134d6 (c54c2a7e-520f-42bb-9ebe-177934e134d6): created successfully Sep 25 11:50:13 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3e1ddc5e-a426-4591-8ee4-8d24756c0fc7 tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b8ccc92-d7f0-419b-884f-0eafd4cd1fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:50:13 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3e1ddc5e-a426-4591-8ee4-8d24756c0fc7 tempest-VolumesGetTest-1984201126 None] Flow 'volume_create_manager' (362a5c58-df4b-4337-97c9-72edd372ab92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:50:13 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-3e1ddc5e-a426-4591-8ee4-8d24756c0fc7 tempest-VolumesGetTest-1984201126 None] Created volume successfully. Sep 25 11:50:14 devstack sudo[98662]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:14 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cf05be36-2c8f-4116-a479-645ab4d5add3 tempest-VolumesExtendTest-1555024739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d93b0aa8-e297-4aff-bb90-fe80872f8b63_rx1uj36ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aa53a6f2-b200-4b80-a5c7-e69d2c43f3d4" returned: 0 in 3.412s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:14 devstack cinder-volume[86984]: DEBUG cinder.image.image_utils [None req-cf05be36-2c8f-4116-a479-645ab4d5add3 tempest-VolumesExtendTest-1555024739 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d93b0aa8-e297-4aff-bb90-fe80872f8b63_rx1uj36ddevstack@QuobyteHD, size 112.00 MB, duration 3.42 sec, destination /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aa53a6f2-b200-4b80-a5c7-e69d2c43f3d4 {{(pid=86984) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 11:50:14 devstack cinder-volume[86984]: INFO cinder.image.image_utils [None req-cf05be36-2c8f-4116-a479-645ab4d5add3 tempest-VolumesExtendTest-1555024739 None] Converted 112.00 MB image at 32.79 MB/s Sep 25 11:50:14 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cf05be36-2c8f-4116-a479-645ab4d5add3 tempest-VolumesExtendTest-1555024739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aa53a6f2-b200-4b80-a5c7-e69d2c43f3d4 1G {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:14 devstack sudo[98677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aa53a6f2-b200-4b80-a5c7-e69d2c43f3d4 1G Sep 25 11:50:14 devstack sudo[98677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:15 devstack sudo[98677]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:15 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cf05be36-2c8f-4116-a479-645ab4d5add3 tempest-VolumesExtendTest-1555024739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aa53a6f2-b200-4b80-a5c7-e69d2c43f3d4 1G" returned: 0 in 0.688s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:15 devstack cinder-volume[86984]: DEBUG cinder.volume.volume_utils [None req-cf05be36-2c8f-4116-a479-645ab4d5add3 tempest-VolumesExtendTest-1555024739 None] Downloaded image d93b0aa8-e297-4aff-bb90-fe80872f8b63 ((None, [{'url': 'file:///opt/stack/data/glance/images/d93b0aa8-e297-4aff-bb90-fe80872f8b63', 'metadata': {}}])) to volume aa53a6f2-b200-4b80-a5c7-e69d2c43f3d4 successfully. {{(pid=86984) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 11:50:15 devstack cinder-volume[86984]: DEBUG cinder.image.image_utils [None req-cf05be36-2c8f-4116-a479-645ab4d5add3 tempest-VolumesExtendTest-1555024739 None] Temporary image d93b0aa8-e297-4aff-bb90-fe80872f8b63 for user eec8353da35845d58105e31890f1f7c6 is deleted. {{(pid=86984) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 11:50:15 devstack cinder-volume[86984]: DEBUG cinder.volume.volume_utils [None req-cf05be36-2c8f-4116-a479-645ab4d5add3 tempest-VolumesExtendTest-1555024739 None] Marking volume aa53a6f2-b200-4b80-a5c7-e69d2c43f3d4 as bootable. {{(pid=86984) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 11:50:15 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf05be36-2c8f-4116-a479-645ab4d5add3 tempest-VolumesExtendTest-1555024739 None] Copying metadata from image d93b0aa8-e297-4aff-bb90-fe80872f8b63 to aa53a6f2-b200-4b80-a5c7-e69d2c43f3d4. {{(pid=86984) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 11:50:15 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf05be36-2c8f-4116-a479-645ab4d5add3 tempest-VolumesExtendTest-1555024739 None] Creating volume glance metadata for volume aa53a6f2-b200-4b80-a5c7-e69d2c43f3d4 backed by image d93b0aa8-e297-4aff-bb90-fe80872f8b63 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd93b0aa8-e297-4aff-bb90-fe80872f8b63', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86984) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 11:50:15 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cf05be36-2c8f-4116-a479-645ab4d5add3 tempest-VolumesExtendTest-1555024739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fa6c98a-59d2-4b52-96a4-e4ce9eba621c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa53a6f2-b200-4b80-a5c7-e69d2c43f3d4', 'volume_size': 1, 'image_id': 'd93b0aa8-e297-4aff-bb90-fe80872f8b63', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d93b0aa8-e297-4aff-bb90-fe80872f8b63', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a57d184bdf174982a6b60117d6d4a5b4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd93b0aa8-e297-4aff-bb90-fe80872f8b63', 'created_at': datetime.datetime(2026, 9, 25, 9, 31, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 31, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d93b0aa8-e297-4aff-bb90-fe80872f8b63/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:50:15 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cf05be36-2c8f-4116-a479-645ab4d5add3 tempest-VolumesExtendTest-1555024739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4ca7a8f-f3db-409c-92fc-1a91655f325b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:50:15 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-cf05be36-2c8f-4116-a479-645ab4d5add3 tempest-VolumesExtendTest-1555024739 None] Volume volume-aa53a6f2-b200-4b80-a5c7-e69d2c43f3d4 (aa53a6f2-b200-4b80-a5c7-e69d2c43f3d4): created successfully Sep 25 11:50:15 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cf05be36-2c8f-4116-a479-645ab4d5add3 tempest-VolumesExtendTest-1555024739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4ca7a8f-f3db-409c-92fc-1a91655f325b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:50:15 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cf05be36-2c8f-4116-a479-645ab4d5add3 tempest-VolumesExtendTest-1555024739 None] Flow 'volume_create_manager' (d22cf98a-5f03-402d-acb8-c860c03a5560) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:50:15 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-cf05be36-2c8f-4116-a479-645ab4d5add3 tempest-VolumesExtendTest-1555024739 None] Created volume successfully. Sep 25 11:50:15 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e06ecc7-a0f6-4db8-aa5a-9044b3365a83 tempest-VolumesGetTest-1984201126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:50:15 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-1e06ecc7-a0f6-4db8-aa5a-9044b3365a83 tempest-VolumesGetTest-1984201126 None] Flow 'volume_create_manager' (485d345e-f657-4bf1-b0a9-f9dde8d06e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:50:15 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-1e06ecc7-a0f6-4db8-aa5a-9044b3365a83 tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32fe314d-c50f-4858-97e8-cbb6e1e2f6f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:50:16 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-1e06ecc7-a0f6-4db8-aa5a-9044b3365a83 tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32fe314d-c50f-4858-97e8-cbb6e1e2f6f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:50:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-892593948',display_name='tempest-VolumesGetTest-Volume-1871209406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=076caa82-e801-4aa8-a41f-5b3fb0ae8c64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f6a1c00cee34650b3106442f2443249',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:50:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:50:16Z,use_quota=True,user_id='0b750a9ac0d643ab979b6125b2297eb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:50:16 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-1e06ecc7-a0f6-4db8-aa5a-9044b3365a83 tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58efde0e-06d4-4a63-bd3a-0e85045ed9e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:50:16 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-1e06ecc7-a0f6-4db8-aa5a-9044b3365a83 tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58efde0e-06d4-4a63-bd3a-0e85045ed9e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:50:16 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-1e06ecc7-a0f6-4db8-aa5a-9044b3365a83 tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (849a0d56-7ae4-4468-ad3a-2d8ad6fce700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:50:16 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-1e06ecc7-a0f6-4db8-aa5a-9044b3365a83 tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (849a0d56-7ae4-4468-ad3a-2d8ad6fce700) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '076caa82-e801-4aa8-a41f-5b3fb0ae8c64', 'volume_name': 'volume-076caa82-e801-4aa8-a41f-5b3fb0ae8c64', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:50:16 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-1e06ecc7-a0f6-4db8-aa5a-9044b3365a83 tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7cb052a-2746-44bb-aec0-c9936f89ea3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:50:16 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-1e06ecc7-a0f6-4db8-aa5a-9044b3365a83 tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7cb052a-2746-44bb-aec0-c9936f89ea3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:50:16 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-1e06ecc7-a0f6-4db8-aa5a-9044b3365a83 tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94268716-4e09-4ae8-9bb1-bbd2097aa1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:50:16 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-1e06ecc7-a0f6-4db8-aa5a-9044b3365a83 tempest-VolumesGetTest-1984201126 None] Volume 076caa82-e801-4aa8-a41f-5b3fb0ae8c64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-076caa82-e801-4aa8-a41f-5b3fb0ae8c64', 'volume_size': 1} Sep 25 11:50:16 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-1e06ecc7-a0f6-4db8-aa5a-9044b3365a83 tempest-VolumesGetTest-1984201126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:50:16 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-1e06ecc7-a0f6-4db8-aa5a-9044b3365a83 tempest-VolumesGetTest-1984201126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:50:16 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-1e06ecc7-a0f6-4db8-aa5a-9044b3365a83 tempest-VolumesGetTest-1984201126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:50:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-892593948',display_name='tempest-VolumesGetTest-Volume-1871209406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=076caa82-e801-4aa8-a41f-5b3fb0ae8c64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f6a1c00cee34650b3106442f2443249',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:50:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:50:16Z,use_quota=True,user_id='0b750a9ac0d643ab979b6125b2297eb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:50:16 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-1e06ecc7-a0f6-4db8-aa5a-9044b3365a83 tempest-VolumesGetTest-1984201126 None] Creating volume 076caa82-e801-4aa8-a41f-5b3fb0ae8c64 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:50:16 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-1e06ecc7-a0f6-4db8-aa5a-9044b3365a83 tempest-VolumesGetTest-1984201126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:50:16 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-1e06ecc7-a0f6-4db8-aa5a-9044b3365a83 tempest-VolumesGetTest-1984201126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:50:16 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-1e06ecc7-a0f6-4db8-aa5a-9044b3365a83 tempest-VolumesGetTest-1984201126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:50:16 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-1e06ecc7-a0f6-4db8-aa5a-9044b3365a83 tempest-VolumesGetTest-1984201126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:50:16 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-1e06ecc7-a0f6-4db8-aa5a-9044b3365a83 tempest-VolumesGetTest-1984201126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:50:16 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-1e06ecc7-a0f6-4db8-aa5a-9044b3365a83 tempest-VolumesGetTest-1984201126 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:50:16 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-1e06ecc7-a0f6-4db8-aa5a-9044b3365a83 tempest-VolumesGetTest-1984201126 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:50:16 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-1e06ecc7-a0f6-4db8-aa5a-9044b3365a83 tempest-VolumesGetTest-1984201126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-076caa82-e801-4aa8-a41f-5b3fb0ae8c64 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:16 devstack sudo[98683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-076caa82-e801-4aa8-a41f-5b3fb0ae8c64 1073741824 Sep 25 11:50:16 devstack sudo[98683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:16 devstack sudo[98683]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:16 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-1e06ecc7-a0f6-4db8-aa5a-9044b3365a83 tempest-VolumesGetTest-1984201126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-076caa82-e801-4aa8-a41f-5b3fb0ae8c64 1073741824" returned: 0 in 0.806s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:17 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-96cb381a-af7e-44bf-9202-b0c136e145d6 tempest-VolumesExtendTest-1555024739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:50:17 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-1e06ecc7-a0f6-4db8-aa5a-9044b3365a83 tempest-VolumesGetTest-1984201126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-076caa82-e801-4aa8-a41f-5b3fb0ae8c64 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:17 devstack sudo[98690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-076caa82-e801-4aa8-a41f-5b3fb0ae8c64 Sep 25 11:50:17 devstack sudo[98690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:17 devstack sudo[98690]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:17 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-1e06ecc7-a0f6-4db8-aa5a-9044b3365a83 tempest-VolumesGetTest-1984201126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-076caa82-e801-4aa8-a41f-5b3fb0ae8c64" returned: 0 in 0.391s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:17 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-1e06ecc7-a0f6-4db8-aa5a-9044b3365a83 tempest-VolumesGetTest-1984201126 None] <== create_volume: return (1331ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:50:17 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-1e06ecc7-a0f6-4db8-aa5a-9044b3365a83 tempest-VolumesGetTest-1984201126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.337s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:50:17 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-96cb381a-af7e-44bf-9202-b0c136e145d6 tempest-VolumesExtendTest-1555024739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.425s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:50:17 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-1e06ecc7-a0f6-4db8-aa5a-9044b3365a83 tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94268716-4e09-4ae8-9bb1-bbd2097aa1a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-076caa82-e801-4aa8-a41f-5b3fb0ae8c64', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:50:17 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-1e06ecc7-a0f6-4db8-aa5a-9044b3365a83 tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98ca6d06-797e-4cab-aeb6-a62b03d91b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:50:17 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd3acfee-1771-4985-bb48-c4ad4940cba1]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:50:17 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-96cb381a-af7e-44bf-9202-b0c136e145d6 tempest-VolumesExtendTest-1555024739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aa53a6f2-b200-4b80-a5c7-e69d2c43f3d4 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:17 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-1e06ecc7-a0f6-4db8-aa5a-9044b3365a83 tempest-VolumesGetTest-1984201126 None] Volume volume-076caa82-e801-4aa8-a41f-5b3fb0ae8c64 (076caa82-e801-4aa8-a41f-5b3fb0ae8c64): created successfully Sep 25 11:50:17 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-1e06ecc7-a0f6-4db8-aa5a-9044b3365a83 tempest-VolumesGetTest-1984201126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98ca6d06-797e-4cab-aeb6-a62b03d91b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:50:17 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-1e06ecc7-a0f6-4db8-aa5a-9044b3365a83 tempest-VolumesGetTest-1984201126 None] Flow 'volume_create_manager' (485d345e-f657-4bf1-b0a9-f9dde8d06e32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:50:17 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-1e06ecc7-a0f6-4db8-aa5a-9044b3365a83 tempest-VolumesGetTest-1984201126 None] Created volume successfully. Sep 25 11:50:17 devstack sudo[98693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aa53a6f2-b200-4b80-a5c7-e69d2c43f3d4 Sep 25 11:50:17 devstack sudo[98693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:18 devstack sudo[98693]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-96cb381a-af7e-44bf-9202-b0c136e145d6 tempest-VolumesExtendTest-1555024739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aa53a6f2-b200-4b80-a5c7-e69d2c43f3d4" returned: 0 in 0.562s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-96cb381a-af7e-44bf-9202-b0c136e145d6 tempest-VolumesExtendTest-1555024739 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aa53a6f2-b200-4b80-a5c7-e69d2c43f3d4 2G {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:18 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-0df0d26e-d3bb-4a7c-9464-0314acf091a5 tempest-VolumesGetTest-1984201126 None] Acquiring lock "cinder-076caa82-e801-4aa8-a41f-5b3fb0ae8c64-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:50:18 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-0df0d26e-d3bb-4a7c-9464-0314acf091a5 tempest-VolumesGetTest-1984201126 None] Lock "cinder-076caa82-e801-4aa8-a41f-5b3fb0ae8c64-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:50:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-96cb381a-af7e-44bf-9202-b0c136e145d6 tempest-VolumesExtendTest-1555024739 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aa53a6f2-b200-4b80-a5c7-e69d2c43f3d4 2G" returned: 0 in 0.247s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-96cb381a-af7e-44bf-9202-b0c136e145d6 tempest-VolumesExtendTest-1555024739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.855s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:50:18 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-0df0d26e-d3bb-4a7c-9464-0314acf091a5 tempest-VolumesGetTest-1984201126 None] Acquiring lock "cinder-quobyte-076caa82-e801-4aa8-a41f-5b3fb0ae8c64" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:50:18 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-0df0d26e-d3bb-4a7c-9464-0314acf091a5 tempest-VolumesGetTest-1984201126 None] Lock "cinder-quobyte-076caa82-e801-4aa8-a41f-5b3fb0ae8c64" acquired by "delete_volume" :: waited 0.038s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:50:18 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-96cb381a-af7e-44bf-9202-b0c136e145d6 tempest-VolumesExtendTest-1555024739 None] Extend volume completed successfully. Sep 25 11:50:18 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bdd570d-2dc7-4dcb-9f5a-cd011d82f775]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:50:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-0df0d26e-d3bb-4a7c-9464-0314acf091a5 tempest-VolumesGetTest-1984201126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-076caa82-e801-4aa8-a41f-5b3fb0ae8c64 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:18 devstack sudo[98701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-076caa82-e801-4aa8-a41f-5b3fb0ae8c64 Sep 25 11:50:18 devstack sudo[98701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:18 devstack sudo[98701]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-0df0d26e-d3bb-4a7c-9464-0314acf091a5 tempest-VolumesGetTest-1984201126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-076caa82-e801-4aa8-a41f-5b3fb0ae8c64" returned: 0 in 0.502s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-0df0d26e-d3bb-4a7c-9464-0314acf091a5 tempest-VolumesGetTest-1984201126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-076caa82-e801-4aa8-a41f-5b3fb0ae8c64 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:19 devstack sudo[98707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-076caa82-e801-4aa8-a41f-5b3fb0ae8c64 Sep 25 11:50:19 devstack sudo[98707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:19 devstack sudo[98707]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:19 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-0df0d26e-d3bb-4a7c-9464-0314acf091a5 tempest-VolumesGetTest-1984201126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-076caa82-e801-4aa8-a41f-5b3fb0ae8c64" returned: 0 in 0.525s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:19 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-0df0d26e-d3bb-4a7c-9464-0314acf091a5 tempest-VolumesGetTest-1984201126 None] Lock "cinder-quobyte-076caa82-e801-4aa8-a41f-5b3fb0ae8c64" released by "delete_volume" :: held 1.098s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:50:19 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-0df0d26e-d3bb-4a7c-9464-0314acf091a5 tempest-VolumesGetTest-1984201126 None] Created reservations ['be00dacb-179e-40e2-9e4c-5f9864ac89a7', 'd4511282-9519-456b-86d6-9bceef2703c2', '00238554-596f-43f5-8978-e410f1c0c5c2', '3e7d5e1f-63d7-474d-bf42-8aec6e30b384'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:50:19 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-0df0d26e-d3bb-4a7c-9464-0314acf091a5 tempest-VolumesGetTest-1984201126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:50:19 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-0df0d26e-d3bb-4a7c-9464-0314acf091a5 tempest-VolumesGetTest-1984201126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:50:19 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-0df0d26e-d3bb-4a7c-9464-0314acf091a5 tempest-VolumesGetTest-1984201126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:50:19 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-0df0d26e-d3bb-4a7c-9464-0314acf091a5 tempest-VolumesGetTest-1984201126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:50:19 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-0df0d26e-d3bb-4a7c-9464-0314acf091a5 tempest-VolumesGetTest-1984201126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:50:19 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-0df0d26e-d3bb-4a7c-9464-0314acf091a5 tempest-VolumesGetTest-1984201126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:19 devstack sudo[98710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:50:19 devstack sudo[98710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:19 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-2a266d71-ef74-4c7d-a900-c214304f6517 tempest-VolumesExtendTest-1555024739 None] Acquiring lock "cinder-aa53a6f2-b200-4b80-a5c7-e69d2c43f3d4-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:50:20 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-2a266d71-ef74-4c7d-a900-c214304f6517 tempest-VolumesExtendTest-1555024739 None] Lock "cinder-aa53a6f2-b200-4b80-a5c7-e69d2c43f3d4-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:50:20 devstack sudo[98710]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-0df0d26e-d3bb-4a7c-9464-0314acf091a5 tempest-VolumesGetTest-1984201126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.374s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:20 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-0df0d26e-d3bb-4a7c-9464-0314acf091a5 tempest-VolumesGetTest-1984201126 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:50:20 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-2a266d71-ef74-4c7d-a900-c214304f6517 tempest-VolumesExtendTest-1555024739 None] Acquiring lock "cinder-quobyte-aa53a6f2-b200-4b80-a5c7-e69d2c43f3d4" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:50:20 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-0df0d26e-d3bb-4a7c-9464-0314acf091a5 tempest-VolumesGetTest-1984201126 None] Deleted volume successfully. Sep 25 11:50:20 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-2a266d71-ef74-4c7d-a900-c214304f6517 tempest-VolumesExtendTest-1555024739 None] Lock "cinder-quobyte-aa53a6f2-b200-4b80-a5c7-e69d2c43f3d4" acquired by "delete_volume" :: waited 0.033s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:50:20 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-0df0d26e-d3bb-4a7c-9464-0314acf091a5 tempest-VolumesGetTest-1984201126 None] Lock "cinder-076caa82-e801-4aa8-a41f-5b3fb0ae8c64-delete_volume" released by "delete_volume" :: held 1.876s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:50:20 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef1c845-c484-48ca-b212-058f2e49c327]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:50:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2a266d71-ef74-4c7d-a900-c214304f6517 tempest-VolumesExtendTest-1555024739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aa53a6f2-b200-4b80-a5c7-e69d2c43f3d4 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:20 devstack sudo[98713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aa53a6f2-b200-4b80-a5c7-e69d2c43f3d4 Sep 25 11:50:20 devstack sudo[98713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:20 devstack sudo[98713]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2a266d71-ef74-4c7d-a900-c214304f6517 tempest-VolumesExtendTest-1555024739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aa53a6f2-b200-4b80-a5c7-e69d2c43f3d4" returned: 0 in 0.569s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2a266d71-ef74-4c7d-a900-c214304f6517 tempest-VolumesExtendTest-1555024739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aa53a6f2-b200-4b80-a5c7-e69d2c43f3d4 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:20 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-fa3b666f-ed3b-491a-8d45-f1719e07952e tempest-VolumesGetTest-1984201126 None] Acquiring lock "cinder-c54c2a7e-520f-42bb-9ebe-177934e134d6-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:50:20 devstack sudo[98718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aa53a6f2-b200-4b80-a5c7-e69d2c43f3d4 Sep 25 11:50:20 devstack sudo[98718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:20 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-fa3b666f-ed3b-491a-8d45-f1719e07952e tempest-VolumesGetTest-1984201126 None] Lock "cinder-c54c2a7e-520f-42bb-9ebe-177934e134d6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:50:20 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-fa3b666f-ed3b-491a-8d45-f1719e07952e tempest-VolumesGetTest-1984201126 None] Acquiring lock "cinder-quobyte-c54c2a7e-520f-42bb-9ebe-177934e134d6" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:50:20 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-fa3b666f-ed3b-491a-8d45-f1719e07952e tempest-VolumesGetTest-1984201126 None] Lock "cinder-quobyte-c54c2a7e-520f-42bb-9ebe-177934e134d6" acquired by "delete_volume" :: waited 0.021s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:50:20 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c25e22-e32a-49d1-9e06-080ad8cc9abd]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:50:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-fa3b666f-ed3b-491a-8d45-f1719e07952e tempest-VolumesGetTest-1984201126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c54c2a7e-520f-42bb-9ebe-177934e134d6 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:21 devstack sudo[98720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c54c2a7e-520f-42bb-9ebe-177934e134d6 Sep 25 11:50:21 devstack sudo[98720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:21 devstack sudo[98718]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:21 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2a266d71-ef74-4c7d-a900-c214304f6517 tempest-VolumesExtendTest-1555024739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aa53a6f2-b200-4b80-a5c7-e69d2c43f3d4" returned: 0 in 0.362s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:21 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-2a266d71-ef74-4c7d-a900-c214304f6517 tempest-VolumesExtendTest-1555024739 None] Lock "cinder-quobyte-aa53a6f2-b200-4b80-a5c7-e69d2c43f3d4" released by "delete_volume" :: held 1.000s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:50:21 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-2a266d71-ef74-4c7d-a900-c214304f6517 tempest-VolumesExtendTest-1555024739 None] Created reservations ['bed212dc-6747-4921-8a2a-4231bd7cb282', 'b7505401-9e53-4ed1-baca-286f8cddc366', 'ece4b6c2-6028-4c5f-8e55-bac7ec42aa01', 'de7b80f2-3a85-43fa-a724-76f173504d0f'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:50:21 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-2a266d71-ef74-4c7d-a900-c214304f6517 tempest-VolumesExtendTest-1555024739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:50:21 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-2a266d71-ef74-4c7d-a900-c214304f6517 tempest-VolumesExtendTest-1555024739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:50:21 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-2a266d71-ef74-4c7d-a900-c214304f6517 tempest-VolumesExtendTest-1555024739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:50:21 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-2a266d71-ef74-4c7d-a900-c214304f6517 tempest-VolumesExtendTest-1555024739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:50:21 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-2a266d71-ef74-4c7d-a900-c214304f6517 tempest-VolumesExtendTest-1555024739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:50:21 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2a266d71-ef74-4c7d-a900-c214304f6517 tempest-VolumesExtendTest-1555024739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:21 devstack sudo[98723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:50:21 devstack sudo[98723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:21 devstack sudo[98720]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:21 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-fa3b666f-ed3b-491a-8d45-f1719e07952e tempest-VolumesGetTest-1984201126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c54c2a7e-520f-42bb-9ebe-177934e134d6" returned: 0 in 0.652s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:21 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-fa3b666f-ed3b-491a-8d45-f1719e07952e tempest-VolumesGetTest-1984201126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c54c2a7e-520f-42bb-9ebe-177934e134d6 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:21 devstack sudo[98729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c54c2a7e-520f-42bb-9ebe-177934e134d6 Sep 25 11:50:21 devstack sudo[98729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:21 devstack sudo[98723]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:21 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2a266d71-ef74-4c7d-a900-c214304f6517 tempest-VolumesExtendTest-1555024739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.326s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:21 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-2a266d71-ef74-4c7d-a900-c214304f6517 tempest-VolumesExtendTest-1555024739 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:50:21 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-2a266d71-ef74-4c7d-a900-c214304f6517 tempest-VolumesExtendTest-1555024739 None] Deleted volume successfully. Sep 25 11:50:21 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-2a266d71-ef74-4c7d-a900-c214304f6517 tempest-VolumesExtendTest-1555024739 None] Lock "cinder-aa53a6f2-b200-4b80-a5c7-e69d2c43f3d4-delete_volume" released by "delete_volume" :: held 1.786s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:50:21 devstack sudo[98729]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:21 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-fa3b666f-ed3b-491a-8d45-f1719e07952e tempest-VolumesGetTest-1984201126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c54c2a7e-520f-42bb-9ebe-177934e134d6" returned: 0 in 0.395s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:21 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-fa3b666f-ed3b-491a-8d45-f1719e07952e tempest-VolumesGetTest-1984201126 None] Lock "cinder-quobyte-c54c2a7e-520f-42bb-9ebe-177934e134d6" released by "delete_volume" :: held 1.113s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:50:22 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-fa3b666f-ed3b-491a-8d45-f1719e07952e tempest-VolumesGetTest-1984201126 None] Created reservations ['4e7a0b6d-191e-4da8-b733-2798c91ddd57', 'd5f97f39-f650-4bc6-90f4-8fda7d33a417', '020cdc17-0e0d-4bc3-a7db-e58fc88ef51b', '96de1fda-3bac-4d14-adc8-13a8e5b31b21'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:50:22 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-fa3b666f-ed3b-491a-8d45-f1719e07952e tempest-VolumesGetTest-1984201126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:50:22 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-fa3b666f-ed3b-491a-8d45-f1719e07952e tempest-VolumesGetTest-1984201126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:50:22 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-fa3b666f-ed3b-491a-8d45-f1719e07952e tempest-VolumesGetTest-1984201126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:50:22 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-fa3b666f-ed3b-491a-8d45-f1719e07952e tempest-VolumesGetTest-1984201126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:50:22 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-fa3b666f-ed3b-491a-8d45-f1719e07952e tempest-VolumesGetTest-1984201126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:50:22 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-fa3b666f-ed3b-491a-8d45-f1719e07952e tempest-VolumesGetTest-1984201126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:22 devstack sudo[98733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:50:22 devstack sudo[98733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:22 devstack sudo[98733]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:22 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-fa3b666f-ed3b-491a-8d45-f1719e07952e tempest-VolumesGetTest-1984201126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.365s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:22 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-fa3b666f-ed3b-491a-8d45-f1719e07952e tempest-VolumesGetTest-1984201126 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:50:22 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-fa3b666f-ed3b-491a-8d45-f1719e07952e tempest-VolumesGetTest-1984201126 None] Deleted volume successfully. Sep 25 11:50:22 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-fa3b666f-ed3b-491a-8d45-f1719e07952e tempest-VolumesGetTest-1984201126 None] Lock "cinder-c54c2a7e-520f-42bb-9ebe-177934e134d6-delete_volume" released by "delete_volume" :: held 1.794s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:50:23 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f27dfb0-9fb8-4e0e-8954-6d5b579b1107 tempest-VolumesExtendTest-1555024739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:50:23 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4f27dfb0-9fb8-4e0e-8954-6d5b579b1107 tempest-VolumesExtendTest-1555024739 None] Flow 'volume_create_manager' (51d9a557-f684-4fb2-b9fa-638a429c1e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:50:23 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4f27dfb0-9fb8-4e0e-8954-6d5b579b1107 tempest-VolumesExtendTest-1555024739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6641987-61ca-426c-9268-8f71ac0c8a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:50:23 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4f27dfb0-9fb8-4e0e-8954-6d5b579b1107 tempest-VolumesExtendTest-1555024739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6641987-61ca-426c-9268-8f71ac0c8a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:50:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-785546159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a390fab6-bc31-48af-971d-9a061a82b202,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e8c0b73a2394f83b9a33ce4fc7d5647',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:50:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:50:23Z,use_quota=True,user_id='eec8353da35845d58105e31890f1f7c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:50:23 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4f27dfb0-9fb8-4e0e-8954-6d5b579b1107 tempest-VolumesExtendTest-1555024739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a9c4bfb-9de4-4b7f-be8b-60caefbdf938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:50:23 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4f27dfb0-9fb8-4e0e-8954-6d5b579b1107 tempest-VolumesExtendTest-1555024739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a9c4bfb-9de4-4b7f-be8b-60caefbdf938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:50:23 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4f27dfb0-9fb8-4e0e-8954-6d5b579b1107 tempest-VolumesExtendTest-1555024739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b483dfc-55a7-4f98-af72-f6808f5ead59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:50:23 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4f27dfb0-9fb8-4e0e-8954-6d5b579b1107 tempest-VolumesExtendTest-1555024739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b483dfc-55a7-4f98-af72-f6808f5ead59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a390fab6-bc31-48af-971d-9a061a82b202', 'volume_name': 'volume-a390fab6-bc31-48af-971d-9a061a82b202', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:50:23 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4f27dfb0-9fb8-4e0e-8954-6d5b579b1107 tempest-VolumesExtendTest-1555024739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd5ea8a4-dc73-490a-b3fc-51b73fba4f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:50:23 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4f27dfb0-9fb8-4e0e-8954-6d5b579b1107 tempest-VolumesExtendTest-1555024739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd5ea8a4-dc73-490a-b3fc-51b73fba4f3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:50:23 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4f27dfb0-9fb8-4e0e-8954-6d5b579b1107 tempest-VolumesExtendTest-1555024739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2deda736-8bb9-4c9a-9c63-a70844567dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:50:23 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-4f27dfb0-9fb8-4e0e-8954-6d5b579b1107 tempest-VolumesExtendTest-1555024739 None] Volume a390fab6-bc31-48af-971d-9a061a82b202: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a390fab6-bc31-48af-971d-9a061a82b202', 'volume_size': 1} Sep 25 11:50:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-4f27dfb0-9fb8-4e0e-8954-6d5b579b1107 tempest-VolumesExtendTest-1555024739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:50:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-4f27dfb0-9fb8-4e0e-8954-6d5b579b1107 tempest-VolumesExtendTest-1555024739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:50:23 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-4f27dfb0-9fb8-4e0e-8954-6d5b579b1107 tempest-VolumesExtendTest-1555024739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:50:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-785546159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a390fab6-bc31-48af-971d-9a061a82b202,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e8c0b73a2394f83b9a33ce4fc7d5647',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:50:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:50:23Z,use_quota=True,user_id='eec8353da35845d58105e31890f1f7c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:50:23 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-4f27dfb0-9fb8-4e0e-8954-6d5b579b1107 tempest-VolumesExtendTest-1555024739 None] Creating volume a390fab6-bc31-48af-971d-9a061a82b202 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:50:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-4f27dfb0-9fb8-4e0e-8954-6d5b579b1107 tempest-VolumesExtendTest-1555024739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:50:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-4f27dfb0-9fb8-4e0e-8954-6d5b579b1107 tempest-VolumesExtendTest-1555024739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:50:23 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-4f27dfb0-9fb8-4e0e-8954-6d5b579b1107 tempest-VolumesExtendTest-1555024739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:50:23 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-4f27dfb0-9fb8-4e0e-8954-6d5b579b1107 tempest-VolumesExtendTest-1555024739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:50:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-4f27dfb0-9fb8-4e0e-8954-6d5b579b1107 tempest-VolumesExtendTest-1555024739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:50:23 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-4f27dfb0-9fb8-4e0e-8954-6d5b579b1107 tempest-VolumesExtendTest-1555024739 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:50:23 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-4f27dfb0-9fb8-4e0e-8954-6d5b579b1107 tempest-VolumesExtendTest-1555024739 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:50:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-4f27dfb0-9fb8-4e0e-8954-6d5b579b1107 tempest-VolumesExtendTest-1555024739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a390fab6-bc31-48af-971d-9a061a82b202 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:23 devstack sudo[98737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a390fab6-bc31-48af-971d-9a061a82b202 1073741824 Sep 25 11:50:23 devstack sudo[98737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:24 devstack sudo[98737]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:24 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-4f27dfb0-9fb8-4e0e-8954-6d5b579b1107 tempest-VolumesExtendTest-1555024739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a390fab6-bc31-48af-971d-9a061a82b202 1073741824" returned: 0 in 0.798s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:24 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-4f27dfb0-9fb8-4e0e-8954-6d5b579b1107 tempest-VolumesExtendTest-1555024739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a390fab6-bc31-48af-971d-9a061a82b202 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:24 devstack sudo[98743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a390fab6-bc31-48af-971d-9a061a82b202 Sep 25 11:50:24 devstack sudo[98743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:24 devstack sudo[98743]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:24 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-4f27dfb0-9fb8-4e0e-8954-6d5b579b1107 tempest-VolumesExtendTest-1555024739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a390fab6-bc31-48af-971d-9a061a82b202" returned: 0 in 0.377s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:24 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-4f27dfb0-9fb8-4e0e-8954-6d5b579b1107 tempest-VolumesExtendTest-1555024739 None] <== create_volume: return (1280ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:50:24 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-4f27dfb0-9fb8-4e0e-8954-6d5b579b1107 tempest-VolumesExtendTest-1555024739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.283s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:50:24 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4f27dfb0-9fb8-4e0e-8954-6d5b579b1107 tempest-VolumesExtendTest-1555024739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2deda736-8bb9-4c9a-9c63-a70844567dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a390fab6-bc31-48af-971d-9a061a82b202', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:50:24 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4f27dfb0-9fb8-4e0e-8954-6d5b579b1107 tempest-VolumesExtendTest-1555024739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6188f5b0-9f64-4b4e-b6fe-50932bd1d58c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:50:24 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-4f27dfb0-9fb8-4e0e-8954-6d5b579b1107 tempest-VolumesExtendTest-1555024739 None] Volume volume-a390fab6-bc31-48af-971d-9a061a82b202 (a390fab6-bc31-48af-971d-9a061a82b202): created successfully Sep 25 11:50:24 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4f27dfb0-9fb8-4e0e-8954-6d5b579b1107 tempest-VolumesExtendTest-1555024739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6188f5b0-9f64-4b4e-b6fe-50932bd1d58c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:50:24 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4f27dfb0-9fb8-4e0e-8954-6d5b579b1107 tempest-VolumesExtendTest-1555024739 None] Flow 'volume_create_manager' (51d9a557-f684-4fb2-b9fa-638a429c1e53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:50:24 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-4f27dfb0-9fb8-4e0e-8954-6d5b579b1107 tempest-VolumesExtendTest-1555024739 None] Created volume successfully. Sep 25 11:50:25 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-677074ec-2f2d-41b3-8334-f3013c5862e4 tempest-VolumesExtendTest-1555024739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:50:25 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-677074ec-2f2d-41b3-8334-f3013c5862e4 tempest-VolumesExtendTest-1555024739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:50:25 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-677074ec-2f2d-41b3-8334-f3013c5862e4 tempest-VolumesExtendTest-1555024739 None] Creating offline snapshot 77029240-e634-4c44-aab8-264922af2078 of volume a390fab6-bc31-48af-971d-9a061a82b202 {{(pid=86984) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:50:25 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e143c16-981e-4cbc-b4d2-c4ac3baa3c4b]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:50:25 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-677074ec-2f2d-41b3-8334-f3013c5862e4 tempest-VolumesExtendTest-1555024739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a390fab6-bc31-48af-971d-9a061a82b202 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:25 devstack sudo[98747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a390fab6-bc31-48af-971d-9a061a82b202 Sep 25 11:50:25 devstack sudo[98747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:26 devstack sudo[98747]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:26 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-677074ec-2f2d-41b3-8334-f3013c5862e4 tempest-VolumesExtendTest-1555024739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a390fab6-bc31-48af-971d-9a061a82b202" returned: 0 in 0.452s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:26 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-677074ec-2f2d-41b3-8334-f3013c5862e4 tempest-VolumesExtendTest-1555024739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a390fab6-bc31-48af-971d-9a061a82b202,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a390fab6-bc31-48af-971d-9a061a82b202.77029240-e634-4c44-aab8-264922af2078 1G {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:26 devstack sudo[98753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a390fab6-bc31-48af-971d-9a061a82b202,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a390fab6-bc31-48af-971d-9a061a82b202.77029240-e634-4c44-aab8-264922af2078 1G Sep 25 11:50:26 devstack sudo[98753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:26 devstack sudo[98753]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:26 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-677074ec-2f2d-41b3-8334-f3013c5862e4 tempest-VolumesExtendTest-1555024739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a390fab6-bc31-48af-971d-9a061a82b202,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a390fab6-bc31-48af-971d-9a061a82b202.77029240-e634-4c44-aab8-264922af2078 1G" returned: 0 in 0.643s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:26 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-677074ec-2f2d-41b3-8334-f3013c5862e4 tempest-VolumesExtendTest-1555024739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a390fab6-bc31-48af-971d-9a061a82b202 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a390fab6-bc31-48af-971d-9a061a82b202.77029240-e634-4c44-aab8-264922af2078 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:26 devstack sudo[98759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a390fab6-bc31-48af-971d-9a061a82b202 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a390fab6-bc31-48af-971d-9a061a82b202.77029240-e634-4c44-aab8-264922af2078 Sep 25 11:50:26 devstack sudo[98759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:27 devstack sudo[98759]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:27 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-677074ec-2f2d-41b3-8334-f3013c5862e4 tempest-VolumesExtendTest-1555024739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a390fab6-bc31-48af-971d-9a061a82b202 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a390fab6-bc31-48af-971d-9a061a82b202.77029240-e634-4c44-aab8-264922af2078" returned: 0 in 0.625s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:27 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-677074ec-2f2d-41b3-8334-f3013c5862e4 tempest-VolumesExtendTest-1555024739 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a390fab6-bc31-48af-971d-9a061a82b202.77029240-e634-4c44-aab8-264922af2078 is being set with open permissions: ugo+rw Sep 25 11:50:27 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-677074ec-2f2d-41b3-8334-f3013c5862e4 tempest-VolumesExtendTest-1555024739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a390fab6-bc31-48af-971d-9a061a82b202.77029240-e634-4c44-aab8-264922af2078 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:27 devstack sudo[98764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a390fab6-bc31-48af-971d-9a061a82b202.77029240-e634-4c44-aab8-264922af2078 Sep 25 11:50:27 devstack sudo[98764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:27 devstack sudo[98764]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:27 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-677074ec-2f2d-41b3-8334-f3013c5862e4 tempest-VolumesExtendTest-1555024739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a390fab6-bc31-48af-971d-9a061a82b202.77029240-e634-4c44-aab8-264922af2078" returned: 0 in 0.406s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:27 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-677074ec-2f2d-41b3-8334-f3013c5862e4 tempest-VolumesExtendTest-1555024739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a390fab6-bc31-48af-971d-9a061a82b202.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:27 devstack sudo[98768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a390fab6-bc31-48af-971d-9a061a82b202.info Sep 25 11:50:27 devstack sudo[98768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:28 devstack sudo[98768]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:28 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-677074ec-2f2d-41b3-8334-f3013c5862e4 tempest-VolumesExtendTest-1555024739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a390fab6-bc31-48af-971d-9a061a82b202.info" returned: 0 in 0.370s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:28 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-677074ec-2f2d-41b3-8334-f3013c5862e4 tempest-VolumesExtendTest-1555024739 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a390fab6-bc31-48af-971d-9a061a82b202.info is being set with open permissions: ugo+rw Sep 25 11:50:28 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-677074ec-2f2d-41b3-8334-f3013c5862e4 tempest-VolumesExtendTest-1555024739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a390fab6-bc31-48af-971d-9a061a82b202.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:28 devstack sudo[98771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a390fab6-bc31-48af-971d-9a061a82b202.info Sep 25 11:50:28 devstack sudo[98771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:28 devstack sudo[98771]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:28 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-677074ec-2f2d-41b3-8334-f3013c5862e4 tempest-VolumesExtendTest-1555024739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a390fab6-bc31-48af-971d-9a061a82b202.info" returned: 0 in 0.348s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:28 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-677074ec-2f2d-41b3-8334-f3013c5862e4 tempest-VolumesExtendTest-1555024739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.966s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:50:28 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-677074ec-2f2d-41b3-8334-f3013c5862e4 tempest-VolumesExtendTest-1555024739 None] Create snapshot completed successfully Sep 25 11:50:28 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-77c9d523-45ad-4e61-a653-339a005bc981 tempest-VolumesExtendTest-1555024739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:50:28 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-77c9d523-45ad-4e61-a653-339a005bc981 tempest-VolumesExtendTest-1555024739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.004s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:50:29 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e466771-2dd4-41c3-b203-79b95fdce342]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:50:29 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-77c9d523-45ad-4e61-a653-339a005bc981 tempest-VolumesExtendTest-1555024739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a390fab6-bc31-48af-971d-9a061a82b202 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:29 devstack sudo[98774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a390fab6-bc31-48af-971d-9a061a82b202 Sep 25 11:50:29 devstack sudo[98774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:29 devstack sudo[98774]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:29 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-77c9d523-45ad-4e61-a653-339a005bc981 tempest-VolumesExtendTest-1555024739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a390fab6-bc31-48af-971d-9a061a82b202" returned: 0 in 0.598s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:29 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-77c9d523-45ad-4e61-a653-339a005bc981 tempest-VolumesExtendTest-1555024739 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a390fab6-bc31-48af-971d-9a061a82b202.77029240-e634-4c44-aab8-264922af2078 2G {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:29 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-77c9d523-45ad-4e61-a653-339a005bc981 tempest-VolumesExtendTest-1555024739 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a390fab6-bc31-48af-971d-9a061a82b202.77029240-e634-4c44-aab8-264922af2078 2G" returned: 0 in 0.191s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:29 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-77c9d523-45ad-4e61-a653-339a005bc981 tempest-VolumesExtendTest-1555024739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.871s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:50:29 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-77c9d523-45ad-4e61-a653-339a005bc981 tempest-VolumesExtendTest-1555024739 None] Extend volume completed successfully. Sep 25 11:50:30 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-80d7d322-23fb-48f0-a281-047a2961e98e tempest-VolumesExtendTest-1555024739 None] Acquiring lock "cinder-77029240-e634-4c44-aab8-264922af2078-delete_snapshot" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:50:30 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-80d7d322-23fb-48f0-a281-047a2961e98e tempest-VolumesExtendTest-1555024739 None] Lock "cinder-77029240-e634-4c44-aab8-264922af2078-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:50:30 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-80d7d322-23fb-48f0-a281-047a2961e98e tempest-VolumesExtendTest-1555024739 None] Acquiring lock "cinder-quobyte-a390fab6-bc31-48af-971d-9a061a82b202" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:50:30 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-80d7d322-23fb-48f0-a281-047a2961e98e tempest-VolumesExtendTest-1555024739 None] Lock "cinder-quobyte-a390fab6-bc31-48af-971d-9a061a82b202" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:50:30 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-80d7d322-23fb-48f0-a281-047a2961e98e tempest-VolumesExtendTest-1555024739 None] Acquiring lock "cinder-quobyte-77029240-e634-4c44-aab8-264922af2078" by "_delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:50:30 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-80d7d322-23fb-48f0-a281-047a2961e98e tempest-VolumesExtendTest-1555024739 None] Lock "cinder-quobyte-77029240-e634-4c44-aab8-264922af2078" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:50:30 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-80d7d322-23fb-48f0-a281-047a2961e98e tempest-VolumesExtendTest-1555024739 None] Deleting offline snapshot 77029240-e634-4c44-aab8-264922af2078 of volume a390fab6-bc31-48af-971d-9a061a82b202 {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:50:30 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-80d7d322-23fb-48f0-a281-047a2961e98e tempest-VolumesExtendTest-1555024739 None] snapshot_file for this snap is: volume-a390fab6-bc31-48af-971d-9a061a82b202.77029240-e634-4c44-aab8-264922af2078 {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:50:30 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[77eac79d-ab68-4908-a945-eca31ff32e5b]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:50:30 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-80d7d322-23fb-48f0-a281-047a2961e98e tempest-VolumesExtendTest-1555024739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a390fab6-bc31-48af-971d-9a061a82b202.77029240-e634-4c44-aab8-264922af2078 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:30 devstack sudo[98784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a390fab6-bc31-48af-971d-9a061a82b202.77029240-e634-4c44-aab8-264922af2078 Sep 25 11:50:30 devstack sudo[98784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:30 devstack sudo[98784]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:30 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-80d7d322-23fb-48f0-a281-047a2961e98e tempest-VolumesExtendTest-1555024739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a390fab6-bc31-48af-971d-9a061a82b202.77029240-e634-4c44-aab8-264922af2078" returned: 0 in 0.522s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:30 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-80d7d322-23fb-48f0-a281-047a2961e98e tempest-VolumesExtendTest-1555024739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a390fab6-bc31-48af-971d-9a061a82b202(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86984) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:50:31 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9bd0b51-8a7b-48b5-925f-e4f08a7caf9f]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:50:31 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-80d7d322-23fb-48f0-a281-047a2961e98e tempest-VolumesExtendTest-1555024739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a390fab6-bc31-48af-971d-9a061a82b202 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:31 devstack sudo[98790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a390fab6-bc31-48af-971d-9a061a82b202 Sep 25 11:50:31 devstack sudo[98790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:31 devstack sudo[98790]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:31 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-80d7d322-23fb-48f0-a281-047a2961e98e tempest-VolumesExtendTest-1555024739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a390fab6-bc31-48af-971d-9a061a82b202" returned: 0 in 0.579s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:31 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-80d7d322-23fb-48f0-a281-047a2961e98e tempest-VolumesExtendTest-1555024739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a390fab6-bc31-48af-971d-9a061a82b202.77029240-e634-4c44-aab8-264922af2078 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:31 devstack sudo[98795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a390fab6-bc31-48af-971d-9a061a82b202.77029240-e634-4c44-aab8-264922af2078 Sep 25 11:50:31 devstack sudo[98795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:32 devstack sudo[98795]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:32 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-80d7d322-23fb-48f0-a281-047a2961e98e tempest-VolumesExtendTest-1555024739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a390fab6-bc31-48af-971d-9a061a82b202.77029240-e634-4c44-aab8-264922af2078" returned: 0 in 0.707s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:32 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-80d7d322-23fb-48f0-a281-047a2961e98e tempest-VolumesExtendTest-1555024739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a390fab6-bc31-48af-971d-9a061a82b202.77029240-e634-4c44-aab8-264922af2078 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:32 devstack sudo[98801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a390fab6-bc31-48af-971d-9a061a82b202.77029240-e634-4c44-aab8-264922af2078 Sep 25 11:50:32 devstack sudo[98801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:32 devstack sudo[98801]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:32 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-80d7d322-23fb-48f0-a281-047a2961e98e tempest-VolumesExtendTest-1555024739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a390fab6-bc31-48af-971d-9a061a82b202.77029240-e634-4c44-aab8-264922af2078" returned: 0 in 0.440s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:32 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-80d7d322-23fb-48f0-a281-047a2961e98e tempest-VolumesExtendTest-1555024739 None] Lock "cinder-quobyte-77029240-e634-4c44-aab8-264922af2078" released by "_delete_snapshot" :: held 2.469s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:50:32 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-80d7d322-23fb-48f0-a281-047a2961e98e tempest-VolumesExtendTest-1555024739 None] Lock "cinder-quobyte-a390fab6-bc31-48af-971d-9a061a82b202" released by "delete_snapshot" :: held 2.521s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:50:33 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-80d7d322-23fb-48f0-a281-047a2961e98e tempest-VolumesExtendTest-1555024739 None] Created reservations ['5abf8ca7-6ce2-4287-912e-aacce7d9f5da', 'fca57a72-88d7-4be4-9d56-ba889d040ac8', 'b575e3fb-8be0-430e-9d82-6164404c367d', '28769380-7c6b-4d17-a7ed-b27845e95b23'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:50:33 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-80d7d322-23fb-48f0-a281-047a2961e98e tempest-VolumesExtendTest-1555024739 None] Delete snapshot completed successfully. Sep 25 11:50:33 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-80d7d322-23fb-48f0-a281-047a2961e98e tempest-VolumesExtendTest-1555024739 None] Lock "cinder-77029240-e634-4c44-aab8-264922af2078-delete_snapshot" released by "delete_snapshot" :: held 2.868s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:50:33 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-3b3f765c-fa93-4b1f-be33-4c0f3c85f0a9 tempest-VolumesExtendTest-1555024739 None] Acquiring lock "cinder-a390fab6-bc31-48af-971d-9a061a82b202-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:50:33 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-3b3f765c-fa93-4b1f-be33-4c0f3c85f0a9 tempest-VolumesExtendTest-1555024739 None] Lock "cinder-a390fab6-bc31-48af-971d-9a061a82b202-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:50:33 devstack cinder-volume[86984]: DEBUG dbcounter [-] [86984] Writing DB stats cinder:UPDATE=110,cinder:INSERT=44,cinder:SELECT=99,cinder:DELETE=9 {{(pid=86984) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:50:33 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-3b3f765c-fa93-4b1f-be33-4c0f3c85f0a9 tempest-VolumesExtendTest-1555024739 None] Acquiring lock "cinder-quobyte-a390fab6-bc31-48af-971d-9a061a82b202" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:50:33 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-3b3f765c-fa93-4b1f-be33-4c0f3c85f0a9 tempest-VolumesExtendTest-1555024739 None] Lock "cinder-quobyte-a390fab6-bc31-48af-971d-9a061a82b202" acquired by "delete_volume" :: waited 0.024s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:50:33 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[a80f070e-9f56-44f2-8291-2fd619953910]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:50:33 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3b3f765c-fa93-4b1f-be33-4c0f3c85f0a9 tempest-VolumesExtendTest-1555024739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a390fab6-bc31-48af-971d-9a061a82b202 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:34 devstack sudo[98805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a390fab6-bc31-48af-971d-9a061a82b202 Sep 25 11:50:34 devstack sudo[98805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:34 devstack sudo[98805]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:34 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3b3f765c-fa93-4b1f-be33-4c0f3c85f0a9 tempest-VolumesExtendTest-1555024739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a390fab6-bc31-48af-971d-9a061a82b202" returned: 0 in 0.796s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:34 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3b3f765c-fa93-4b1f-be33-4c0f3c85f0a9 tempest-VolumesExtendTest-1555024739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a390fab6-bc31-48af-971d-9a061a82b202 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:34 devstack sudo[98810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a390fab6-bc31-48af-971d-9a061a82b202 Sep 25 11:50:34 devstack sudo[98810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:35 devstack sudo[98810]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:35 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3b3f765c-fa93-4b1f-be33-4c0f3c85f0a9 tempest-VolumesExtendTest-1555024739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a390fab6-bc31-48af-971d-9a061a82b202" returned: 0 in 0.373s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:35 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-3b3f765c-fa93-4b1f-be33-4c0f3c85f0a9 tempest-VolumesExtendTest-1555024739 None] Lock "cinder-quobyte-a390fab6-bc31-48af-971d-9a061a82b202" released by "delete_volume" :: held 1.272s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:50:35 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-3b3f765c-fa93-4b1f-be33-4c0f3c85f0a9 tempest-VolumesExtendTest-1555024739 None] Created reservations ['205cc6d8-df24-4bd3-9d37-a4f7927beaa4', 'bfdb59ee-6e11-420f-90d0-6ad75cd4ed2f', '9ef4ed31-5725-4017-b072-0cedca58799e', '0cced60e-4245-42fc-8a81-7670ae7d0508'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:50:35 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3b3f765c-fa93-4b1f-be33-4c0f3c85f0a9 tempest-VolumesExtendTest-1555024739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:50:35 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3b3f765c-fa93-4b1f-be33-4c0f3c85f0a9 tempest-VolumesExtendTest-1555024739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:50:35 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3b3f765c-fa93-4b1f-be33-4c0f3c85f0a9 tempest-VolumesExtendTest-1555024739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:50:35 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3b3f765c-fa93-4b1f-be33-4c0f3c85f0a9 tempest-VolumesExtendTest-1555024739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:50:35 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3b3f765c-fa93-4b1f-be33-4c0f3c85f0a9 tempest-VolumesExtendTest-1555024739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:50:35 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3b3f765c-fa93-4b1f-be33-4c0f3c85f0a9 tempest-VolumesExtendTest-1555024739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:35 devstack sudo[98813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:50:35 devstack sudo[98813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:35 devstack sudo[98813]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:35 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3b3f765c-fa93-4b1f-be33-4c0f3c85f0a9 tempest-VolumesExtendTest-1555024739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.412s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:35 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-3b3f765c-fa93-4b1f-be33-4c0f3c85f0a9 tempest-VolumesExtendTest-1555024739 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:50:35 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-3b3f765c-fa93-4b1f-be33-4c0f3c85f0a9 tempest-VolumesExtendTest-1555024739 None] Deleted volume successfully. Sep 25 11:50:35 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-3b3f765c-fa93-4b1f-be33-4c0f3c85f0a9 tempest-VolumesExtendTest-1555024739 None] Lock "cinder-a390fab6-bc31-48af-971d-9a061a82b202-delete_volume" released by "delete_volume" :: held 2.056s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:50:38 devstack cinder-volume[86984]: DEBUG oslo_service.periodic_task [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:50:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:50:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:50:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:50:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:50:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:50:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:38 devstack sudo[98817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:50:38 devstack sudo[98817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:39 devstack sudo[98817]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.547s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:39 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:50:39 devstack cinder-volume[86984]: DEBUG oslo_service.periodic_task [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running periodic task VolumeManager._thread_info {{(pid=86984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:50:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] thread count: 28 {{(pid=86984) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 11:50:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] thread info: [<_MainThread(MainThread, started 132046492332160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86984) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 11:50:41 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ea75b8e-4b31-459c-97e5-9246998f81a0 tempest-VolumesSnapshotListTestJSON-708270845 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:50:41 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3ea75b8e-4b31-459c-97e5-9246998f81a0 tempest-VolumesSnapshotListTestJSON-708270845 None] Flow 'volume_create_manager' (ddcdf4f3-2466-4c04-9d26-2c86e201ed90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:50:41 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3ea75b8e-4b31-459c-97e5-9246998f81a0 tempest-VolumesSnapshotListTestJSON-708270845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (682fea38-9caa-446d-95da-88c9998b2928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:50:41 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3ea75b8e-4b31-459c-97e5-9246998f81a0 tempest-VolumesSnapshotListTestJSON-708270845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (682fea38-9caa-446d-95da-88c9998b2928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:50:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-238966550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7771661-6035-4725-acf5-946232deb27e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c67bfa7abaf4450da2f7e83dc8ee57bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:50:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:50:41Z,use_quota=True,user_id='3647bdd95b854bcdb190852dcd6cb70b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:50:41 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3ea75b8e-4b31-459c-97e5-9246998f81a0 tempest-VolumesSnapshotListTestJSON-708270845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b83281d-7a58-4db4-a138-4b10b006d19b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:50:41 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3ea75b8e-4b31-459c-97e5-9246998f81a0 tempest-VolumesSnapshotListTestJSON-708270845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b83281d-7a58-4db4-a138-4b10b006d19b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:50:41 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3ea75b8e-4b31-459c-97e5-9246998f81a0 tempest-VolumesSnapshotListTestJSON-708270845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d80f9ae3-753a-4cc0-8ce2-c4fb579b907c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:50:41 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3ea75b8e-4b31-459c-97e5-9246998f81a0 tempest-VolumesSnapshotListTestJSON-708270845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d80f9ae3-753a-4cc0-8ce2-c4fb579b907c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7771661-6035-4725-acf5-946232deb27e', 'volume_name': 'volume-b7771661-6035-4725-acf5-946232deb27e', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:50:41 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3ea75b8e-4b31-459c-97e5-9246998f81a0 tempest-VolumesSnapshotListTestJSON-708270845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2d4d504-92c2-412e-ab9a-afc66d6f7124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:50:41 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3ea75b8e-4b31-459c-97e5-9246998f81a0 tempest-VolumesSnapshotListTestJSON-708270845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2d4d504-92c2-412e-ab9a-afc66d6f7124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:50:41 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3ea75b8e-4b31-459c-97e5-9246998f81a0 tempest-VolumesSnapshotListTestJSON-708270845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c188f04e-049f-4351-b1be-109070416504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:50:41 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-3ea75b8e-4b31-459c-97e5-9246998f81a0 tempest-VolumesSnapshotListTestJSON-708270845 None] Volume b7771661-6035-4725-acf5-946232deb27e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7771661-6035-4725-acf5-946232deb27e', 'volume_size': 1} Sep 25 11:50:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3ea75b8e-4b31-459c-97e5-9246998f81a0 tempest-VolumesSnapshotListTestJSON-708270845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:50:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3ea75b8e-4b31-459c-97e5-9246998f81a0 tempest-VolumesSnapshotListTestJSON-708270845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:50:41 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3ea75b8e-4b31-459c-97e5-9246998f81a0 tempest-VolumesSnapshotListTestJSON-708270845 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:50:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-238966550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7771661-6035-4725-acf5-946232deb27e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c67bfa7abaf4450da2f7e83dc8ee57bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:50:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:50:41Z,use_quota=True,user_id='3647bdd95b854bcdb190852dcd6cb70b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:50:41 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-3ea75b8e-4b31-459c-97e5-9246998f81a0 tempest-VolumesSnapshotListTestJSON-708270845 None] Creating volume b7771661-6035-4725-acf5-946232deb27e {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:50:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3ea75b8e-4b31-459c-97e5-9246998f81a0 tempest-VolumesSnapshotListTestJSON-708270845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:50:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3ea75b8e-4b31-459c-97e5-9246998f81a0 tempest-VolumesSnapshotListTestJSON-708270845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:50:41 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3ea75b8e-4b31-459c-97e5-9246998f81a0 tempest-VolumesSnapshotListTestJSON-708270845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:50:41 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3ea75b8e-4b31-459c-97e5-9246998f81a0 tempest-VolumesSnapshotListTestJSON-708270845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:50:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3ea75b8e-4b31-459c-97e5-9246998f81a0 tempest-VolumesSnapshotListTestJSON-708270845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:50:41 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3ea75b8e-4b31-459c-97e5-9246998f81a0 tempest-VolumesSnapshotListTestJSON-708270845 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:50:41 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-3ea75b8e-4b31-459c-97e5-9246998f81a0 tempest-VolumesSnapshotListTestJSON-708270845 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:50:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3ea75b8e-4b31-459c-97e5-9246998f81a0 tempest-VolumesSnapshotListTestJSON-708270845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:41 devstack sudo[98827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e 1073741824 Sep 25 11:50:41 devstack sudo[98827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:42 devstack sudo[98827]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:42 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3ea75b8e-4b31-459c-97e5-9246998f81a0 tempest-VolumesSnapshotListTestJSON-708270845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e 1073741824" returned: 0 in 0.896s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:42 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3ea75b8e-4b31-459c-97e5-9246998f81a0 tempest-VolumesSnapshotListTestJSON-708270845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:42 devstack sudo[98833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e Sep 25 11:50:42 devstack sudo[98833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:42 devstack sudo[98833]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:42 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3ea75b8e-4b31-459c-97e5-9246998f81a0 tempest-VolumesSnapshotListTestJSON-708270845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e" returned: 0 in 0.481s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:42 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3ea75b8e-4b31-459c-97e5-9246998f81a0 tempest-VolumesSnapshotListTestJSON-708270845 None] <== create_volume: return (1511ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:50:42 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3ea75b8e-4b31-459c-97e5-9246998f81a0 tempest-VolumesSnapshotListTestJSON-708270845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.514s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:50:42 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3ea75b8e-4b31-459c-97e5-9246998f81a0 tempest-VolumesSnapshotListTestJSON-708270845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c188f04e-049f-4351-b1be-109070416504) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7771661-6035-4725-acf5-946232deb27e', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:50:42 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3ea75b8e-4b31-459c-97e5-9246998f81a0 tempest-VolumesSnapshotListTestJSON-708270845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04041764-554d-4e4a-b314-6911a01afc8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:50:43 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-3ea75b8e-4b31-459c-97e5-9246998f81a0 tempest-VolumesSnapshotListTestJSON-708270845 None] Volume volume-b7771661-6035-4725-acf5-946232deb27e (b7771661-6035-4725-acf5-946232deb27e): created successfully Sep 25 11:50:43 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3ea75b8e-4b31-459c-97e5-9246998f81a0 tempest-VolumesSnapshotListTestJSON-708270845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04041764-554d-4e4a-b314-6911a01afc8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:50:43 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3ea75b8e-4b31-459c-97e5-9246998f81a0 tempest-VolumesSnapshotListTestJSON-708270845 None] Flow 'volume_create_manager' (ddcdf4f3-2466-4c04-9d26-2c86e201ed90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:50:43 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-3ea75b8e-4b31-459c-97e5-9246998f81a0 tempest-VolumesSnapshotListTestJSON-708270845 None] Created volume successfully. Sep 25 11:50:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-21c5fa52-7c79-4611-97ae-a7dcd14ae3b1 tempest-VolumesSnapshotListTestJSON-708270845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:50:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-21c5fa52-7c79-4611-97ae-a7dcd14ae3b1 tempest-VolumesSnapshotListTestJSON-708270845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:50:44 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-21c5fa52-7c79-4611-97ae-a7dcd14ae3b1 tempest-VolumesSnapshotListTestJSON-708270845 None] Creating offline snapshot 38d9fca9-7935-4d7a-afb5-7354879a59f0 of volume b7771661-6035-4725-acf5-946232deb27e {{(pid=86984) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:50:44 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[1773dad5-8ec9-4d68-bee1-0f174fb4b1ac]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:50:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-21c5fa52-7c79-4611-97ae-a7dcd14ae3b1 tempest-VolumesSnapshotListTestJSON-708270845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:44 devstack sudo[98837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e Sep 25 11:50:44 devstack sudo[98837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:44 devstack sudo[98837]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-21c5fa52-7c79-4611-97ae-a7dcd14ae3b1 tempest-VolumesSnapshotListTestJSON-708270845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e" returned: 0 in 0.687s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-21c5fa52-7c79-4611-97ae-a7dcd14ae3b1 tempest-VolumesSnapshotListTestJSON-708270845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e.38d9fca9-7935-4d7a-afb5-7354879a59f0 1G {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:44 devstack sudo[98842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e.38d9fca9-7935-4d7a-afb5-7354879a59f0 1G Sep 25 11:50:44 devstack sudo[98842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:45 devstack sudo[98842]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-21c5fa52-7c79-4611-97ae-a7dcd14ae3b1 tempest-VolumesSnapshotListTestJSON-708270845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e.38d9fca9-7935-4d7a-afb5-7354879a59f0 1G" returned: 0 in 0.842s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-21c5fa52-7c79-4611-97ae-a7dcd14ae3b1 tempest-VolumesSnapshotListTestJSON-708270845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7771661-6035-4725-acf5-946232deb27e -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e.38d9fca9-7935-4d7a-afb5-7354879a59f0 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:45 devstack sudo[98848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7771661-6035-4725-acf5-946232deb27e -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e.38d9fca9-7935-4d7a-afb5-7354879a59f0 Sep 25 11:50:45 devstack sudo[98848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:46 devstack sudo[98848]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-21c5fa52-7c79-4611-97ae-a7dcd14ae3b1 tempest-VolumesSnapshotListTestJSON-708270845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7771661-6035-4725-acf5-946232deb27e -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e.38d9fca9-7935-4d7a-afb5-7354879a59f0" returned: 0 in 0.512s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:46 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-21c5fa52-7c79-4611-97ae-a7dcd14ae3b1 tempest-VolumesSnapshotListTestJSON-708270845 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e.38d9fca9-7935-4d7a-afb5-7354879a59f0 is being set with open permissions: ugo+rw Sep 25 11:50:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-21c5fa52-7c79-4611-97ae-a7dcd14ae3b1 tempest-VolumesSnapshotListTestJSON-708270845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e.38d9fca9-7935-4d7a-afb5-7354879a59f0 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:46 devstack sudo[98853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e.38d9fca9-7935-4d7a-afb5-7354879a59f0 Sep 25 11:50:46 devstack sudo[98853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:46 devstack sudo[98853]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-21c5fa52-7c79-4611-97ae-a7dcd14ae3b1 tempest-VolumesSnapshotListTestJSON-708270845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e.38d9fca9-7935-4d7a-afb5-7354879a59f0" returned: 0 in 0.481s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-21c5fa52-7c79-4611-97ae-a7dcd14ae3b1 tempest-VolumesSnapshotListTestJSON-708270845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:46 devstack sudo[98856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e.info Sep 25 11:50:46 devstack sudo[98856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:47 devstack sudo[98856]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-21c5fa52-7c79-4611-97ae-a7dcd14ae3b1 tempest-VolumesSnapshotListTestJSON-708270845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e.info" returned: 0 in 0.577s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:47 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-21c5fa52-7c79-4611-97ae-a7dcd14ae3b1 tempest-VolumesSnapshotListTestJSON-708270845 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e.info is being set with open permissions: ugo+rw Sep 25 11:50:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-21c5fa52-7c79-4611-97ae-a7dcd14ae3b1 tempest-VolumesSnapshotListTestJSON-708270845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:47 devstack sudo[98859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e.info Sep 25 11:50:47 devstack sudo[98859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:47 devstack sudo[98859]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-21c5fa52-7c79-4611-97ae-a7dcd14ae3b1 tempest-VolumesSnapshotListTestJSON-708270845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e.info" returned: 0 in 0.563s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-21c5fa52-7c79-4611-97ae-a7dcd14ae3b1 tempest-VolumesSnapshotListTestJSON-708270845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.890s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:50:47 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-21c5fa52-7c79-4611-97ae-a7dcd14ae3b1 tempest-VolumesSnapshotListTestJSON-708270845 None] Create snapshot completed successfully Sep 25 11:50:48 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce2448c3-4c64-42e2-9cb1-556345357018 tempest-VolumesListTestJSON-1420959277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:50:48 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ce2448c3-4c64-42e2-9cb1-556345357018 tempest-VolumesListTestJSON-1420959277 None] Flow 'volume_create_manager' (8ee07234-a311-4d0c-a53b-ef3ec531321a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:50:48 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ce2448c3-4c64-42e2-9cb1-556345357018 tempest-VolumesListTestJSON-1420959277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f272dbd0-883e-474b-a95f-a8285d8dff50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:50:48 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ce2448c3-4c64-42e2-9cb1-556345357018 tempest-VolumesListTestJSON-1420959277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f272dbd0-883e-474b-a95f-a8285d8dff50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:50:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-586777083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=602ea4eb-a902-494a-91a1-896918239abf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='88662043abaa4747a9161a3a87794853',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:50:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:50:48Z,use_quota=True,user_id='82db508d60064f9c8837ff8ebc151a76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:50:48 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ce2448c3-4c64-42e2-9cb1-556345357018 tempest-VolumesListTestJSON-1420959277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2da625b8-5657-4130-98c8-9c1751ece944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:50:48 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ce2448c3-4c64-42e2-9cb1-556345357018 tempest-VolumesListTestJSON-1420959277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2da625b8-5657-4130-98c8-9c1751ece944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:50:48 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ce2448c3-4c64-42e2-9cb1-556345357018 tempest-VolumesListTestJSON-1420959277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ee0745f-2b68-45fa-9459-bb5b13f72847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:50:48 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ce2448c3-4c64-42e2-9cb1-556345357018 tempest-VolumesListTestJSON-1420959277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ee0745f-2b68-45fa-9459-bb5b13f72847) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '602ea4eb-a902-494a-91a1-896918239abf', 'volume_name': 'volume-602ea4eb-a902-494a-91a1-896918239abf', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:50:48 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ce2448c3-4c64-42e2-9cb1-556345357018 tempest-VolumesListTestJSON-1420959277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b539cbb-af2a-4335-8269-b72fce43fa63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:50:48 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ce2448c3-4c64-42e2-9cb1-556345357018 tempest-VolumesListTestJSON-1420959277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b539cbb-af2a-4335-8269-b72fce43fa63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:50:48 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ce2448c3-4c64-42e2-9cb1-556345357018 tempest-VolumesListTestJSON-1420959277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (237043ee-a508-481b-a820-be2c85202e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:50:48 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-ce2448c3-4c64-42e2-9cb1-556345357018 tempest-VolumesListTestJSON-1420959277 None] Volume 602ea4eb-a902-494a-91a1-896918239abf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-602ea4eb-a902-494a-91a1-896918239abf', 'volume_size': 1} Sep 25 11:50:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-ce2448c3-4c64-42e2-9cb1-556345357018 tempest-VolumesListTestJSON-1420959277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:50:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-ce2448c3-4c64-42e2-9cb1-556345357018 tempest-VolumesListTestJSON-1420959277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:50:48 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-ce2448c3-4c64-42e2-9cb1-556345357018 tempest-VolumesListTestJSON-1420959277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:50:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-586777083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=602ea4eb-a902-494a-91a1-896918239abf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='88662043abaa4747a9161a3a87794853',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:50:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:50:48Z,use_quota=True,user_id='82db508d60064f9c8837ff8ebc151a76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:50:48 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-ce2448c3-4c64-42e2-9cb1-556345357018 tempest-VolumesListTestJSON-1420959277 None] Creating volume 602ea4eb-a902-494a-91a1-896918239abf {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:50:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-ce2448c3-4c64-42e2-9cb1-556345357018 tempest-VolumesListTestJSON-1420959277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:50:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-ce2448c3-4c64-42e2-9cb1-556345357018 tempest-VolumesListTestJSON-1420959277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:50:48 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-ce2448c3-4c64-42e2-9cb1-556345357018 tempest-VolumesListTestJSON-1420959277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:50:48 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-ce2448c3-4c64-42e2-9cb1-556345357018 tempest-VolumesListTestJSON-1420959277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:50:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-ce2448c3-4c64-42e2-9cb1-556345357018 tempest-VolumesListTestJSON-1420959277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:50:48 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-ce2448c3-4c64-42e2-9cb1-556345357018 tempest-VolumesListTestJSON-1420959277 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:50:48 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-ce2448c3-4c64-42e2-9cb1-556345357018 tempest-VolumesListTestJSON-1420959277 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:50:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ce2448c3-4c64-42e2-9cb1-556345357018 tempest-VolumesListTestJSON-1420959277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-602ea4eb-a902-494a-91a1-896918239abf 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:48 devstack sudo[98896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-602ea4eb-a902-494a-91a1-896918239abf 1073741824 Sep 25 11:50:48 devstack sudo[98896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-399bbf27-1d21-4fba-9c83-8f5005ce54f6 tempest-VolumesSnapshotListTestJSON-708270845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:50:49 devstack sudo[98896]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ce2448c3-4c64-42e2-9cb1-556345357018 tempest-VolumesListTestJSON-1420959277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-602ea4eb-a902-494a-91a1-896918239abf 1073741824" returned: 0 in 0.889s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:49 devstack cinder-volume[86984]: DEBUG dbcounter [-] [86984] Writing DB stats cinder:UPDATE=145,cinder:SELECT=100,cinder:INSERT=40,cinder:DELETE=11 {{(pid=86984) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:50:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ce2448c3-4c64-42e2-9cb1-556345357018 tempest-VolumesListTestJSON-1420959277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-602ea4eb-a902-494a-91a1-896918239abf {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:49 devstack sudo[98904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-602ea4eb-a902-494a-91a1-896918239abf Sep 25 11:50:49 devstack sudo[98904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:49 devstack sudo[98904]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ce2448c3-4c64-42e2-9cb1-556345357018 tempest-VolumesListTestJSON-1420959277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-602ea4eb-a902-494a-91a1-896918239abf" returned: 0 in 0.394s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:49 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-ce2448c3-4c64-42e2-9cb1-556345357018 tempest-VolumesListTestJSON-1420959277 None] <== create_volume: return (1379ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:50:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-ce2448c3-4c64-42e2-9cb1-556345357018 tempest-VolumesListTestJSON-1420959277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.388s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:50:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-399bbf27-1d21-4fba-9c83-8f5005ce54f6 tempest-VolumesSnapshotListTestJSON-708270845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.115s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:50:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ce2448c3-4c64-42e2-9cb1-556345357018 tempest-VolumesListTestJSON-1420959277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (237043ee-a508-481b-a820-be2c85202e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-602ea4eb-a902-494a-91a1-896918239abf', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:50:50 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ce2448c3-4c64-42e2-9cb1-556345357018 tempest-VolumesListTestJSON-1420959277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1d1cc45-f640-4a9f-bc2e-251f8cadbe47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:50:50 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-399bbf27-1d21-4fba-9c83-8f5005ce54f6 tempest-VolumesSnapshotListTestJSON-708270845 None] Creating offline snapshot 10002c96-ae9c-47df-849f-4ddcacbbfd1c of volume b7771661-6035-4725-acf5-946232deb27e {{(pid=86984) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:50:50 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-ce2448c3-4c64-42e2-9cb1-556345357018 tempest-VolumesListTestJSON-1420959277 None] Volume volume-602ea4eb-a902-494a-91a1-896918239abf (602ea4eb-a902-494a-91a1-896918239abf): created successfully Sep 25 11:50:50 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ce2448c3-4c64-42e2-9cb1-556345357018 tempest-VolumesListTestJSON-1420959277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1d1cc45-f640-4a9f-bc2e-251f8cadbe47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:50:50 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ce2448c3-4c64-42e2-9cb1-556345357018 tempest-VolumesListTestJSON-1420959277 None] Flow 'volume_create_manager' (8ee07234-a311-4d0c-a53b-ef3ec531321a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:50:50 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aaa2ada-e858-4191-9223-a6dcf014aa61]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:50:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-399bbf27-1d21-4fba-9c83-8f5005ce54f6 tempest-VolumesSnapshotListTestJSON-708270845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e.38d9fca9-7935-4d7a-afb5-7354879a59f0 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:50 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-ce2448c3-4c64-42e2-9cb1-556345357018 tempest-VolumesListTestJSON-1420959277 None] Created volume successfully. Sep 25 11:50:50 devstack sudo[98907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e.38d9fca9-7935-4d7a-afb5-7354879a59f0 Sep 25 11:50:50 devstack sudo[98907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:51 devstack sudo[98907]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-399bbf27-1d21-4fba-9c83-8f5005ce54f6 tempest-VolumesSnapshotListTestJSON-708270845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e.38d9fca9-7935-4d7a-afb5-7354879a59f0" returned: 0 in 1.043s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:51 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-399bbf27-1d21-4fba-9c83-8f5005ce54f6 tempest-VolumesSnapshotListTestJSON-708270845 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7771661-6035-4725-acf5-946232deb27e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86984) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:50:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-399bbf27-1d21-4fba-9c83-8f5005ce54f6 tempest-VolumesSnapshotListTestJSON-708270845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e.38d9fca9-7935-4d7a-afb5-7354879a59f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e.10002c96-ae9c-47df-849f-4ddcacbbfd1c 1G {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:51 devstack sudo[98912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e.38d9fca9-7935-4d7a-afb5-7354879a59f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e.10002c96-ae9c-47df-849f-4ddcacbbfd1c 1G Sep 25 11:50:51 devstack sudo[98912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:52 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb3ad361-20c4-4e56-a7b0-b01487d4fd38 tempest-VolumesListTestJSON-1420959277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:50:52 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-bb3ad361-20c4-4e56-a7b0-b01487d4fd38 tempest-VolumesListTestJSON-1420959277 None] Flow 'volume_create_manager' (95002685-221e-460b-9711-26eb7cbec994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:50:52 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-bb3ad361-20c4-4e56-a7b0-b01487d4fd38 tempest-VolumesListTestJSON-1420959277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55ef5cd9-955f-4ba3-a51b-8ad543746480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:50:52 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-bb3ad361-20c4-4e56-a7b0-b01487d4fd38 tempest-VolumesListTestJSON-1420959277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55ef5cd9-955f-4ba3-a51b-8ad543746480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:50:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-574787920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=623a0f57-42b1-4519-b0ee-28443cdce267,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='88662043abaa4747a9161a3a87794853',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:50:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:50:52Z,use_quota=True,user_id='82db508d60064f9c8837ff8ebc151a76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:50:52 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-bb3ad361-20c4-4e56-a7b0-b01487d4fd38 tempest-VolumesListTestJSON-1420959277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bd0273c-b5b0-4b3b-ad7b-acc7b0fcff0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:50:52 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-bb3ad361-20c4-4e56-a7b0-b01487d4fd38 tempest-VolumesListTestJSON-1420959277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bd0273c-b5b0-4b3b-ad7b-acc7b0fcff0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:50:52 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-bb3ad361-20c4-4e56-a7b0-b01487d4fd38 tempest-VolumesListTestJSON-1420959277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04de1af2-21da-4faa-b77d-f5e797a4d8a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:50:52 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-bb3ad361-20c4-4e56-a7b0-b01487d4fd38 tempest-VolumesListTestJSON-1420959277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04de1af2-21da-4faa-b77d-f5e797a4d8a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '623a0f57-42b1-4519-b0ee-28443cdce267', 'volume_name': 'volume-623a0f57-42b1-4519-b0ee-28443cdce267', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:50:52 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-bb3ad361-20c4-4e56-a7b0-b01487d4fd38 tempest-VolumesListTestJSON-1420959277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62cde880-eb11-4dcd-9f4b-6cc402e6bdd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:50:52 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-bb3ad361-20c4-4e56-a7b0-b01487d4fd38 tempest-VolumesListTestJSON-1420959277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62cde880-eb11-4dcd-9f4b-6cc402e6bdd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:50:52 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-bb3ad361-20c4-4e56-a7b0-b01487d4fd38 tempest-VolumesListTestJSON-1420959277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb80d4fb-f10a-4f34-8c65-582ef09ce8f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:50:52 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-bb3ad361-20c4-4e56-a7b0-b01487d4fd38 tempest-VolumesListTestJSON-1420959277 None] Volume 623a0f57-42b1-4519-b0ee-28443cdce267: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-623a0f57-42b1-4519-b0ee-28443cdce267', 'volume_size': 1} Sep 25 11:50:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-bb3ad361-20c4-4e56-a7b0-b01487d4fd38 tempest-VolumesListTestJSON-1420959277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:50:52 devstack sudo[98912]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-399bbf27-1d21-4fba-9c83-8f5005ce54f6 tempest-VolumesSnapshotListTestJSON-708270845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e.38d9fca9-7935-4d7a-afb5-7354879a59f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e.10002c96-ae9c-47df-849f-4ddcacbbfd1c 1G" returned: 0 in 1.082s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-399bbf27-1d21-4fba-9c83-8f5005ce54f6 tempest-VolumesSnapshotListTestJSON-708270845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7771661-6035-4725-acf5-946232deb27e.38d9fca9-7935-4d7a-afb5-7354879a59f0 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e.10002c96-ae9c-47df-849f-4ddcacbbfd1c {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:52 devstack sudo[98917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7771661-6035-4725-acf5-946232deb27e.38d9fca9-7935-4d7a-afb5-7354879a59f0 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e.10002c96-ae9c-47df-849f-4ddcacbbfd1c Sep 25 11:50:52 devstack sudo[98917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:52 devstack sudo[98917]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-399bbf27-1d21-4fba-9c83-8f5005ce54f6 tempest-VolumesSnapshotListTestJSON-708270845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7771661-6035-4725-acf5-946232deb27e.38d9fca9-7935-4d7a-afb5-7354879a59f0 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e.10002c96-ae9c-47df-849f-4ddcacbbfd1c" returned: 0 in 0.570s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:52 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-399bbf27-1d21-4fba-9c83-8f5005ce54f6 tempest-VolumesSnapshotListTestJSON-708270845 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e.10002c96-ae9c-47df-849f-4ddcacbbfd1c is being set with open permissions: ugo+rw Sep 25 11:50:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-399bbf27-1d21-4fba-9c83-8f5005ce54f6 tempest-VolumesSnapshotListTestJSON-708270845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e.10002c96-ae9c-47df-849f-4ddcacbbfd1c {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:52 devstack sudo[98925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e.10002c96-ae9c-47df-849f-4ddcacbbfd1c Sep 25 11:50:52 devstack sudo[98925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:53 devstack sudo[98925]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-399bbf27-1d21-4fba-9c83-8f5005ce54f6 tempest-VolumesSnapshotListTestJSON-708270845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e.10002c96-ae9c-47df-849f-4ddcacbbfd1c" returned: 0 in 0.466s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-399bbf27-1d21-4fba-9c83-8f5005ce54f6 tempest-VolumesSnapshotListTestJSON-708270845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.401s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:50:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-bb3ad361-20c4-4e56-a7b0-b01487d4fd38 tempest-VolumesListTestJSON-1420959277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.172s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:50:53 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-bb3ad361-20c4-4e56-a7b0-b01487d4fd38 tempest-VolumesListTestJSON-1420959277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:50:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-574787920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=623a0f57-42b1-4519-b0ee-28443cdce267,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='88662043abaa4747a9161a3a87794853',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:50:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:50:52Z,use_quota=True,user_id='82db508d60064f9c8837ff8ebc151a76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:50:53 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-bb3ad361-20c4-4e56-a7b0-b01487d4fd38 tempest-VolumesListTestJSON-1420959277 None] Creating volume 623a0f57-42b1-4519-b0ee-28443cdce267 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:50:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-bb3ad361-20c4-4e56-a7b0-b01487d4fd38 tempest-VolumesListTestJSON-1420959277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:50:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-bb3ad361-20c4-4e56-a7b0-b01487d4fd38 tempest-VolumesListTestJSON-1420959277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:50:53 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-bb3ad361-20c4-4e56-a7b0-b01487d4fd38 tempest-VolumesListTestJSON-1420959277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:50:53 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-bb3ad361-20c4-4e56-a7b0-b01487d4fd38 tempest-VolumesListTestJSON-1420959277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:50:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-bb3ad361-20c4-4e56-a7b0-b01487d4fd38 tempest-VolumesListTestJSON-1420959277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:50:53 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-bb3ad361-20c4-4e56-a7b0-b01487d4fd38 tempest-VolumesListTestJSON-1420959277 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:50:53 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-bb3ad361-20c4-4e56-a7b0-b01487d4fd38 tempest-VolumesListTestJSON-1420959277 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:50:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-bb3ad361-20c4-4e56-a7b0-b01487d4fd38 tempest-VolumesListTestJSON-1420959277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-623a0f57-42b1-4519-b0ee-28443cdce267 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:53 devstack sudo[98929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-623a0f57-42b1-4519-b0ee-28443cdce267 1073741824 Sep 25 11:50:53 devstack sudo[98929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:53 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-399bbf27-1d21-4fba-9c83-8f5005ce54f6 tempest-VolumesSnapshotListTestJSON-708270845 None] Create snapshot completed successfully Sep 25 11:50:54 devstack sudo[98929]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-bb3ad361-20c4-4e56-a7b0-b01487d4fd38 tempest-VolumesListTestJSON-1420959277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-623a0f57-42b1-4519-b0ee-28443cdce267 1073741824" returned: 0 in 0.709s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-bb3ad361-20c4-4e56-a7b0-b01487d4fd38 tempest-VolumesListTestJSON-1420959277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-623a0f57-42b1-4519-b0ee-28443cdce267 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:54 devstack sudo[98935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-623a0f57-42b1-4519-b0ee-28443cdce267 Sep 25 11:50:54 devstack sudo[98935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-c413defc-aca1-4f50-bfc0-b650392cf48a tempest-VolumesSnapshotListTestJSON-708270845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:50:54 devstack sudo[98935]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-bb3ad361-20c4-4e56-a7b0-b01487d4fd38 tempest-VolumesListTestJSON-1420959277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-623a0f57-42b1-4519-b0ee-28443cdce267" returned: 0 in 0.535s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:54 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-bb3ad361-20c4-4e56-a7b0-b01487d4fd38 tempest-VolumesListTestJSON-1420959277 None] <== create_volume: return (1318ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:50:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-bb3ad361-20c4-4e56-a7b0-b01487d4fd38 tempest-VolumesListTestJSON-1420959277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.321s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:50:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-c413defc-aca1-4f50-bfc0-b650392cf48a tempest-VolumesSnapshotListTestJSON-708270845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.068s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:50:54 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-c413defc-aca1-4f50-bfc0-b650392cf48a tempest-VolumesSnapshotListTestJSON-708270845 None] Creating offline snapshot 1e9c0b0c-6bfc-4228-abbd-162654ec29f5 of volume b7771661-6035-4725-acf5-946232deb27e {{(pid=86984) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:50:54 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-bb3ad361-20c4-4e56-a7b0-b01487d4fd38 tempest-VolumesListTestJSON-1420959277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb80d4fb-f10a-4f34-8c65-582ef09ce8f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-623a0f57-42b1-4519-b0ee-28443cdce267', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:50:54 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-bb3ad361-20c4-4e56-a7b0-b01487d4fd38 tempest-VolumesListTestJSON-1420959277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6e87a3a-7404-41b6-89b5-b4eddc0d4e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:50:54 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a04dc58-e2f7-4e42-92d8-cdb80efd4033]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:50:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-c413defc-aca1-4f50-bfc0-b650392cf48a tempest-VolumesSnapshotListTestJSON-708270845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e.10002c96-ae9c-47df-849f-4ddcacbbfd1c {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:54 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-bb3ad361-20c4-4e56-a7b0-b01487d4fd38 tempest-VolumesListTestJSON-1420959277 None] Volume volume-623a0f57-42b1-4519-b0ee-28443cdce267 (623a0f57-42b1-4519-b0ee-28443cdce267): created successfully Sep 25 11:50:54 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-bb3ad361-20c4-4e56-a7b0-b01487d4fd38 tempest-VolumesListTestJSON-1420959277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6e87a3a-7404-41b6-89b5-b4eddc0d4e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:50:54 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-bb3ad361-20c4-4e56-a7b0-b01487d4fd38 tempest-VolumesListTestJSON-1420959277 None] Flow 'volume_create_manager' (95002685-221e-460b-9711-26eb7cbec994) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:50:54 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-bb3ad361-20c4-4e56-a7b0-b01487d4fd38 tempest-VolumesListTestJSON-1420959277 None] Created volume successfully. Sep 25 11:50:55 devstack sudo[98939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e.10002c96-ae9c-47df-849f-4ddcacbbfd1c Sep 25 11:50:55 devstack sudo[98939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:55 devstack sudo[98939]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-c413defc-aca1-4f50-bfc0-b650392cf48a tempest-VolumesSnapshotListTestJSON-708270845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e.10002c96-ae9c-47df-849f-4ddcacbbfd1c" returned: 0 in 0.840s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:55 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-c413defc-aca1-4f50-bfc0-b650392cf48a tempest-VolumesSnapshotListTestJSON-708270845 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7771661-6035-4725-acf5-946232deb27e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86984) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:50:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-c413defc-aca1-4f50-bfc0-b650392cf48a tempest-VolumesSnapshotListTestJSON-708270845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e.10002c96-ae9c-47df-849f-4ddcacbbfd1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e.1e9c0b0c-6bfc-4228-abbd-162654ec29f5 1G {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:55 devstack sudo[98954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e.10002c96-ae9c-47df-849f-4ddcacbbfd1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e.1e9c0b0c-6bfc-4228-abbd-162654ec29f5 1G Sep 25 11:50:55 devstack sudo[98954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:56 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-a73d80d1-221b-4de0-a85d-f518d053f00d tempest-VolumesListTestJSON-1420959277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:50:56 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-a73d80d1-221b-4de0-a85d-f518d053f00d tempest-VolumesListTestJSON-1420959277 None] Flow 'volume_create_manager' (fe5fc4ea-d84d-43cc-96c8-a95ea6b555bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:50:56 devstack sudo[98954]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:56 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-a73d80d1-221b-4de0-a85d-f518d053f00d tempest-VolumesListTestJSON-1420959277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b89a8219-dd38-4f81-a22e-ecf05e769076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:50:56 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-c413defc-aca1-4f50-bfc0-b650392cf48a tempest-VolumesSnapshotListTestJSON-708270845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e.10002c96-ae9c-47df-849f-4ddcacbbfd1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e.1e9c0b0c-6bfc-4228-abbd-162654ec29f5 1G" returned: 0 in 1.009s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:56 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-c413defc-aca1-4f50-bfc0-b650392cf48a tempest-VolumesSnapshotListTestJSON-708270845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7771661-6035-4725-acf5-946232deb27e.10002c96-ae9c-47df-849f-4ddcacbbfd1c -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e.1e9c0b0c-6bfc-4228-abbd-162654ec29f5 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:56 devstack sudo[98967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7771661-6035-4725-acf5-946232deb27e.10002c96-ae9c-47df-849f-4ddcacbbfd1c -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e.1e9c0b0c-6bfc-4228-abbd-162654ec29f5 Sep 25 11:50:56 devstack sudo[98967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:56 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-a73d80d1-221b-4de0-a85d-f518d053f00d tempest-VolumesListTestJSON-1420959277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b89a8219-dd38-4f81-a22e-ecf05e769076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:50:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1368294876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e60d91f-75d4-400b-bd53-780c787f2628,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='88662043abaa4747a9161a3a87794853',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:50:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:50:57Z,use_quota=True,user_id='82db508d60064f9c8837ff8ebc151a76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:50:56 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-a73d80d1-221b-4de0-a85d-f518d053f00d tempest-VolumesListTestJSON-1420959277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17b64425-3594-43b8-9d51-4657cb2f06e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:50:56 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-a73d80d1-221b-4de0-a85d-f518d053f00d tempest-VolumesListTestJSON-1420959277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17b64425-3594-43b8-9d51-4657cb2f06e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:50:56 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-a73d80d1-221b-4de0-a85d-f518d053f00d tempest-VolumesListTestJSON-1420959277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c9de861-9f93-48a7-8f27-c76e0e5acb0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:50:56 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-a73d80d1-221b-4de0-a85d-f518d053f00d tempest-VolumesListTestJSON-1420959277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c9de861-9f93-48a7-8f27-c76e0e5acb0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e60d91f-75d4-400b-bd53-780c787f2628', 'volume_name': 'volume-1e60d91f-75d4-400b-bd53-780c787f2628', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:50:56 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-a73d80d1-221b-4de0-a85d-f518d053f00d tempest-VolumesListTestJSON-1420959277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30df5842-3867-4c7c-971c-757658ab45e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:50:56 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-a73d80d1-221b-4de0-a85d-f518d053f00d tempest-VolumesListTestJSON-1420959277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30df5842-3867-4c7c-971c-757658ab45e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:50:56 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-a73d80d1-221b-4de0-a85d-f518d053f00d tempest-VolumesListTestJSON-1420959277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82dc7495-55a3-4ed3-bc63-a7877b7f0991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:50:56 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-a73d80d1-221b-4de0-a85d-f518d053f00d tempest-VolumesListTestJSON-1420959277 None] Volume 1e60d91f-75d4-400b-bd53-780c787f2628: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e60d91f-75d4-400b-bd53-780c787f2628', 'volume_size': 1} Sep 25 11:50:56 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-a73d80d1-221b-4de0-a85d-f518d053f00d tempest-VolumesListTestJSON-1420959277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:50:57 devstack sudo[98967]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:57 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-c413defc-aca1-4f50-bfc0-b650392cf48a tempest-VolumesSnapshotListTestJSON-708270845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7771661-6035-4725-acf5-946232deb27e.10002c96-ae9c-47df-849f-4ddcacbbfd1c -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e.1e9c0b0c-6bfc-4228-abbd-162654ec29f5" returned: 0 in 0.395s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:57 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-c413defc-aca1-4f50-bfc0-b650392cf48a tempest-VolumesSnapshotListTestJSON-708270845 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e.1e9c0b0c-6bfc-4228-abbd-162654ec29f5 is being set with open permissions: ugo+rw Sep 25 11:50:57 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-c413defc-aca1-4f50-bfc0-b650392cf48a tempest-VolumesSnapshotListTestJSON-708270845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e.1e9c0b0c-6bfc-4228-abbd-162654ec29f5 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:57 devstack sudo[98972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e.1e9c0b0c-6bfc-4228-abbd-162654ec29f5 Sep 25 11:50:57 devstack sudo[98972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:57 devstack sudo[98972]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:57 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-c413defc-aca1-4f50-bfc0-b650392cf48a tempest-VolumesSnapshotListTestJSON-708270845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e.1e9c0b0c-6bfc-4228-abbd-162654ec29f5" returned: 0 in 0.299s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:57 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-c413defc-aca1-4f50-bfc0-b650392cf48a tempest-VolumesSnapshotListTestJSON-708270845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.756s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:50:57 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-a73d80d1-221b-4de0-a85d-f518d053f00d tempest-VolumesListTestJSON-1420959277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.638s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:50:57 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-a73d80d1-221b-4de0-a85d-f518d053f00d tempest-VolumesListTestJSON-1420959277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:50:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1368294876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e60d91f-75d4-400b-bd53-780c787f2628,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='88662043abaa4747a9161a3a87794853',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:50:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:50:57Z,use_quota=True,user_id='82db508d60064f9c8837ff8ebc151a76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:50:57 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-a73d80d1-221b-4de0-a85d-f518d053f00d tempest-VolumesListTestJSON-1420959277 None] Creating volume 1e60d91f-75d4-400b-bd53-780c787f2628 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:50:57 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-a73d80d1-221b-4de0-a85d-f518d053f00d tempest-VolumesListTestJSON-1420959277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:50:57 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-a73d80d1-221b-4de0-a85d-f518d053f00d tempest-VolumesListTestJSON-1420959277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:50:57 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-a73d80d1-221b-4de0-a85d-f518d053f00d tempest-VolumesListTestJSON-1420959277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:50:57 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-a73d80d1-221b-4de0-a85d-f518d053f00d tempest-VolumesListTestJSON-1420959277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:50:57 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-a73d80d1-221b-4de0-a85d-f518d053f00d tempest-VolumesListTestJSON-1420959277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:50:57 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-a73d80d1-221b-4de0-a85d-f518d053f00d tempest-VolumesListTestJSON-1420959277 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:50:57 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-a73d80d1-221b-4de0-a85d-f518d053f00d tempest-VolumesListTestJSON-1420959277 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:50:57 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a73d80d1-221b-4de0-a85d-f518d053f00d tempest-VolumesListTestJSON-1420959277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1e60d91f-75d4-400b-bd53-780c787f2628 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:57 devstack sudo[98975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1e60d91f-75d4-400b-bd53-780c787f2628 1073741824 Sep 25 11:50:57 devstack sudo[98975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:57 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-c413defc-aca1-4f50-bfc0-b650392cf48a tempest-VolumesSnapshotListTestJSON-708270845 None] Create snapshot completed successfully Sep 25 11:50:58 devstack sudo[98975]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:58 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a73d80d1-221b-4de0-a85d-f518d053f00d tempest-VolumesListTestJSON-1420959277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1e60d91f-75d4-400b-bd53-780c787f2628 1073741824" returned: 0 in 0.853s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:58 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a73d80d1-221b-4de0-a85d-f518d053f00d tempest-VolumesListTestJSON-1420959277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1e60d91f-75d4-400b-bd53-780c787f2628 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:50:58 devstack sudo[98981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1e60d91f-75d4-400b-bd53-780c787f2628 Sep 25 11:50:58 devstack sudo[98981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:50:58 devstack sudo[98981]: pam_unix(sudo:session): session closed for user root Sep 25 11:50:58 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a73d80d1-221b-4de0-a85d-f518d053f00d tempest-VolumesListTestJSON-1420959277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1e60d91f-75d4-400b-bd53-780c787f2628" returned: 0 in 0.403s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:50:58 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-a73d80d1-221b-4de0-a85d-f518d053f00d tempest-VolumesListTestJSON-1420959277 None] <== create_volume: return (1344ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:50:58 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-a73d80d1-221b-4de0-a85d-f518d053f00d tempest-VolumesListTestJSON-1420959277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.349s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:50:58 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-a73d80d1-221b-4de0-a85d-f518d053f00d tempest-VolumesListTestJSON-1420959277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82dc7495-55a3-4ed3-bc63-a7877b7f0991) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e60d91f-75d4-400b-bd53-780c787f2628', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:50:58 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-a73d80d1-221b-4de0-a85d-f518d053f00d tempest-VolumesListTestJSON-1420959277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8806ee13-4b59-4fe2-90fd-bd83a752790e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:50:58 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-a73d80d1-221b-4de0-a85d-f518d053f00d tempest-VolumesListTestJSON-1420959277 None] Volume volume-1e60d91f-75d4-400b-bd53-780c787f2628 (1e60d91f-75d4-400b-bd53-780c787f2628): created successfully Sep 25 11:50:58 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-a73d80d1-221b-4de0-a85d-f518d053f00d tempest-VolumesListTestJSON-1420959277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8806ee13-4b59-4fe2-90fd-bd83a752790e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:50:58 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-a73d80d1-221b-4de0-a85d-f518d053f00d tempest-VolumesListTestJSON-1420959277 None] Flow 'volume_create_manager' (fe5fc4ea-d84d-43cc-96c8-a95ea6b555bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:50:58 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-a73d80d1-221b-4de0-a85d-f518d053f00d tempest-VolumesListTestJSON-1420959277 None] Created volume successfully. Sep 25 11:50:59 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-c9951e4a-7d77-4f8d-a2a6-8aa66a9735ee tempest-VolumesSnapshotListTestJSON-708270845 None] Acquiring lock "cinder-1e9c0b0c-6bfc-4228-abbd-162654ec29f5-delete_snapshot" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:50:59 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-c9951e4a-7d77-4f8d-a2a6-8aa66a9735ee tempest-VolumesSnapshotListTestJSON-708270845 None] Lock "cinder-1e9c0b0c-6bfc-4228-abbd-162654ec29f5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:50:59 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-c9951e4a-7d77-4f8d-a2a6-8aa66a9735ee tempest-VolumesSnapshotListTestJSON-708270845 None] Acquiring lock "cinder-quobyte-b7771661-6035-4725-acf5-946232deb27e" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:50:59 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-c9951e4a-7d77-4f8d-a2a6-8aa66a9735ee tempest-VolumesSnapshotListTestJSON-708270845 None] Lock "cinder-quobyte-b7771661-6035-4725-acf5-946232deb27e" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:50:59 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-c9951e4a-7d77-4f8d-a2a6-8aa66a9735ee tempest-VolumesSnapshotListTestJSON-708270845 None] Acquiring lock "cinder-quobyte-1e9c0b0c-6bfc-4228-abbd-162654ec29f5" by "_delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:50:59 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-c9951e4a-7d77-4f8d-a2a6-8aa66a9735ee tempest-VolumesSnapshotListTestJSON-708270845 None] Lock "cinder-quobyte-1e9c0b0c-6bfc-4228-abbd-162654ec29f5" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:50:59 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-c9951e4a-7d77-4f8d-a2a6-8aa66a9735ee tempest-VolumesSnapshotListTestJSON-708270845 None] Deleting offline snapshot 1e9c0b0c-6bfc-4228-abbd-162654ec29f5 of volume b7771661-6035-4725-acf5-946232deb27e {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:50:59 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-c9951e4a-7d77-4f8d-a2a6-8aa66a9735ee tempest-VolumesSnapshotListTestJSON-708270845 None] snapshot_file for this snap is: volume-b7771661-6035-4725-acf5-946232deb27e.1e9c0b0c-6bfc-4228-abbd-162654ec29f5 {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:50:59 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a30ac6-c698-4c16-8bef-0c3264348fa2]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:50:59 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-c9951e4a-7d77-4f8d-a2a6-8aa66a9735ee tempest-VolumesSnapshotListTestJSON-708270845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e.1e9c0b0c-6bfc-4228-abbd-162654ec29f5 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:00 devstack sudo[98996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e.1e9c0b0c-6bfc-4228-abbd-162654ec29f5 Sep 25 11:51:00 devstack sudo[98996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:00 devstack sudo[98996]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:00 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-c9951e4a-7d77-4f8d-a2a6-8aa66a9735ee tempest-VolumesSnapshotListTestJSON-708270845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e.1e9c0b0c-6bfc-4228-abbd-162654ec29f5" returned: 0 in 0.994s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:00 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-c9951e4a-7d77-4f8d-a2a6-8aa66a9735ee tempest-VolumesSnapshotListTestJSON-708270845 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7771661-6035-4725-acf5-946232deb27e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86984) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:51:00 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5a7fa7-fa0e-4485-8774-53670ff61a08]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:51:00 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-c9951e4a-7d77-4f8d-a2a6-8aa66a9735ee tempest-VolumesSnapshotListTestJSON-708270845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e.10002c96-ae9c-47df-849f-4ddcacbbfd1c {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:01 devstack sudo[99045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e.10002c96-ae9c-47df-849f-4ddcacbbfd1c Sep 25 11:51:01 devstack sudo[99045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:01 devstack sudo[99045]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:01 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-c9951e4a-7d77-4f8d-a2a6-8aa66a9735ee tempest-VolumesSnapshotListTestJSON-708270845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e.10002c96-ae9c-47df-849f-4ddcacbbfd1c" returned: 0 in 0.706s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:01 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-c9951e4a-7d77-4f8d-a2a6-8aa66a9735ee tempest-VolumesSnapshotListTestJSON-708270845 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7771661-6035-4725-acf5-946232deb27e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86984) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:51:01 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-c9951e4a-7d77-4f8d-a2a6-8aa66a9735ee tempest-VolumesSnapshotListTestJSON-708270845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e.1e9c0b0c-6bfc-4228-abbd-162654ec29f5 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:01 devstack sudo[99067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e.1e9c0b0c-6bfc-4228-abbd-162654ec29f5 Sep 25 11:51:01 devstack sudo[99067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:02 devstack sudo[99067]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:02 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-c9951e4a-7d77-4f8d-a2a6-8aa66a9735ee tempest-VolumesSnapshotListTestJSON-708270845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e.1e9c0b0c-6bfc-4228-abbd-162654ec29f5" returned: 0 in 0.756s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:02 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-c9951e4a-7d77-4f8d-a2a6-8aa66a9735ee tempest-VolumesSnapshotListTestJSON-708270845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e.1e9c0b0c-6bfc-4228-abbd-162654ec29f5 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:02 devstack sudo[99084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e.1e9c0b0c-6bfc-4228-abbd-162654ec29f5 Sep 25 11:51:02 devstack sudo[99084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:02 devstack sudo[99084]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:02 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-c9951e4a-7d77-4f8d-a2a6-8aa66a9735ee tempest-VolumesSnapshotListTestJSON-708270845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e.1e9c0b0c-6bfc-4228-abbd-162654ec29f5" returned: 0 in 0.575s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:03 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-c9951e4a-7d77-4f8d-a2a6-8aa66a9735ee tempest-VolumesSnapshotListTestJSON-708270845 None] Lock "cinder-quobyte-1e9c0b0c-6bfc-4228-abbd-162654ec29f5" released by "_delete_snapshot" :: held 3.329s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:51:03 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-c9951e4a-7d77-4f8d-a2a6-8aa66a9735ee tempest-VolumesSnapshotListTestJSON-708270845 None] Lock "cinder-quobyte-b7771661-6035-4725-acf5-946232deb27e" released by "delete_snapshot" :: held 3.380s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:51:03 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-c9951e4a-7d77-4f8d-a2a6-8aa66a9735ee tempest-VolumesSnapshotListTestJSON-708270845 None] Created reservations ['539b8ddf-56f6-4af6-af73-1beeb6dd928f', '7c9229b5-505b-4a0d-8fc0-9cbe08aab256', 'dce49753-9bb4-4a62-a425-254eb4ec5b50', '1e32ced5-61e4-462c-91e3-8dfad49d1d1a'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:51:03 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-c9951e4a-7d77-4f8d-a2a6-8aa66a9735ee tempest-VolumesSnapshotListTestJSON-708270845 None] Delete snapshot completed successfully. Sep 25 11:51:03 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-c9951e4a-7d77-4f8d-a2a6-8aa66a9735ee tempest-VolumesSnapshotListTestJSON-708270845 None] Lock "cinder-1e9c0b0c-6bfc-4228-abbd-162654ec29f5-delete_snapshot" released by "delete_snapshot" :: held 3.822s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:51:04 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-9d61f80c-e129-4b2c-82d1-cc68fc139ecb tempest-VolumesSnapshotListTestJSON-708270845 None] Acquiring lock "cinder-10002c96-ae9c-47df-849f-4ddcacbbfd1c-delete_snapshot" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:51:04 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-9d61f80c-e129-4b2c-82d1-cc68fc139ecb tempest-VolumesSnapshotListTestJSON-708270845 None] Lock "cinder-10002c96-ae9c-47df-849f-4ddcacbbfd1c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:51:04 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-9d61f80c-e129-4b2c-82d1-cc68fc139ecb tempest-VolumesSnapshotListTestJSON-708270845 None] Acquiring lock "cinder-quobyte-b7771661-6035-4725-acf5-946232deb27e" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:51:04 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-9d61f80c-e129-4b2c-82d1-cc68fc139ecb tempest-VolumesSnapshotListTestJSON-708270845 None] Lock "cinder-quobyte-b7771661-6035-4725-acf5-946232deb27e" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:51:04 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-9d61f80c-e129-4b2c-82d1-cc68fc139ecb tempest-VolumesSnapshotListTestJSON-708270845 None] Acquiring lock "cinder-quobyte-10002c96-ae9c-47df-849f-4ddcacbbfd1c" by "_delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:51:04 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-9d61f80c-e129-4b2c-82d1-cc68fc139ecb tempest-VolumesSnapshotListTestJSON-708270845 None] Lock "cinder-quobyte-10002c96-ae9c-47df-849f-4ddcacbbfd1c" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:51:04 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-9d61f80c-e129-4b2c-82d1-cc68fc139ecb tempest-VolumesSnapshotListTestJSON-708270845 None] Deleting offline snapshot 10002c96-ae9c-47df-849f-4ddcacbbfd1c of volume b7771661-6035-4725-acf5-946232deb27e {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:51:04 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-9d61f80c-e129-4b2c-82d1-cc68fc139ecb tempest-VolumesSnapshotListTestJSON-708270845 None] snapshot_file for this snap is: volume-b7771661-6035-4725-acf5-946232deb27e.10002c96-ae9c-47df-849f-4ddcacbbfd1c {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:51:04 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b3094d1-c2dc-4ce1-9a8a-115b4dc7a749]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:51:04 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-9d61f80c-e129-4b2c-82d1-cc68fc139ecb tempest-VolumesSnapshotListTestJSON-708270845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e.10002c96-ae9c-47df-849f-4ddcacbbfd1c {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:04 devstack sudo[99090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e.10002c96-ae9c-47df-849f-4ddcacbbfd1c Sep 25 11:51:04 devstack sudo[99090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:04 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-0963f06d-e15a-4512-b15a-9d178547dcca tempest-VolumesListTestJSON-1420959277 None] Acquiring lock "cinder-1e60d91f-75d4-400b-bd53-780c787f2628-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:51:04 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-0963f06d-e15a-4512-b15a-9d178547dcca tempest-VolumesListTestJSON-1420959277 None] Lock "cinder-1e60d91f-75d4-400b-bd53-780c787f2628-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:51:04 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-0963f06d-e15a-4512-b15a-9d178547dcca tempest-VolumesListTestJSON-1420959277 None] Acquiring lock "cinder-quobyte-1e60d91f-75d4-400b-bd53-780c787f2628" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:51:04 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-0963f06d-e15a-4512-b15a-9d178547dcca tempest-VolumesListTestJSON-1420959277 None] Lock "cinder-quobyte-1e60d91f-75d4-400b-bd53-780c787f2628" acquired by "delete_volume" :: waited 0.032s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:51:04 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[f59ced02-6ff9-4bf7-8a9c-4f9a2c9e44f4]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:51:04 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-0963f06d-e15a-4512-b15a-9d178547dcca tempest-VolumesListTestJSON-1420959277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1e60d91f-75d4-400b-bd53-780c787f2628 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:04 devstack sudo[99090]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:04 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-9d61f80c-e129-4b2c-82d1-cc68fc139ecb tempest-VolumesSnapshotListTestJSON-708270845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e.10002c96-ae9c-47df-849f-4ddcacbbfd1c" returned: 0 in 0.775s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:04 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-9d61f80c-e129-4b2c-82d1-cc68fc139ecb tempest-VolumesSnapshotListTestJSON-708270845 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7771661-6035-4725-acf5-946232deb27e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86984) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:51:05 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c9a5f2-53cc-48eb-be89-8deda578b78f]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:51:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-9d61f80c-e129-4b2c-82d1-cc68fc139ecb tempest-VolumesSnapshotListTestJSON-708270845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e.38d9fca9-7935-4d7a-afb5-7354879a59f0 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:05 devstack sudo[99095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1e60d91f-75d4-400b-bd53-780c787f2628 Sep 25 11:51:05 devstack sudo[99095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:05 devstack sudo[99096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e.38d9fca9-7935-4d7a-afb5-7354879a59f0 Sep 25 11:51:05 devstack sudo[99096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:05 devstack sudo[99095]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-0963f06d-e15a-4512-b15a-9d178547dcca tempest-VolumesListTestJSON-1420959277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1e60d91f-75d4-400b-bd53-780c787f2628" returned: 0 in 0.803s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-0963f06d-e15a-4512-b15a-9d178547dcca tempest-VolumesListTestJSON-1420959277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1e60d91f-75d4-400b-bd53-780c787f2628 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:05 devstack sudo[99103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1e60d91f-75d4-400b-bd53-780c787f2628 Sep 25 11:51:05 devstack sudo[99103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:06 devstack sudo[99096]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-9d61f80c-e129-4b2c-82d1-cc68fc139ecb tempest-VolumesSnapshotListTestJSON-708270845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e.38d9fca9-7935-4d7a-afb5-7354879a59f0" returned: 0 in 0.987s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:06 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-9d61f80c-e129-4b2c-82d1-cc68fc139ecb tempest-VolumesSnapshotListTestJSON-708270845 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7771661-6035-4725-acf5-946232deb27e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86984) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:51:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-9d61f80c-e129-4b2c-82d1-cc68fc139ecb tempest-VolumesSnapshotListTestJSON-708270845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e.10002c96-ae9c-47df-849f-4ddcacbbfd1c {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:06 devstack sudo[99108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e.10002c96-ae9c-47df-849f-4ddcacbbfd1c Sep 25 11:51:06 devstack sudo[99108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:06 devstack sudo[99103]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-0963f06d-e15a-4512-b15a-9d178547dcca tempest-VolumesListTestJSON-1420959277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1e60d91f-75d4-400b-bd53-780c787f2628" returned: 0 in 0.602s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:06 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-0963f06d-e15a-4512-b15a-9d178547dcca tempest-VolumesListTestJSON-1420959277 None] Lock "cinder-quobyte-1e60d91f-75d4-400b-bd53-780c787f2628" released by "delete_volume" :: held 1.515s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:51:06 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-0963f06d-e15a-4512-b15a-9d178547dcca tempest-VolumesListTestJSON-1420959277 None] Created reservations ['cb91063c-d298-4b9d-99fa-9908e08dc9b7', 'f8b915b7-24aa-412f-91df-f7bfbc0bbf26', '8fc97621-d1d1-4d62-a735-75928403de36', 'edabe344-3a5e-4bfa-bfd0-543542a54a3b'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:51:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-0963f06d-e15a-4512-b15a-9d178547dcca tempest-VolumesListTestJSON-1420959277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:51:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-0963f06d-e15a-4512-b15a-9d178547dcca tempest-VolumesListTestJSON-1420959277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:51:06 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-0963f06d-e15a-4512-b15a-9d178547dcca tempest-VolumesListTestJSON-1420959277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:51:06 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-0963f06d-e15a-4512-b15a-9d178547dcca tempest-VolumesListTestJSON-1420959277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:51:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-0963f06d-e15a-4512-b15a-9d178547dcca tempest-VolumesListTestJSON-1420959277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:51:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-0963f06d-e15a-4512-b15a-9d178547dcca tempest-VolumesListTestJSON-1420959277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:06 devstack sudo[99114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:51:06 devstack sudo[99114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:06 devstack sudo[99108]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-9d61f80c-e129-4b2c-82d1-cc68fc139ecb tempest-VolumesSnapshotListTestJSON-708270845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e.10002c96-ae9c-47df-849f-4ddcacbbfd1c" returned: 0 in 0.930s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-9d61f80c-e129-4b2c-82d1-cc68fc139ecb tempest-VolumesSnapshotListTestJSON-708270845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e.10002c96-ae9c-47df-849f-4ddcacbbfd1c {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:07 devstack sudo[99116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e.10002c96-ae9c-47df-849f-4ddcacbbfd1c Sep 25 11:51:07 devstack sudo[99116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:07 devstack sudo[99114]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-0963f06d-e15a-4512-b15a-9d178547dcca tempest-VolumesListTestJSON-1420959277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.522s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:07 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-0963f06d-e15a-4512-b15a-9d178547dcca tempest-VolumesListTestJSON-1420959277 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:51:07 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-0963f06d-e15a-4512-b15a-9d178547dcca tempest-VolumesListTestJSON-1420959277 None] Deleted volume successfully. Sep 25 11:51:07 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-6288e59c-8dc2-4789-b9cc-595b51be58dd tempest-VolumesListTestJSON-1420959277 None] Acquiring lock "cinder-623a0f57-42b1-4519-b0ee-28443cdce267-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:51:07 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-0963f06d-e15a-4512-b15a-9d178547dcca tempest-VolumesListTestJSON-1420959277 None] Lock "cinder-1e60d91f-75d4-400b-bd53-780c787f2628-delete_volume" released by "delete_volume" :: held 2.703s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:51:07 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-6288e59c-8dc2-4789-b9cc-595b51be58dd tempest-VolumesListTestJSON-1420959277 None] Lock "cinder-623a0f57-42b1-4519-b0ee-28443cdce267-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:51:07 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-6288e59c-8dc2-4789-b9cc-595b51be58dd tempest-VolumesListTestJSON-1420959277 None] Acquiring lock "cinder-quobyte-623a0f57-42b1-4519-b0ee-28443cdce267" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:51:07 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-6288e59c-8dc2-4789-b9cc-595b51be58dd tempest-VolumesListTestJSON-1420959277 None] Lock "cinder-quobyte-623a0f57-42b1-4519-b0ee-28443cdce267" acquired by "delete_volume" :: waited 0.025s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:51:07 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[051d1e84-353b-49a0-87ac-f146b0f172af]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:51:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6288e59c-8dc2-4789-b9cc-595b51be58dd tempest-VolumesListTestJSON-1420959277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-623a0f57-42b1-4519-b0ee-28443cdce267 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:07 devstack sudo[99119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-623a0f57-42b1-4519-b0ee-28443cdce267 Sep 25 11:51:07 devstack sudo[99119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:07 devstack sudo[99116]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-9d61f80c-e129-4b2c-82d1-cc68fc139ecb tempest-VolumesSnapshotListTestJSON-708270845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e.10002c96-ae9c-47df-849f-4ddcacbbfd1c" returned: 0 in 0.905s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:07 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-9d61f80c-e129-4b2c-82d1-cc68fc139ecb tempest-VolumesSnapshotListTestJSON-708270845 None] Lock "cinder-quobyte-10002c96-ae9c-47df-849f-4ddcacbbfd1c" released by "_delete_snapshot" :: held 3.828s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:51:07 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-9d61f80c-e129-4b2c-82d1-cc68fc139ecb tempest-VolumesSnapshotListTestJSON-708270845 None] Lock "cinder-quobyte-b7771661-6035-4725-acf5-946232deb27e" released by "delete_snapshot" :: held 3.863s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:51:08 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-9d61f80c-e129-4b2c-82d1-cc68fc139ecb tempest-VolumesSnapshotListTestJSON-708270845 None] Created reservations ['142b990a-94b3-4b20-9e1a-a35aa6a190f0', 'a1d577ad-5ef4-4b58-ac43-d504662b2779', '639fcb43-70b0-4b02-a559-1be52759cdf7', '2661a7f8-5514-4377-99fd-8a0b4182e06b'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:51:08 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-9d61f80c-e129-4b2c-82d1-cc68fc139ecb tempest-VolumesSnapshotListTestJSON-708270845 None] Delete snapshot completed successfully. Sep 25 11:51:08 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-9d61f80c-e129-4b2c-82d1-cc68fc139ecb tempest-VolumesSnapshotListTestJSON-708270845 None] Lock "cinder-10002c96-ae9c-47df-849f-4ddcacbbfd1c-delete_snapshot" released by "delete_snapshot" :: held 4.075s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:51:08 devstack sudo[99119]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6288e59c-8dc2-4789-b9cc-595b51be58dd tempest-VolumesListTestJSON-1420959277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-623a0f57-42b1-4519-b0ee-28443cdce267" returned: 0 in 0.746s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6288e59c-8dc2-4789-b9cc-595b51be58dd tempest-VolumesListTestJSON-1420959277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-623a0f57-42b1-4519-b0ee-28443cdce267 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:08 devstack sudo[99127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-623a0f57-42b1-4519-b0ee-28443cdce267 Sep 25 11:51:08 devstack sudo[99127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:08 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-a01c1456-571e-40a8-9f39-351a6fd9e7c6 tempest-VolumesSnapshotListTestJSON-708270845 None] Acquiring lock "cinder-38d9fca9-7935-4d7a-afb5-7354879a59f0-delete_snapshot" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:51:08 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-a01c1456-571e-40a8-9f39-351a6fd9e7c6 tempest-VolumesSnapshotListTestJSON-708270845 None] Lock "cinder-38d9fca9-7935-4d7a-afb5-7354879a59f0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:51:08 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-a01c1456-571e-40a8-9f39-351a6fd9e7c6 tempest-VolumesSnapshotListTestJSON-708270845 None] Acquiring lock "cinder-quobyte-b7771661-6035-4725-acf5-946232deb27e" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:51:08 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-a01c1456-571e-40a8-9f39-351a6fd9e7c6 tempest-VolumesSnapshotListTestJSON-708270845 None] Lock "cinder-quobyte-b7771661-6035-4725-acf5-946232deb27e" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:51:08 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-a01c1456-571e-40a8-9f39-351a6fd9e7c6 tempest-VolumesSnapshotListTestJSON-708270845 None] Acquiring lock "cinder-quobyte-38d9fca9-7935-4d7a-afb5-7354879a59f0" by "_delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:51:08 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-a01c1456-571e-40a8-9f39-351a6fd9e7c6 tempest-VolumesSnapshotListTestJSON-708270845 None] Lock "cinder-quobyte-38d9fca9-7935-4d7a-afb5-7354879a59f0" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:51:08 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-a01c1456-571e-40a8-9f39-351a6fd9e7c6 tempest-VolumesSnapshotListTestJSON-708270845 None] Deleting offline snapshot 38d9fca9-7935-4d7a-afb5-7354879a59f0 of volume b7771661-6035-4725-acf5-946232deb27e {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:51:08 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-a01c1456-571e-40a8-9f39-351a6fd9e7c6 tempest-VolumesSnapshotListTestJSON-708270845 None] snapshot_file for this snap is: volume-b7771661-6035-4725-acf5-946232deb27e.38d9fca9-7935-4d7a-afb5-7354879a59f0 {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:51:08 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8642717-42c8-4c9a-adf4-ce009c0f22f4]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:51:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a01c1456-571e-40a8-9f39-351a6fd9e7c6 tempest-VolumesSnapshotListTestJSON-708270845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e.38d9fca9-7935-4d7a-afb5-7354879a59f0 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:08 devstack sudo[99127]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6288e59c-8dc2-4789-b9cc-595b51be58dd tempest-VolumesListTestJSON-1420959277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-623a0f57-42b1-4519-b0ee-28443cdce267" returned: 0 in 0.588s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:08 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-6288e59c-8dc2-4789-b9cc-595b51be58dd tempest-VolumesListTestJSON-1420959277 None] Lock "cinder-quobyte-623a0f57-42b1-4519-b0ee-28443cdce267" released by "delete_volume" :: held 1.435s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:51:09 devstack sudo[99129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e.38d9fca9-7935-4d7a-afb5-7354879a59f0 Sep 25 11:51:09 devstack sudo[99129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:09 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-6288e59c-8dc2-4789-b9cc-595b51be58dd tempest-VolumesListTestJSON-1420959277 None] Created reservations ['740964d0-6733-411d-9172-9b8e0a285fa0', '1548917b-d0dd-4ede-a285-de26e7698504', 'f854ea89-ea4b-4a40-ab38-fd96a7507832', 'c454f4e5-e8ac-42a2-8ad8-77bddd2fc48b'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:51:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-6288e59c-8dc2-4789-b9cc-595b51be58dd tempest-VolumesListTestJSON-1420959277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:51:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-6288e59c-8dc2-4789-b9cc-595b51be58dd tempest-VolumesListTestJSON-1420959277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:51:09 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-6288e59c-8dc2-4789-b9cc-595b51be58dd tempest-VolumesListTestJSON-1420959277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:51:09 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-6288e59c-8dc2-4789-b9cc-595b51be58dd tempest-VolumesListTestJSON-1420959277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:51:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-6288e59c-8dc2-4789-b9cc-595b51be58dd tempest-VolumesListTestJSON-1420959277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:51:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6288e59c-8dc2-4789-b9cc-595b51be58dd tempest-VolumesListTestJSON-1420959277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:09 devstack sudo[99129]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a01c1456-571e-40a8-9f39-351a6fd9e7c6 tempest-VolumesSnapshotListTestJSON-708270845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e.38d9fca9-7935-4d7a-afb5-7354879a59f0" returned: 0 in 0.630s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:09 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-a01c1456-571e-40a8-9f39-351a6fd9e7c6 tempest-VolumesSnapshotListTestJSON-708270845 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7771661-6035-4725-acf5-946232deb27e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86984) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:51:09 devstack sudo[99138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:51:09 devstack sudo[99138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:09 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbfc8643-7574-4a9f-aa3d-640c4f571e48]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:51:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a01c1456-571e-40a8-9f39-351a6fd9e7c6 tempest-VolumesSnapshotListTestJSON-708270845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:09 devstack sudo[99138]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6288e59c-8dc2-4789-b9cc-595b51be58dd tempest-VolumesListTestJSON-1420959277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.415s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:09 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-6288e59c-8dc2-4789-b9cc-595b51be58dd tempest-VolumesListTestJSON-1420959277 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:51:09 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-6288e59c-8dc2-4789-b9cc-595b51be58dd tempest-VolumesListTestJSON-1420959277 None] Deleted volume successfully. Sep 25 11:51:09 devstack sudo[99140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e Sep 25 11:51:09 devstack sudo[99140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:09 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-6288e59c-8dc2-4789-b9cc-595b51be58dd tempest-VolumesListTestJSON-1420959277 None] Lock "cinder-623a0f57-42b1-4519-b0ee-28443cdce267-delete_volume" released by "delete_volume" :: held 2.474s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:51:10 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e3b33671-c15c-44a7-bf69-d371b789d7d5 tempest-VolumesListTestJSON-1420959277 None] Acquiring lock "cinder-602ea4eb-a902-494a-91a1-896918239abf-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:51:10 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e3b33671-c15c-44a7-bf69-d371b789d7d5 tempest-VolumesListTestJSON-1420959277 None] Lock "cinder-602ea4eb-a902-494a-91a1-896918239abf-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:51:10 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e3b33671-c15c-44a7-bf69-d371b789d7d5 tempest-VolumesListTestJSON-1420959277 None] Acquiring lock "cinder-quobyte-602ea4eb-a902-494a-91a1-896918239abf" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:51:10 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e3b33671-c15c-44a7-bf69-d371b789d7d5 tempest-VolumesListTestJSON-1420959277 None] Lock "cinder-quobyte-602ea4eb-a902-494a-91a1-896918239abf" acquired by "delete_volume" :: waited 0.027s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:51:10 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6673eb5-6c57-4d1a-a858-8b88cfb60012]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:51:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e3b33671-c15c-44a7-bf69-d371b789d7d5 tempest-VolumesListTestJSON-1420959277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-602ea4eb-a902-494a-91a1-896918239abf {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:10 devstack sudo[99140]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a01c1456-571e-40a8-9f39-351a6fd9e7c6 tempest-VolumesSnapshotListTestJSON-708270845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e" returned: 0 in 1.019s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a01c1456-571e-40a8-9f39-351a6fd9e7c6 tempest-VolumesSnapshotListTestJSON-708270845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e.38d9fca9-7935-4d7a-afb5-7354879a59f0 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:10 devstack sudo[99147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e.38d9fca9-7935-4d7a-afb5-7354879a59f0 Sep 25 11:51:10 devstack sudo[99147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:10 devstack sudo[99146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-602ea4eb-a902-494a-91a1-896918239abf Sep 25 11:51:10 devstack sudo[99146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:11 devstack sudo[99146]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e3b33671-c15c-44a7-bf69-d371b789d7d5 tempest-VolumesListTestJSON-1420959277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-602ea4eb-a902-494a-91a1-896918239abf" returned: 0 in 0.601s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e3b33671-c15c-44a7-bf69-d371b789d7d5 tempest-VolumesListTestJSON-1420959277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-602ea4eb-a902-494a-91a1-896918239abf {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:11 devstack sudo[99157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-602ea4eb-a902-494a-91a1-896918239abf Sep 25 11:51:11 devstack sudo[99157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:11 devstack sudo[99147]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a01c1456-571e-40a8-9f39-351a6fd9e7c6 tempest-VolumesSnapshotListTestJSON-708270845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e.38d9fca9-7935-4d7a-afb5-7354879a59f0" returned: 0 in 0.636s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a01c1456-571e-40a8-9f39-351a6fd9e7c6 tempest-VolumesSnapshotListTestJSON-708270845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e.38d9fca9-7935-4d7a-afb5-7354879a59f0 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:11 devstack sudo[99159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e.38d9fca9-7935-4d7a-afb5-7354879a59f0 Sep 25 11:51:11 devstack sudo[99159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:11 devstack sudo[99157]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e3b33671-c15c-44a7-bf69-d371b789d7d5 tempest-VolumesListTestJSON-1420959277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-602ea4eb-a902-494a-91a1-896918239abf" returned: 0 in 0.750s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:11 devstack sudo[99159]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a01c1456-571e-40a8-9f39-351a6fd9e7c6 tempest-VolumesSnapshotListTestJSON-708270845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e.38d9fca9-7935-4d7a-afb5-7354879a59f0" returned: 0 in 0.628s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:11 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e3b33671-c15c-44a7-bf69-d371b789d7d5 tempest-VolumesListTestJSON-1420959277 None] Lock "cinder-quobyte-602ea4eb-a902-494a-91a1-896918239abf" released by "delete_volume" :: held 1.467s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:51:11 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-a01c1456-571e-40a8-9f39-351a6fd9e7c6 tempest-VolumesSnapshotListTestJSON-708270845 None] Lock "cinder-quobyte-38d9fca9-7935-4d7a-afb5-7354879a59f0" released by "_delete_snapshot" :: held 3.234s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:51:11 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-a01c1456-571e-40a8-9f39-351a6fd9e7c6 tempest-VolumesSnapshotListTestJSON-708270845 None] Lock "cinder-quobyte-b7771661-6035-4725-acf5-946232deb27e" released by "delete_snapshot" :: held 3.302s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:51:12 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-e3b33671-c15c-44a7-bf69-d371b789d7d5 tempest-VolumesListTestJSON-1420959277 None] Created reservations ['2a9e6d8e-b60d-4650-8d04-0e854ac565da', 'ea30451c-5f17-4200-a705-afd45dfa8a2f', '33dc8e14-ece1-40b4-9bb7-e22f3b4833df', '500e64b5-a1ad-49a6-98d6-cb74990c54c7'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:51:12 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-a01c1456-571e-40a8-9f39-351a6fd9e7c6 tempest-VolumesSnapshotListTestJSON-708270845 None] Created reservations ['30450d79-c33f-4c7d-b454-df36789fc744', '87f7b75b-ca5a-4e5e-af27-df908fccd828', 'b56c5021-cd33-4a86-8011-8a2f6c407be6', 'e962a608-2312-4b8e-a9a9-759fbc0a97c1'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:51:12 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-e3b33671-c15c-44a7-bf69-d371b789d7d5 tempest-VolumesListTestJSON-1420959277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:51:12 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-e3b33671-c15c-44a7-bf69-d371b789d7d5 tempest-VolumesListTestJSON-1420959277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:51:12 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-e3b33671-c15c-44a7-bf69-d371b789d7d5 tempest-VolumesListTestJSON-1420959277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:51:12 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-e3b33671-c15c-44a7-bf69-d371b789d7d5 tempest-VolumesListTestJSON-1420959277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:51:12 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-e3b33671-c15c-44a7-bf69-d371b789d7d5 tempest-VolumesListTestJSON-1420959277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:51:12 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e3b33671-c15c-44a7-bf69-d371b789d7d5 tempest-VolumesListTestJSON-1420959277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:12 devstack sudo[99163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:51:12 devstack sudo[99163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:12 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-a01c1456-571e-40a8-9f39-351a6fd9e7c6 tempest-VolumesSnapshotListTestJSON-708270845 None] Delete snapshot completed successfully. Sep 25 11:51:12 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-a01c1456-571e-40a8-9f39-351a6fd9e7c6 tempest-VolumesSnapshotListTestJSON-708270845 None] Lock "cinder-38d9fca9-7935-4d7a-afb5-7354879a59f0-delete_snapshot" released by "delete_snapshot" :: held 3.786s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:51:12 devstack sudo[99163]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:12 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e3b33671-c15c-44a7-bf69-d371b789d7d5 tempest-VolumesListTestJSON-1420959277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.436s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:12 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-e3b33671-c15c-44a7-bf69-d371b789d7d5 tempest-VolumesListTestJSON-1420959277 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:51:12 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-e3b33671-c15c-44a7-bf69-d371b789d7d5 tempest-VolumesListTestJSON-1420959277 None] Deleted volume successfully. Sep 25 11:51:12 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e3b33671-c15c-44a7-bf69-d371b789d7d5 tempest-VolumesListTestJSON-1420959277 None] Lock "cinder-602ea4eb-a902-494a-91a1-896918239abf-delete_volume" released by "delete_volume" :: held 2.539s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:51:13 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-a17f6713-5e39-4da7-97a7-7eebfde73772 tempest-VolumesSnapshotListTestJSON-708270845 None] Acquiring lock "cinder-b7771661-6035-4725-acf5-946232deb27e-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:51:13 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-a17f6713-5e39-4da7-97a7-7eebfde73772 tempest-VolumesSnapshotListTestJSON-708270845 None] Lock "cinder-b7771661-6035-4725-acf5-946232deb27e-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:51:13 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-a17f6713-5e39-4da7-97a7-7eebfde73772 tempest-VolumesSnapshotListTestJSON-708270845 None] Acquiring lock "cinder-quobyte-b7771661-6035-4725-acf5-946232deb27e" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:51:13 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-a17f6713-5e39-4da7-97a7-7eebfde73772 tempest-VolumesSnapshotListTestJSON-708270845 None] Lock "cinder-quobyte-b7771661-6035-4725-acf5-946232deb27e" acquired by "delete_volume" :: waited 0.058s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:51:13 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e73a2c8-67e2-43b7-b25c-3a51da6c8acc]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:51:13 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a17f6713-5e39-4da7-97a7-7eebfde73772 tempest-VolumesSnapshotListTestJSON-708270845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:13 devstack sudo[99167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e Sep 25 11:51:13 devstack sudo[99167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:14 devstack sudo[99167]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:14 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a17f6713-5e39-4da7-97a7-7eebfde73772 tempest-VolumesSnapshotListTestJSON-708270845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e" returned: 0 in 0.819s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:14 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a17f6713-5e39-4da7-97a7-7eebfde73772 tempest-VolumesSnapshotListTestJSON-708270845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:14 devstack sudo[99172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e Sep 25 11:51:14 devstack sudo[99172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:14 devstack sudo[99172]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:14 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a17f6713-5e39-4da7-97a7-7eebfde73772 tempest-VolumesSnapshotListTestJSON-708270845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b7771661-6035-4725-acf5-946232deb27e" returned: 0 in 0.616s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:14 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-a17f6713-5e39-4da7-97a7-7eebfde73772 tempest-VolumesSnapshotListTestJSON-708270845 None] Lock "cinder-quobyte-b7771661-6035-4725-acf5-946232deb27e" released by "delete_volume" :: held 1.585s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:51:15 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-a17f6713-5e39-4da7-97a7-7eebfde73772 tempest-VolumesSnapshotListTestJSON-708270845 None] Created reservations ['173ddb9a-ce1e-4b67-92ac-787a8db5c7cd', 'd102db89-7fa8-4b4a-bb6a-328a53ffb291', '4aaa7cc1-f370-4181-88ac-22d01fb71892', '2ca30cab-9b45-41ed-b7e6-5cf4145b0f42'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:51:15 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-a17f6713-5e39-4da7-97a7-7eebfde73772 tempest-VolumesSnapshotListTestJSON-708270845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:51:15 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-a17f6713-5e39-4da7-97a7-7eebfde73772 tempest-VolumesSnapshotListTestJSON-708270845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:51:15 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-a17f6713-5e39-4da7-97a7-7eebfde73772 tempest-VolumesSnapshotListTestJSON-708270845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:51:15 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-a17f6713-5e39-4da7-97a7-7eebfde73772 tempest-VolumesSnapshotListTestJSON-708270845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:51:15 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-a17f6713-5e39-4da7-97a7-7eebfde73772 tempest-VolumesSnapshotListTestJSON-708270845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:51:15 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a17f6713-5e39-4da7-97a7-7eebfde73772 tempest-VolumesSnapshotListTestJSON-708270845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:15 devstack sudo[99175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:51:15 devstack sudo[99175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:15 devstack sudo[99175]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:15 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a17f6713-5e39-4da7-97a7-7eebfde73772 tempest-VolumesSnapshotListTestJSON-708270845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.757s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:15 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-a17f6713-5e39-4da7-97a7-7eebfde73772 tempest-VolumesSnapshotListTestJSON-708270845 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:51:16 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-a17f6713-5e39-4da7-97a7-7eebfde73772 tempest-VolumesSnapshotListTestJSON-708270845 None] Deleted volume successfully. Sep 25 11:51:16 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-a17f6713-5e39-4da7-97a7-7eebfde73772 tempest-VolumesSnapshotListTestJSON-708270845 None] Lock "cinder-b7771661-6035-4725-acf5-946232deb27e-delete_volume" released by "delete_volume" :: held 2.830s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:51:25 devstack cinder-volume[86984]: DEBUG dbcounter [-] [86984] Writing DB stats cinder:UPDATE=55,cinder:DELETE=6,cinder:SELECT=46,cinder:INSERT=12 {{(pid=86984) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:51:26 devstack cinder-volume[86984]: DEBUG dbcounter [-] [86984] Writing DB stats cinder:SELECT=51,cinder:INSERT=22,cinder:UPDATE=77,cinder:DELETE=5 {{(pid=86984) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:51:38 devstack cinder-volume[86984]: DEBUG oslo_service.periodic_task [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:51:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:51:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:51:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:51:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:51:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:51:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:38 devstack sudo[99239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:51:38 devstack sudo[99239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:39 devstack sudo[99239]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.412s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:39 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:51:39 devstack cinder-volume[86984]: DEBUG oslo_service.periodic_task [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running periodic task VolumeManager._thread_info {{(pid=86984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:51:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] thread count: 28 {{(pid=86984) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 11:51:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] thread info: [<_MainThread(MainThread, started 132046492332160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86984) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 11:51:42 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-94d909db-b6bc-4af3-ab4f-12c2dbc6e641 tempest-VolumesSnapshotTestJSON-1438674217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:51:42 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-94d909db-b6bc-4af3-ab4f-12c2dbc6e641 tempest-VolumesSnapshotTestJSON-1438674217 None] Flow 'volume_create_manager' (f8424787-66e9-42f5-8a7e-b471d77cb509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:51:42 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-94d909db-b6bc-4af3-ab4f-12c2dbc6e641 tempest-VolumesSnapshotTestJSON-1438674217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6968fa00-aee5-460f-98a1-2720c7b1f9ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:51:42 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-94d909db-b6bc-4af3-ab4f-12c2dbc6e641 tempest-VolumesSnapshotTestJSON-1438674217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6968fa00-aee5-460f-98a1-2720c7b1f9ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:51:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-395160009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2735b2c5-5134-45a1-9304-38b95c375c0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2437d2ea68f4f68be08425e0599a9b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:51:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:51:42Z,use_quota=True,user_id='0fe6a04643a34fc6a664bfb998b802f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:51:42 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-94d909db-b6bc-4af3-ab4f-12c2dbc6e641 tempest-VolumesSnapshotTestJSON-1438674217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32cb3c6c-acb7-43d1-8911-25a0ea9896d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:51:42 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-94d909db-b6bc-4af3-ab4f-12c2dbc6e641 tempest-VolumesSnapshotTestJSON-1438674217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32cb3c6c-acb7-43d1-8911-25a0ea9896d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:51:42 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-94d909db-b6bc-4af3-ab4f-12c2dbc6e641 tempest-VolumesSnapshotTestJSON-1438674217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e07b72b-8168-4cc4-9942-cc8f704f62f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:51:42 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-94d909db-b6bc-4af3-ab4f-12c2dbc6e641 tempest-VolumesSnapshotTestJSON-1438674217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e07b72b-8168-4cc4-9942-cc8f704f62f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2735b2c5-5134-45a1-9304-38b95c375c0c', 'volume_name': 'volume-2735b2c5-5134-45a1-9304-38b95c375c0c', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:51:42 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-94d909db-b6bc-4af3-ab4f-12c2dbc6e641 tempest-VolumesSnapshotTestJSON-1438674217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c2c9725-1879-4aa8-814f-1137d6c868ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:51:42 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-94d909db-b6bc-4af3-ab4f-12c2dbc6e641 tempest-VolumesSnapshotTestJSON-1438674217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c2c9725-1879-4aa8-814f-1137d6c868ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:51:42 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-94d909db-b6bc-4af3-ab4f-12c2dbc6e641 tempest-VolumesSnapshotTestJSON-1438674217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (806eeedf-b49c-49a7-bb20-b28da4e4ffdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:51:42 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-94d909db-b6bc-4af3-ab4f-12c2dbc6e641 tempest-VolumesSnapshotTestJSON-1438674217 None] Volume 2735b2c5-5134-45a1-9304-38b95c375c0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2735b2c5-5134-45a1-9304-38b95c375c0c', 'volume_size': 1} Sep 25 11:51:42 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-94d909db-b6bc-4af3-ab4f-12c2dbc6e641 tempest-VolumesSnapshotTestJSON-1438674217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:51:42 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-94d909db-b6bc-4af3-ab4f-12c2dbc6e641 tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:51:42 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-94d909db-b6bc-4af3-ab4f-12c2dbc6e641 tempest-VolumesSnapshotTestJSON-1438674217 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:51:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-395160009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2735b2c5-5134-45a1-9304-38b95c375c0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2437d2ea68f4f68be08425e0599a9b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:51:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:51:42Z,use_quota=True,user_id='0fe6a04643a34fc6a664bfb998b802f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:51:42 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-94d909db-b6bc-4af3-ab4f-12c2dbc6e641 tempest-VolumesSnapshotTestJSON-1438674217 None] Creating volume 2735b2c5-5134-45a1-9304-38b95c375c0c {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:51:42 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-94d909db-b6bc-4af3-ab4f-12c2dbc6e641 tempest-VolumesSnapshotTestJSON-1438674217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:51:42 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-94d909db-b6bc-4af3-ab4f-12c2dbc6e641 tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:51:42 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-94d909db-b6bc-4af3-ab4f-12c2dbc6e641 tempest-VolumesSnapshotTestJSON-1438674217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:51:42 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-94d909db-b6bc-4af3-ab4f-12c2dbc6e641 tempest-VolumesSnapshotTestJSON-1438674217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:51:42 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-94d909db-b6bc-4af3-ab4f-12c2dbc6e641 tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:51:42 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-94d909db-b6bc-4af3-ab4f-12c2dbc6e641 tempest-VolumesSnapshotTestJSON-1438674217 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:51:42 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-94d909db-b6bc-4af3-ab4f-12c2dbc6e641 tempest-VolumesSnapshotTestJSON-1438674217 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:51:42 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-94d909db-b6bc-4af3-ab4f-12c2dbc6e641 tempest-VolumesSnapshotTestJSON-1438674217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2735b2c5-5134-45a1-9304-38b95c375c0c 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:42 devstack sudo[99286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2735b2c5-5134-45a1-9304-38b95c375c0c 1073741824 Sep 25 11:51:42 devstack sudo[99286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:42 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c8ee364-2531-4520-a7b2-b306a31cff6a tempest-TestServerVolumeAttachScenarioOldVersion-1341439926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:51:43 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-5c8ee364-2531-4520-a7b2-b306a31cff6a tempest-TestServerVolumeAttachScenarioOldVersion-1341439926 None] Flow 'volume_create_manager' (cd7d4dd8-37ed-4e8f-a492-30465575b0ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:51:43 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-5c8ee364-2531-4520-a7b2-b306a31cff6a tempest-TestServerVolumeAttachScenarioOldVersion-1341439926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4a55cad-a6e7-4de2-8260-f99ef9d15f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:51:43 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-5c8ee364-2531-4520-a7b2-b306a31cff6a tempest-TestServerVolumeAttachScenarioOldVersion-1341439926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4a55cad-a6e7-4de2-8260-f99ef9d15f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:51:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-611382644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1639a562-1c05-4c27-8583-b0385b326355,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcc70c44628b4e4f818ba3be299fb2b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:51:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:51:43Z,use_quota=True,user_id='d8d9bf8cb9eb479c9a8a20438bcf1757',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:51:43 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-5c8ee364-2531-4520-a7b2-b306a31cff6a tempest-TestServerVolumeAttachScenarioOldVersion-1341439926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85bde6e0-76db-4536-849c-7666130ae08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:51:43 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-5c8ee364-2531-4520-a7b2-b306a31cff6a tempest-TestServerVolumeAttachScenarioOldVersion-1341439926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85bde6e0-76db-4536-849c-7666130ae08b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:51:43 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-5c8ee364-2531-4520-a7b2-b306a31cff6a tempest-TestServerVolumeAttachScenarioOldVersion-1341439926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35c19f58-df83-451c-998d-9c14cd2bd0f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:51:43 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-5c8ee364-2531-4520-a7b2-b306a31cff6a tempest-TestServerVolumeAttachScenarioOldVersion-1341439926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35c19f58-df83-451c-998d-9c14cd2bd0f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1639a562-1c05-4c27-8583-b0385b326355', 'volume_name': 'volume-1639a562-1c05-4c27-8583-b0385b326355', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:51:43 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-5c8ee364-2531-4520-a7b2-b306a31cff6a tempest-TestServerVolumeAttachScenarioOldVersion-1341439926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29f92a7a-576b-418c-9f6e-6e823c526aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:51:43 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-5c8ee364-2531-4520-a7b2-b306a31cff6a tempest-TestServerVolumeAttachScenarioOldVersion-1341439926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29f92a7a-576b-418c-9f6e-6e823c526aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:51:43 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-5c8ee364-2531-4520-a7b2-b306a31cff6a tempest-TestServerVolumeAttachScenarioOldVersion-1341439926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8c3c63c-f0dd-46c8-8558-9cb2da13c1bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:51:43 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-5c8ee364-2531-4520-a7b2-b306a31cff6a tempest-TestServerVolumeAttachScenarioOldVersion-1341439926 None] Volume 1639a562-1c05-4c27-8583-b0385b326355: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1639a562-1c05-4c27-8583-b0385b326355', 'volume_size': 1} Sep 25 11:51:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-5c8ee364-2531-4520-a7b2-b306a31cff6a tempest-TestServerVolumeAttachScenarioOldVersion-1341439926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:51:44 devstack sudo[99286]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-94d909db-b6bc-4af3-ab4f-12c2dbc6e641 tempest-VolumesSnapshotTestJSON-1438674217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2735b2c5-5134-45a1-9304-38b95c375c0c 1073741824" returned: 0 in 1.165s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-94d909db-b6bc-4af3-ab4f-12c2dbc6e641 tempest-VolumesSnapshotTestJSON-1438674217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2735b2c5-5134-45a1-9304-38b95c375c0c {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:44 devstack sudo[99323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2735b2c5-5134-45a1-9304-38b95c375c0c Sep 25 11:51:44 devstack sudo[99323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:44 devstack sudo[99323]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-94d909db-b6bc-4af3-ab4f-12c2dbc6e641 tempest-VolumesSnapshotTestJSON-1438674217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2735b2c5-5134-45a1-9304-38b95c375c0c" returned: 0 in 0.435s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:44 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-94d909db-b6bc-4af3-ab4f-12c2dbc6e641 tempest-VolumesSnapshotTestJSON-1438674217 None] <== create_volume: return (1759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:51:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-94d909db-b6bc-4af3-ab4f-12c2dbc6e641 tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.772s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:51:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-5c8ee364-2531-4520-a7b2-b306a31cff6a tempest-TestServerVolumeAttachScenarioOldVersion-1341439926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.473s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:51:44 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-5c8ee364-2531-4520-a7b2-b306a31cff6a tempest-TestServerVolumeAttachScenarioOldVersion-1341439926 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:51:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-611382644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1639a562-1c05-4c27-8583-b0385b326355,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcc70c44628b4e4f818ba3be299fb2b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:51:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:51:43Z,use_quota=True,user_id='d8d9bf8cb9eb479c9a8a20438bcf1757',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:51:44 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-5c8ee364-2531-4520-a7b2-b306a31cff6a tempest-TestServerVolumeAttachScenarioOldVersion-1341439926 None] Creating volume 1639a562-1c05-4c27-8583-b0385b326355 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:51:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-5c8ee364-2531-4520-a7b2-b306a31cff6a tempest-TestServerVolumeAttachScenarioOldVersion-1341439926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:51:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-5c8ee364-2531-4520-a7b2-b306a31cff6a tempest-TestServerVolumeAttachScenarioOldVersion-1341439926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:51:44 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-5c8ee364-2531-4520-a7b2-b306a31cff6a tempest-TestServerVolumeAttachScenarioOldVersion-1341439926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:51:44 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-5c8ee364-2531-4520-a7b2-b306a31cff6a tempest-TestServerVolumeAttachScenarioOldVersion-1341439926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:51:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-5c8ee364-2531-4520-a7b2-b306a31cff6a tempest-TestServerVolumeAttachScenarioOldVersion-1341439926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:51:44 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-5c8ee364-2531-4520-a7b2-b306a31cff6a tempest-TestServerVolumeAttachScenarioOldVersion-1341439926 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:51:44 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-5c8ee364-2531-4520-a7b2-b306a31cff6a tempest-TestServerVolumeAttachScenarioOldVersion-1341439926 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:51:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-5c8ee364-2531-4520-a7b2-b306a31cff6a tempest-TestServerVolumeAttachScenarioOldVersion-1341439926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1639a562-1c05-4c27-8583-b0385b326355 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:44 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-94d909db-b6bc-4af3-ab4f-12c2dbc6e641 tempest-VolumesSnapshotTestJSON-1438674217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (806eeedf-b49c-49a7-bb20-b28da4e4ffdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2735b2c5-5134-45a1-9304-38b95c375c0c', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:51:44 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-94d909db-b6bc-4af3-ab4f-12c2dbc6e641 tempest-VolumesSnapshotTestJSON-1438674217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8c68359-4c32-46aa-a72f-a272f2f77378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:51:44 devstack sudo[99342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1639a562-1c05-4c27-8583-b0385b326355 1073741824 Sep 25 11:51:44 devstack sudo[99342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:44 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-94d909db-b6bc-4af3-ab4f-12c2dbc6e641 tempest-VolumesSnapshotTestJSON-1438674217 None] Volume volume-2735b2c5-5134-45a1-9304-38b95c375c0c (2735b2c5-5134-45a1-9304-38b95c375c0c): created successfully Sep 25 11:51:44 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-94d909db-b6bc-4af3-ab4f-12c2dbc6e641 tempest-VolumesSnapshotTestJSON-1438674217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8c68359-4c32-46aa-a72f-a272f2f77378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:51:44 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-94d909db-b6bc-4af3-ab4f-12c2dbc6e641 tempest-VolumesSnapshotTestJSON-1438674217 None] Flow 'volume_create_manager' (f8424787-66e9-42f5-8a7e-b471d77cb509) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:51:44 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-94d909db-b6bc-4af3-ab4f-12c2dbc6e641 tempest-VolumesSnapshotTestJSON-1438674217 None] Created volume successfully. Sep 25 11:51:45 devstack sudo[99342]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-5c8ee364-2531-4520-a7b2-b306a31cff6a tempest-TestServerVolumeAttachScenarioOldVersion-1341439926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1639a562-1c05-4c27-8583-b0385b326355 1073741824" returned: 0 in 0.951s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-5c8ee364-2531-4520-a7b2-b306a31cff6a tempest-TestServerVolumeAttachScenarioOldVersion-1341439926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1639a562-1c05-4c27-8583-b0385b326355 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:45 devstack sudo[99348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1639a562-1c05-4c27-8583-b0385b326355 Sep 25 11:51:45 devstack sudo[99348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:46 devstack sudo[99348]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-5c8ee364-2531-4520-a7b2-b306a31cff6a tempest-TestServerVolumeAttachScenarioOldVersion-1341439926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1639a562-1c05-4c27-8583-b0385b326355" returned: 0 in 0.744s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:46 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-5c8ee364-2531-4520-a7b2-b306a31cff6a tempest-TestServerVolumeAttachScenarioOldVersion-1341439926 None] <== create_volume: return (1800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:51:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-5c8ee364-2531-4520-a7b2-b306a31cff6a tempest-TestServerVolumeAttachScenarioOldVersion-1341439926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.806s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:51:46 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-5c8ee364-2531-4520-a7b2-b306a31cff6a tempest-TestServerVolumeAttachScenarioOldVersion-1341439926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8c3c63c-f0dd-46c8-8558-9cb2da13c1bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1639a562-1c05-4c27-8583-b0385b326355', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:51:46 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-5c8ee364-2531-4520-a7b2-b306a31cff6a tempest-TestServerVolumeAttachScenarioOldVersion-1341439926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db0670c8-b0b1-44b3-a43c-80cddc127756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:51:46 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-5c8ee364-2531-4520-a7b2-b306a31cff6a tempest-TestServerVolumeAttachScenarioOldVersion-1341439926 None] Volume volume-1639a562-1c05-4c27-8583-b0385b326355 (1639a562-1c05-4c27-8583-b0385b326355): created successfully Sep 25 11:51:46 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-5c8ee364-2531-4520-a7b2-b306a31cff6a tempest-TestServerVolumeAttachScenarioOldVersion-1341439926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db0670c8-b0b1-44b3-a43c-80cddc127756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:51:46 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-5c8ee364-2531-4520-a7b2-b306a31cff6a tempest-TestServerVolumeAttachScenarioOldVersion-1341439926 None] Flow 'volume_create_manager' (cd7d4dd8-37ed-4e8f-a492-30465575b0ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:51:46 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-5c8ee364-2531-4520-a7b2-b306a31cff6a tempest-TestServerVolumeAttachScenarioOldVersion-1341439926 None] Created volume successfully. Sep 25 11:51:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-274354a7-9053-43be-8efc-f2981db74fa1 tempest-VolumesSnapshotTestJSON-1438674217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:51:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-274354a7-9053-43be-8efc-f2981db74fa1 tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:51:46 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-274354a7-9053-43be-8efc-f2981db74fa1 tempest-VolumesSnapshotTestJSON-1438674217 None] Creating offline snapshot d0d01c7a-bece-4171-8e71-65075a138746 of volume 2735b2c5-5134-45a1-9304-38b95c375c0c {{(pid=86984) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:51:47 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac4f028-eee8-4393-b5a5-1ea102d1a717]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:51:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-274354a7-9053-43be-8efc-f2981db74fa1 tempest-VolumesSnapshotTestJSON-1438674217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2735b2c5-5134-45a1-9304-38b95c375c0c {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:47 devstack sudo[99353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2735b2c5-5134-45a1-9304-38b95c375c0c Sep 25 11:51:47 devstack sudo[99353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:47 devstack sudo[99353]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-274354a7-9053-43be-8efc-f2981db74fa1 tempest-VolumesSnapshotTestJSON-1438674217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2735b2c5-5134-45a1-9304-38b95c375c0c" returned: 0 in 0.837s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-274354a7-9053-43be-8efc-f2981db74fa1 tempest-VolumesSnapshotTestJSON-1438674217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2735b2c5-5134-45a1-9304-38b95c375c0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2735b2c5-5134-45a1-9304-38b95c375c0c.d0d01c7a-bece-4171-8e71-65075a138746 1G {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:47 devstack sudo[99358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2735b2c5-5134-45a1-9304-38b95c375c0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2735b2c5-5134-45a1-9304-38b95c375c0c.d0d01c7a-bece-4171-8e71-65075a138746 1G Sep 25 11:51:47 devstack sudo[99358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:49 devstack sudo[99358]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-274354a7-9053-43be-8efc-f2981db74fa1 tempest-VolumesSnapshotTestJSON-1438674217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2735b2c5-5134-45a1-9304-38b95c375c0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2735b2c5-5134-45a1-9304-38b95c375c0c.d0d01c7a-bece-4171-8e71-65075a138746 1G" returned: 0 in 1.319s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-274354a7-9053-43be-8efc-f2981db74fa1 tempest-VolumesSnapshotTestJSON-1438674217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2735b2c5-5134-45a1-9304-38b95c375c0c -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2735b2c5-5134-45a1-9304-38b95c375c0c.d0d01c7a-bece-4171-8e71-65075a138746 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:49 devstack sudo[99367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2735b2c5-5134-45a1-9304-38b95c375c0c -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2735b2c5-5134-45a1-9304-38b95c375c0c.d0d01c7a-bece-4171-8e71-65075a138746 Sep 25 11:51:49 devstack sudo[99367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:49 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee881e5e-5561-4345-beee-4b11de66c4d6 tempest-VolumesActionsTest-821311522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:51:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ee881e5e-5561-4345-beee-4b11de66c4d6 tempest-VolumesActionsTest-821311522 None] Flow 'volume_create_manager' (4718408b-78a3-419f-906c-47af8ff80f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:51:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ee881e5e-5561-4345-beee-4b11de66c4d6 tempest-VolumesActionsTest-821311522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90eab067-e419-44b8-8f9e-a5197521d425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:51:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ee881e5e-5561-4345-beee-4b11de66c4d6 tempest-VolumesActionsTest-821311522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90eab067-e419-44b8-8f9e-a5197521d425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:51:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-325148072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fcb403f-997b-4eeb-9f0b-79e244f37630,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af85dda72acd4db88b68cc01b7569e60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:51:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:51:50Z,use_quota=True,user_id='c370d3ebe2d24b02a5f064d1b7908383',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:51:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ee881e5e-5561-4345-beee-4b11de66c4d6 tempest-VolumesActionsTest-821311522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e4f7032-b39b-42ff-9ad3-a895f0f4f1dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:51:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ee881e5e-5561-4345-beee-4b11de66c4d6 tempest-VolumesActionsTest-821311522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e4f7032-b39b-42ff-9ad3-a895f0f4f1dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:51:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ee881e5e-5561-4345-beee-4b11de66c4d6 tempest-VolumesActionsTest-821311522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d667567-5775-4a37-ba90-6222dc33cd3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:51:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ee881e5e-5561-4345-beee-4b11de66c4d6 tempest-VolumesActionsTest-821311522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d667567-5775-4a37-ba90-6222dc33cd3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fcb403f-997b-4eeb-9f0b-79e244f37630', 'volume_name': 'volume-1fcb403f-997b-4eeb-9f0b-79e244f37630', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:51:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ee881e5e-5561-4345-beee-4b11de66c4d6 tempest-VolumesActionsTest-821311522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9de9f5fd-d29e-4a18-b46f-b39934f8b8a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:51:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ee881e5e-5561-4345-beee-4b11de66c4d6 tempest-VolumesActionsTest-821311522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9de9f5fd-d29e-4a18-b46f-b39934f8b8a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:51:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ee881e5e-5561-4345-beee-4b11de66c4d6 tempest-VolumesActionsTest-821311522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20e5eea5-9083-47fd-976d-c6bf36829fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:51:49 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-ee881e5e-5561-4345-beee-4b11de66c4d6 tempest-VolumesActionsTest-821311522 None] Volume 1fcb403f-997b-4eeb-9f0b-79e244f37630: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fcb403f-997b-4eeb-9f0b-79e244f37630', 'volume_size': 1} Sep 25 11:51:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-ee881e5e-5561-4345-beee-4b11de66c4d6 tempest-VolumesActionsTest-821311522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:51:50 devstack sudo[99367]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-274354a7-9053-43be-8efc-f2981db74fa1 tempest-VolumesSnapshotTestJSON-1438674217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2735b2c5-5134-45a1-9304-38b95c375c0c -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2735b2c5-5134-45a1-9304-38b95c375c0c.d0d01c7a-bece-4171-8e71-65075a138746" returned: 0 in 0.902s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:50 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-274354a7-9053-43be-8efc-f2981db74fa1 tempest-VolumesSnapshotTestJSON-1438674217 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2735b2c5-5134-45a1-9304-38b95c375c0c.d0d01c7a-bece-4171-8e71-65075a138746 is being set with open permissions: ugo+rw Sep 25 11:51:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-274354a7-9053-43be-8efc-f2981db74fa1 tempest-VolumesSnapshotTestJSON-1438674217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2735b2c5-5134-45a1-9304-38b95c375c0c.d0d01c7a-bece-4171-8e71-65075a138746 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:50 devstack sudo[99414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2735b2c5-5134-45a1-9304-38b95c375c0c.d0d01c7a-bece-4171-8e71-65075a138746 Sep 25 11:51:50 devstack sudo[99414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-3c50e72d-a74e-4feb-beb1-c72c706c9424 req-f8e8add8-696d-462a-8432-841bd57f9068 tempest-TestServerVolumeAttachScenarioOldVersion-1341439926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:51:50 devstack sudo[99414]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-274354a7-9053-43be-8efc-f2981db74fa1 tempest-VolumesSnapshotTestJSON-1438674217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2735b2c5-5134-45a1-9304-38b95c375c0c.d0d01c7a-bece-4171-8e71-65075a138746" returned: 0 in 0.436s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-274354a7-9053-43be-8efc-f2981db74fa1 tempest-VolumesSnapshotTestJSON-1438674217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2735b2c5-5134-45a1-9304-38b95c375c0c.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:50 devstack sudo[99419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2735b2c5-5134-45a1-9304-38b95c375c0c.info Sep 25 11:51:50 devstack sudo[99419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:51 devstack sudo[99419]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-274354a7-9053-43be-8efc-f2981db74fa1 tempest-VolumesSnapshotTestJSON-1438674217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2735b2c5-5134-45a1-9304-38b95c375c0c.info" returned: 0 in 0.434s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:51 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-274354a7-9053-43be-8efc-f2981db74fa1 tempest-VolumesSnapshotTestJSON-1438674217 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2735b2c5-5134-45a1-9304-38b95c375c0c.info is being set with open permissions: ugo+rw Sep 25 11:51:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-274354a7-9053-43be-8efc-f2981db74fa1 tempest-VolumesSnapshotTestJSON-1438674217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2735b2c5-5134-45a1-9304-38b95c375c0c.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:51 devstack sudo[99422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2735b2c5-5134-45a1-9304-38b95c375c0c.info Sep 25 11:51:51 devstack sudo[99422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:51 devstack sudo[99422]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-274354a7-9053-43be-8efc-f2981db74fa1 tempest-VolumesSnapshotTestJSON-1438674217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2735b2c5-5134-45a1-9304-38b95c375c0c.info" returned: 0 in 0.328s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-274354a7-9053-43be-8efc-f2981db74fa1 tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.423s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:51:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-ee881e5e-5561-4345-beee-4b11de66c4d6 tempest-VolumesActionsTest-821311522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.497s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:51:51 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-ee881e5e-5561-4345-beee-4b11de66c4d6 tempest-VolumesActionsTest-821311522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:51:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-325148072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fcb403f-997b-4eeb-9f0b-79e244f37630,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af85dda72acd4db88b68cc01b7569e60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:51:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:51:50Z,use_quota=True,user_id='c370d3ebe2d24b02a5f064d1b7908383',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:51:51 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-ee881e5e-5561-4345-beee-4b11de66c4d6 tempest-VolumesActionsTest-821311522 None] Creating volume 1fcb403f-997b-4eeb-9f0b-79e244f37630 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:51:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-ee881e5e-5561-4345-beee-4b11de66c4d6 tempest-VolumesActionsTest-821311522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:51:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-ee881e5e-5561-4345-beee-4b11de66c4d6 tempest-VolumesActionsTest-821311522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:51:51 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-ee881e5e-5561-4345-beee-4b11de66c4d6 tempest-VolumesActionsTest-821311522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:51:51 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-ee881e5e-5561-4345-beee-4b11de66c4d6 tempest-VolumesActionsTest-821311522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:51:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-ee881e5e-5561-4345-beee-4b11de66c4d6 tempest-VolumesActionsTest-821311522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:51:51 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-ee881e5e-5561-4345-beee-4b11de66c4d6 tempest-VolumesActionsTest-821311522 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:51:51 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-ee881e5e-5561-4345-beee-4b11de66c4d6 tempest-VolumesActionsTest-821311522 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:51:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ee881e5e-5561-4345-beee-4b11de66c4d6 tempest-VolumesActionsTest-821311522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1fcb403f-997b-4eeb-9f0b-79e244f37630 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:51 devstack sudo[99425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1fcb403f-997b-4eeb-9f0b-79e244f37630 1073741824 Sep 25 11:51:51 devstack sudo[99425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:51 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-274354a7-9053-43be-8efc-f2981db74fa1 tempest-VolumesSnapshotTestJSON-1438674217 None] Create snapshot completed successfully Sep 25 11:51:52 devstack sudo[99425]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ee881e5e-5561-4345-beee-4b11de66c4d6 tempest-VolumesActionsTest-821311522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1fcb403f-997b-4eeb-9f0b-79e244f37630 1073741824" returned: 0 in 0.709s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ee881e5e-5561-4345-beee-4b11de66c4d6 tempest-VolumesActionsTest-821311522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1fcb403f-997b-4eeb-9f0b-79e244f37630 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:52 devstack sudo[99431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1fcb403f-997b-4eeb-9f0b-79e244f37630 Sep 25 11:51:52 devstack sudo[99431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:52 devstack sudo[99431]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ee881e5e-5561-4345-beee-4b11de66c4d6 tempest-VolumesActionsTest-821311522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1fcb403f-997b-4eeb-9f0b-79e244f37630" returned: 0 in 0.396s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:52 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-ee881e5e-5561-4345-beee-4b11de66c4d6 tempest-VolumesActionsTest-821311522 None] <== create_volume: return (1177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:51:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-ee881e5e-5561-4345-beee-4b11de66c4d6 tempest-VolumesActionsTest-821311522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:51:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-3c50e72d-a74e-4feb-beb1-c72c706c9424 req-f8e8add8-696d-462a-8432-841bd57f9068 tempest-TestServerVolumeAttachScenarioOldVersion-1341439926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.337s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:51:52 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ee881e5e-5561-4345-beee-4b11de66c4d6 tempest-VolumesActionsTest-821311522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20e5eea5-9083-47fd-976d-c6bf36829fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fcb403f-997b-4eeb-9f0b-79e244f37630', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:51:52 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ee881e5e-5561-4345-beee-4b11de66c4d6 tempest-VolumesActionsTest-821311522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dea53be-1b85-47b0-b41c-bd0b33358d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:51:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-3c50e72d-a74e-4feb-beb1-c72c706c9424 req-f8e8add8-696d-462a-8432-841bd57f9068 tempest-TestServerVolumeAttachScenarioOldVersion-1341439926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.060s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:51:52 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-ee881e5e-5561-4345-beee-4b11de66c4d6 tempest-VolumesActionsTest-821311522 None] Volume volume-1fcb403f-997b-4eeb-9f0b-79e244f37630 (1fcb403f-997b-4eeb-9f0b-79e244f37630): created successfully Sep 25 11:51:52 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ee881e5e-5561-4345-beee-4b11de66c4d6 tempest-VolumesActionsTest-821311522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dea53be-1b85-47b0-b41c-bd0b33358d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:51:52 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ee881e5e-5561-4345-beee-4b11de66c4d6 tempest-VolumesActionsTest-821311522 None] Flow 'volume_create_manager' (4718408b-78a3-419f-906c-47af8ff80f8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:51:52 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-ee881e5e-5561-4345-beee-4b11de66c4d6 tempest-VolumesActionsTest-821311522 None] Created volume successfully. Sep 25 11:51:52 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [req-3c50e72d-a74e-4feb-beb1-c72c706c9424 req-f8e8add8-696d-462a-8432-841bd57f9068 tempest-TestServerVolumeAttachScenarioOldVersion-1341439926 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba', 'name': 'volume-1639a562-1c05-4c27-8583-b0385b326355', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5b61b449-a4ec-4816-972f-eb244b9b4332', 'enforce_multipath': True} {{(pid=86984) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 11:51:52 devstack cinder-volume[86984]: INFO cinder.volume.manager [req-3c50e72d-a74e-4feb-beb1-c72c706c9424 req-f8e8add8-696d-462a-8432-841bd57f9068 tempest-TestServerVolumeAttachScenarioOldVersion-1341439926 None] attachment_update completed successfully. Sep 25 11:51:52 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-aed3d1ba-a4ed-4e75-b407-eb42a526f846 tempest-VolumesSnapshotTestJSON-1438674217 None] Acquiring lock "cinder-d0d01c7a-bece-4171-8e71-65075a138746-delete_snapshot" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:51:52 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-aed3d1ba-a4ed-4e75-b407-eb42a526f846 tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "cinder-d0d01c7a-bece-4171-8e71-65075a138746-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:51:53 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-aed3d1ba-a4ed-4e75-b407-eb42a526f846 tempest-VolumesSnapshotTestJSON-1438674217 None] Acquiring lock "cinder-quobyte-2735b2c5-5134-45a1-9304-38b95c375c0c" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:51:53 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-aed3d1ba-a4ed-4e75-b407-eb42a526f846 tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "cinder-quobyte-2735b2c5-5134-45a1-9304-38b95c375c0c" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:51:53 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-aed3d1ba-a4ed-4e75-b407-eb42a526f846 tempest-VolumesSnapshotTestJSON-1438674217 None] Acquiring lock "cinder-quobyte-d0d01c7a-bece-4171-8e71-65075a138746" by "_delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:51:53 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-aed3d1ba-a4ed-4e75-b407-eb42a526f846 tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "cinder-quobyte-d0d01c7a-bece-4171-8e71-65075a138746" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:51:53 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-aed3d1ba-a4ed-4e75-b407-eb42a526f846 tempest-VolumesSnapshotTestJSON-1438674217 None] Deleting offline snapshot d0d01c7a-bece-4171-8e71-65075a138746 of volume 2735b2c5-5134-45a1-9304-38b95c375c0c {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:51:53 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-aed3d1ba-a4ed-4e75-b407-eb42a526f846 tempest-VolumesSnapshotTestJSON-1438674217 None] snapshot_file for this snap is: volume-2735b2c5-5134-45a1-9304-38b95c375c0c.d0d01c7a-bece-4171-8e71-65075a138746 {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:51:53 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec62bbf-8110-43c9-98de-57867aa9cecc]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:51:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-aed3d1ba-a4ed-4e75-b407-eb42a526f846 tempest-VolumesSnapshotTestJSON-1438674217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2735b2c5-5134-45a1-9304-38b95c375c0c.d0d01c7a-bece-4171-8e71-65075a138746 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:53 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-d82e0016-f4bd-4358-a213-634843bbeb69 tempest-VolumesActionsTest-821311522 None] Acquiring lock "cinder-1fcb403f-997b-4eeb-9f0b-79e244f37630" by "attach_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:51:53 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-d82e0016-f4bd-4358-a213-634843bbeb69 tempest-VolumesActionsTest-821311522 None] Lock "cinder-1fcb403f-997b-4eeb-9f0b-79e244f37630" acquired by "attach_volume" :: waited 0.041s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:51:53 devstack sudo[99458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2735b2c5-5134-45a1-9304-38b95c375c0c.d0d01c7a-bece-4171-8e71-65075a138746 Sep 25 11:51:53 devstack sudo[99458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:53 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-d82e0016-f4bd-4358-a213-634843bbeb69 tempest-VolumesActionsTest-821311522 None] Attaching volume 1fcb403f-997b-4eeb-9f0b-79e244f37630 to instance dc6a72b3-aed5-4d93-9ffb-b8854aa6c309 at mountpoint /dev/vdb on host None. Sep 25 11:51:53 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-d82e0016-f4bd-4358-a213-634843bbeb69 tempest-VolumesActionsTest-821311522 None] Attach volume completed successfully. Sep 25 11:51:53 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-d82e0016-f4bd-4358-a213-634843bbeb69 tempest-VolumesActionsTest-821311522 None] Lock "cinder-1fcb403f-997b-4eeb-9f0b-79e244f37630" released by "attach_volume" :: held 0.233s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:51:53 devstack sudo[99458]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-aed3d1ba-a4ed-4e75-b407-eb42a526f846 tempest-VolumesSnapshotTestJSON-1438674217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2735b2c5-5134-45a1-9304-38b95c375c0c.d0d01c7a-bece-4171-8e71-65075a138746" returned: 0 in 0.751s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:53 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-aed3d1ba-a4ed-4e75-b407-eb42a526f846 tempest-VolumesSnapshotTestJSON-1438674217 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2735b2c5-5134-45a1-9304-38b95c375c0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86984) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:51:54 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dedddb5-fc5d-40be-bea3-92a108df7f3d]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:51:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-aed3d1ba-a4ed-4e75-b407-eb42a526f846 tempest-VolumesSnapshotTestJSON-1438674217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2735b2c5-5134-45a1-9304-38b95c375c0c {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:54 devstack sudo[99855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2735b2c5-5134-45a1-9304-38b95c375c0c Sep 25 11:51:54 devstack sudo[99855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:55 devstack sudo[99855]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:55 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-0863b4e1-56a7-4b7a-ba6c-d58ea773bc99 tempest-VolumesActionsTest-1180183357 None] Terminate volume connection completed successfully. Sep 25 11:51:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-aed3d1ba-a4ed-4e75-b407-eb42a526f846 tempest-VolumesSnapshotTestJSON-1438674217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2735b2c5-5134-45a1-9304-38b95c375c0c" returned: 0 in 1.251s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-aed3d1ba-a4ed-4e75-b407-eb42a526f846 tempest-VolumesSnapshotTestJSON-1438674217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2735b2c5-5134-45a1-9304-38b95c375c0c.d0d01c7a-bece-4171-8e71-65075a138746 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:55 devstack sudo[99860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2735b2c5-5134-45a1-9304-38b95c375c0c.d0d01c7a-bece-4171-8e71-65075a138746 Sep 25 11:51:55 devstack sudo[99860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:55 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-0863b4e1-56a7-4b7a-ba6c-d58ea773bc99 tempest-VolumesActionsTest-1180183357 None] Acquiring lock "cinder-1fcb403f-997b-4eeb-9f0b-79e244f37630-detach_volume" by "detach_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:51:55 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-0863b4e1-56a7-4b7a-ba6c-d58ea773bc99 tempest-VolumesActionsTest-1180183357 None] Lock "cinder-1fcb403f-997b-4eeb-9f0b-79e244f37630-detach_volume" acquired by "detach_volume" :: waited 0.058s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:51:55 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-0863b4e1-56a7-4b7a-ba6c-d58ea773bc99 tempest-VolumesActionsTest-1180183357 None] Detaching volume 1fcb403f-997b-4eeb-9f0b-79e244f37630 from instance dc6a72b3-aed5-4d93-9ffb-b8854aa6c309. Sep 25 11:51:55 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-0863b4e1-56a7-4b7a-ba6c-d58ea773bc99 tempest-VolumesActionsTest-1180183357 None] Detach volume completed successfully. Sep 25 11:51:55 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-0863b4e1-56a7-4b7a-ba6c-d58ea773bc99 tempest-VolumesActionsTest-1180183357 None] Lock "cinder-1fcb403f-997b-4eeb-9f0b-79e244f37630-detach_volume" released by "detach_volume" :: held 0.236s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:51:56 devstack sudo[99860]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:56 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-aed3d1ba-a4ed-4e75-b407-eb42a526f846 tempest-VolumesSnapshotTestJSON-1438674217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2735b2c5-5134-45a1-9304-38b95c375c0c.d0d01c7a-bece-4171-8e71-65075a138746" returned: 0 in 0.915s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:56 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-aed3d1ba-a4ed-4e75-b407-eb42a526f846 tempest-VolumesSnapshotTestJSON-1438674217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2735b2c5-5134-45a1-9304-38b95c375c0c.d0d01c7a-bece-4171-8e71-65075a138746 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:56 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-01ce512f-032e-4e05-abe1-35a68000de9d tempest-VolumesActionsTest-821311522 None] Acquiring lock "cinder-1fcb403f-997b-4eeb-9f0b-79e244f37630-detach_volume" by "detach_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:51:56 devstack sudo[99865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2735b2c5-5134-45a1-9304-38b95c375c0c.d0d01c7a-bece-4171-8e71-65075a138746 Sep 25 11:51:56 devstack sudo[99865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:56 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-01ce512f-032e-4e05-abe1-35a68000de9d tempest-VolumesActionsTest-821311522 None] Lock "cinder-1fcb403f-997b-4eeb-9f0b-79e244f37630-detach_volume" acquired by "detach_volume" :: waited 0.055s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:51:56 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-01ce512f-032e-4e05-abe1-35a68000de9d tempest-VolumesActionsTest-821311522 None] Volume detach called, but volume not attached. Sep 25 11:51:56 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-01ce512f-032e-4e05-abe1-35a68000de9d tempest-VolumesActionsTest-821311522 None] Lock "cinder-1fcb403f-997b-4eeb-9f0b-79e244f37630-detach_volume" released by "detach_volume" :: held 0.040s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:51:56 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-5132cb5e-95d0-4523-98cb-940a1eb36235 tempest-VolumesActionsTest-821311522 None] Acquiring lock "cinder-1fcb403f-997b-4eeb-9f0b-79e244f37630-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:51:56 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-5132cb5e-95d0-4523-98cb-940a1eb36235 tempest-VolumesActionsTest-821311522 None] Lock "cinder-1fcb403f-997b-4eeb-9f0b-79e244f37630-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:51:57 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-5132cb5e-95d0-4523-98cb-940a1eb36235 tempest-VolumesActionsTest-821311522 None] Acquiring lock "cinder-quobyte-1fcb403f-997b-4eeb-9f0b-79e244f37630" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:51:57 devstack sudo[99865]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:57 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-5132cb5e-95d0-4523-98cb-940a1eb36235 tempest-VolumesActionsTest-821311522 None] Lock "cinder-quobyte-1fcb403f-997b-4eeb-9f0b-79e244f37630" acquired by "delete_volume" :: waited 0.040s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:51:57 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-aed3d1ba-a4ed-4e75-b407-eb42a526f846 tempest-VolumesSnapshotTestJSON-1438674217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2735b2c5-5134-45a1-9304-38b95c375c0c.d0d01c7a-bece-4171-8e71-65075a138746" returned: 0 in 0.928s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:57 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea8d2c8-ce36-443e-a5c1-b9855b70b63e]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:51:57 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-5132cb5e-95d0-4523-98cb-940a1eb36235 tempest-VolumesActionsTest-821311522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1fcb403f-997b-4eeb-9f0b-79e244f37630 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:57 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-aed3d1ba-a4ed-4e75-b407-eb42a526f846 tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "cinder-quobyte-d0d01c7a-bece-4171-8e71-65075a138746" released by "_delete_snapshot" :: held 4.133s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:51:57 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-aed3d1ba-a4ed-4e75-b407-eb42a526f846 tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "cinder-quobyte-2735b2c5-5134-45a1-9304-38b95c375c0c" released by "delete_snapshot" :: held 4.179s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:51:57 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-aed3d1ba-a4ed-4e75-b407-eb42a526f846 tempest-VolumesSnapshotTestJSON-1438674217 None] Created reservations ['e20e225b-8239-4864-940b-7fe8a0452c1f', '129276a4-9d6a-4c67-abb7-418d00880b50', '1f77098c-d14e-4d26-985f-7ec97537531e', '294c3a16-8634-4f50-b055-3236906e539d'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:51:57 devstack sudo[99868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1fcb403f-997b-4eeb-9f0b-79e244f37630 Sep 25 11:51:57 devstack sudo[99868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:57 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-aed3d1ba-a4ed-4e75-b407-eb42a526f846 tempest-VolumesSnapshotTestJSON-1438674217 None] Delete snapshot completed successfully. Sep 25 11:51:57 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-aed3d1ba-a4ed-4e75-b407-eb42a526f846 tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "cinder-d0d01c7a-bece-4171-8e71-65075a138746-delete_snapshot" released by "delete_snapshot" :: held 4.517s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:51:57 devstack sudo[99868]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:57 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-5132cb5e-95d0-4523-98cb-940a1eb36235 tempest-VolumesActionsTest-821311522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1fcb403f-997b-4eeb-9f0b-79e244f37630" returned: 0 in 0.721s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:57 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-5132cb5e-95d0-4523-98cb-940a1eb36235 tempest-VolumesActionsTest-821311522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1fcb403f-997b-4eeb-9f0b-79e244f37630 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:57 devstack sudo[99873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1fcb403f-997b-4eeb-9f0b-79e244f37630 Sep 25 11:51:57 devstack sudo[99873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:58 devstack sudo[99873]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:58 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-5132cb5e-95d0-4523-98cb-940a1eb36235 tempest-VolumesActionsTest-821311522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1fcb403f-997b-4eeb-9f0b-79e244f37630" returned: 0 in 0.385s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:58 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-5132cb5e-95d0-4523-98cb-940a1eb36235 tempest-VolumesActionsTest-821311522 None] Lock "cinder-quobyte-1fcb403f-997b-4eeb-9f0b-79e244f37630" released by "delete_volume" :: held 1.267s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:51:58 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-5132cb5e-95d0-4523-98cb-940a1eb36235 tempest-VolumesActionsTest-821311522 None] Created reservations ['431a727a-6ae7-4860-839d-62cbd3e1f0b7', 'e7a363a0-5f31-4bc1-9c7b-b2394a1e47e3', 'de3ed731-c853-4684-a9fd-8e6a285998d5', '81c6c8ef-7071-47ca-8a6c-ec94dfc73ad1'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:51:58 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-5132cb5e-95d0-4523-98cb-940a1eb36235 tempest-VolumesActionsTest-821311522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:51:58 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-5132cb5e-95d0-4523-98cb-940a1eb36235 tempest-VolumesActionsTest-821311522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:51:58 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-5132cb5e-95d0-4523-98cb-940a1eb36235 tempest-VolumesActionsTest-821311522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:51:58 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-5132cb5e-95d0-4523-98cb-940a1eb36235 tempest-VolumesActionsTest-821311522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:51:58 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-5132cb5e-95d0-4523-98cb-940a1eb36235 tempest-VolumesActionsTest-821311522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:51:58 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-5132cb5e-95d0-4523-98cb-940a1eb36235 tempest-VolumesActionsTest-821311522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:58 devstack sudo[99881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:51:58 devstack sudo[99881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:59 devstack cinder-volume[86984]: INFO cinder.volume.manager [req-d19c0f72-47e7-47b4-85ae-34a2c2a22c2b req-0748a2e9-bcb2-4248-8e26-5acb9334c396 tempest-TestServerVolumeAttachScenarioOldVersion-1341439926 None] Terminate volume connection completed successfully. Sep 25 11:51:59 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [req-d19c0f72-47e7-47b4-85ae-34a2c2a22c2b req-0748a2e9-bcb2-4248-8e26-5acb9334c396 tempest-TestServerVolumeAttachScenarioOldVersion-1341439926 None] Deleting attachment 5b61b449-a4ec-4816-972f-eb244b9b4332. {{(pid=86984) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 11:51:59 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ffa896f-0b74-4eec-9ba6-f90e0b9603b1 tempest-VolumesSnapshotTestJSON-1438674217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:51:59 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4ffa896f-0b74-4eec-9ba6-f90e0b9603b1 tempest-VolumesSnapshotTestJSON-1438674217 None] Flow 'volume_create_manager' (960e22de-9225-4f82-849f-1254e7c4d17d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:51:59 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4ffa896f-0b74-4eec-9ba6-f90e0b9603b1 tempest-VolumesSnapshotTestJSON-1438674217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbee46e3-eb75-4a88-b0b9-60461fbef71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:51:59 devstack sudo[99881]: pam_unix(sudo:session): session closed for user root Sep 25 11:51:59 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4ffa896f-0b74-4eec-9ba6-f90e0b9603b1 tempest-VolumesSnapshotTestJSON-1438674217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbee46e3-eb75-4a88-b0b9-60461fbef71f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1613731973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e159705-5798-4c31-bea7-d45ce209014c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2437d2ea68f4f68be08425e0599a9b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:51:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:51:59Z,use_quota=True,user_id='0fe6a04643a34fc6a664bfb998b802f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:51:59 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4ffa896f-0b74-4eec-9ba6-f90e0b9603b1 tempest-VolumesSnapshotTestJSON-1438674217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82a340df-6b05-442c-9250-d486205221ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:51:59 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4ffa896f-0b74-4eec-9ba6-f90e0b9603b1 tempest-VolumesSnapshotTestJSON-1438674217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82a340df-6b05-442c-9250-d486205221ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:51:59 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4ffa896f-0b74-4eec-9ba6-f90e0b9603b1 tempest-VolumesSnapshotTestJSON-1438674217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92a11a59-d2bf-4629-ad4b-ad9281824afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:51:59 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4ffa896f-0b74-4eec-9ba6-f90e0b9603b1 tempest-VolumesSnapshotTestJSON-1438674217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92a11a59-d2bf-4629-ad4b-ad9281824afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e159705-5798-4c31-bea7-d45ce209014c', 'volume_name': 'volume-0e159705-5798-4c31-bea7-d45ce209014c', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:51:59 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4ffa896f-0b74-4eec-9ba6-f90e0b9603b1 tempest-VolumesSnapshotTestJSON-1438674217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7f85b33-9e0e-4749-874c-ad3cd7b5f9d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:51:59 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4ffa896f-0b74-4eec-9ba6-f90e0b9603b1 tempest-VolumesSnapshotTestJSON-1438674217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7f85b33-9e0e-4749-874c-ad3cd7b5f9d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:51:59 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4ffa896f-0b74-4eec-9ba6-f90e0b9603b1 tempest-VolumesSnapshotTestJSON-1438674217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f5b2460-8aaa-447c-be1a-51e360f0d8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:51:59 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-4ffa896f-0b74-4eec-9ba6-f90e0b9603b1 tempest-VolumesSnapshotTestJSON-1438674217 None] Volume 0e159705-5798-4c31-bea7-d45ce209014c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e159705-5798-4c31-bea7-d45ce209014c', 'volume_size': 1} Sep 25 11:51:59 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-4ffa896f-0b74-4eec-9ba6-f90e0b9603b1 tempest-VolumesSnapshotTestJSON-1438674217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:51:59 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-4ffa896f-0b74-4eec-9ba6-f90e0b9603b1 tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:51:59 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-4ffa896f-0b74-4eec-9ba6-f90e0b9603b1 tempest-VolumesSnapshotTestJSON-1438674217 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1613731973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e159705-5798-4c31-bea7-d45ce209014c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2437d2ea68f4f68be08425e0599a9b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:51:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:51:59Z,use_quota=True,user_id='0fe6a04643a34fc6a664bfb998b802f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:51:59 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-4ffa896f-0b74-4eec-9ba6-f90e0b9603b1 tempest-VolumesSnapshotTestJSON-1438674217 None] Creating volume 0e159705-5798-4c31-bea7-d45ce209014c {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:51:59 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-4ffa896f-0b74-4eec-9ba6-f90e0b9603b1 tempest-VolumesSnapshotTestJSON-1438674217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:51:59 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-4ffa896f-0b74-4eec-9ba6-f90e0b9603b1 tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:51:59 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-4ffa896f-0b74-4eec-9ba6-f90e0b9603b1 tempest-VolumesSnapshotTestJSON-1438674217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:51:59 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-4ffa896f-0b74-4eec-9ba6-f90e0b9603b1 tempest-VolumesSnapshotTestJSON-1438674217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:51:59 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-4ffa896f-0b74-4eec-9ba6-f90e0b9603b1 tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:51:59 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-4ffa896f-0b74-4eec-9ba6-f90e0b9603b1 tempest-VolumesSnapshotTestJSON-1438674217 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:51:59 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-4ffa896f-0b74-4eec-9ba6-f90e0b9603b1 tempest-VolumesSnapshotTestJSON-1438674217 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:51:59 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-4ffa896f-0b74-4eec-9ba6-f90e0b9603b1 tempest-VolumesSnapshotTestJSON-1438674217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0e159705-5798-4c31-bea7-d45ce209014c 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:51:59 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-5132cb5e-95d0-4523-98cb-940a1eb36235 tempest-VolumesActionsTest-821311522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.824s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:51:59 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-5132cb5e-95d0-4523-98cb-940a1eb36235 tempest-VolumesActionsTest-821311522 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:51:59 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-5132cb5e-95d0-4523-98cb-940a1eb36235 tempest-VolumesActionsTest-821311522 None] Deleted volume successfully. Sep 25 11:51:59 devstack sudo[99910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0e159705-5798-4c31-bea7-d45ce209014c 1073741824 Sep 25 11:51:59 devstack sudo[99910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:51:59 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-5132cb5e-95d0-4523-98cb-940a1eb36235 tempest-VolumesActionsTest-821311522 None] Lock "cinder-1fcb403f-997b-4eeb-9f0b-79e244f37630-delete_volume" released by "delete_volume" :: held 2.648s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:52:00 devstack sudo[99910]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:00 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-4ffa896f-0b74-4eec-9ba6-f90e0b9603b1 tempest-VolumesSnapshotTestJSON-1438674217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0e159705-5798-4c31-bea7-d45ce209014c 1073741824" returned: 0 in 0.807s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:00 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-4ffa896f-0b74-4eec-9ba6-f90e0b9603b1 tempest-VolumesSnapshotTestJSON-1438674217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0e159705-5798-4c31-bea7-d45ce209014c {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:00 devstack sudo[99923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0e159705-5798-4c31-bea7-d45ce209014c Sep 25 11:52:00 devstack sudo[99923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:00 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e63b7f3a-5848-44f4-8d5b-104a1f2fba45 tempest-TestServerVolumeAttachScenarioOldVersion-1341439926 None] Acquiring lock "cinder-1639a562-1c05-4c27-8583-b0385b326355-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:52:00 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e63b7f3a-5848-44f4-8d5b-104a1f2fba45 tempest-TestServerVolumeAttachScenarioOldVersion-1341439926 None] Lock "cinder-1639a562-1c05-4c27-8583-b0385b326355-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:52:00 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e63b7f3a-5848-44f4-8d5b-104a1f2fba45 tempest-TestServerVolumeAttachScenarioOldVersion-1341439926 None] Acquiring lock "cinder-quobyte-1639a562-1c05-4c27-8583-b0385b326355" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:52:00 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e63b7f3a-5848-44f4-8d5b-104a1f2fba45 tempest-TestServerVolumeAttachScenarioOldVersion-1341439926 None] Lock "cinder-quobyte-1639a562-1c05-4c27-8583-b0385b326355" acquired by "delete_volume" :: waited 0.018s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:52:01 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a601a9-284b-48af-9746-7c60978ca1ed]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:52:01 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e63b7f3a-5848-44f4-8d5b-104a1f2fba45 tempest-TestServerVolumeAttachScenarioOldVersion-1341439926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1639a562-1c05-4c27-8583-b0385b326355 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:01 devstack sudo[99923]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:01 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-4ffa896f-0b74-4eec-9ba6-f90e0b9603b1 tempest-VolumesSnapshotTestJSON-1438674217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0e159705-5798-4c31-bea7-d45ce209014c" returned: 0 in 0.635s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:01 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-4ffa896f-0b74-4eec-9ba6-f90e0b9603b1 tempest-VolumesSnapshotTestJSON-1438674217 None] <== create_volume: return (1523ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:52:01 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-4ffa896f-0b74-4eec-9ba6-f90e0b9603b1 tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.527s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:52:01 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4ffa896f-0b74-4eec-9ba6-f90e0b9603b1 tempest-VolumesSnapshotTestJSON-1438674217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f5b2460-8aaa-447c-be1a-51e360f0d8db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e159705-5798-4c31-bea7-d45ce209014c', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:01 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4ffa896f-0b74-4eec-9ba6-f90e0b9603b1 tempest-VolumesSnapshotTestJSON-1438674217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ac60c00-4bc9-4377-bf63-d2b22db219fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:01 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-4ffa896f-0b74-4eec-9ba6-f90e0b9603b1 tempest-VolumesSnapshotTestJSON-1438674217 None] Volume volume-0e159705-5798-4c31-bea7-d45ce209014c (0e159705-5798-4c31-bea7-d45ce209014c): created successfully Sep 25 11:52:01 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4ffa896f-0b74-4eec-9ba6-f90e0b9603b1 tempest-VolumesSnapshotTestJSON-1438674217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ac60c00-4bc9-4377-bf63-d2b22db219fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:01 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4ffa896f-0b74-4eec-9ba6-f90e0b9603b1 tempest-VolumesSnapshotTestJSON-1438674217 None] Flow 'volume_create_manager' (960e22de-9225-4f82-849f-1254e7c4d17d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:52:01 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-4ffa896f-0b74-4eec-9ba6-f90e0b9603b1 tempest-VolumesSnapshotTestJSON-1438674217 None] Created volume successfully. Sep 25 11:52:01 devstack sudo[99941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1639a562-1c05-4c27-8583-b0385b326355 Sep 25 11:52:01 devstack sudo[99941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:01 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-8cac04de-14e6-4793-ae94-3d07bc3a61ad tempest-VolumesSnapshotTestJSON-1438674217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:52:01 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-8cac04de-14e6-4793-ae94-3d07bc3a61ad tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:52:01 devstack sudo[99941]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:01 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e63b7f3a-5848-44f4-8d5b-104a1f2fba45 tempest-TestServerVolumeAttachScenarioOldVersion-1341439926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1639a562-1c05-4c27-8583-b0385b326355" returned: 0 in 0.752s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:01 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e63b7f3a-5848-44f4-8d5b-104a1f2fba45 tempest-TestServerVolumeAttachScenarioOldVersion-1341439926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1639a562-1c05-4c27-8583-b0385b326355 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:01 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-8cac04de-14e6-4793-ae94-3d07bc3a61ad tempest-VolumesSnapshotTestJSON-1438674217 None] Creating offline snapshot 27b8ff0c-c4ea-4bb5-aef8-3c0f2b3cc6cc of volume 0e159705-5798-4c31-bea7-d45ce209014c {{(pid=86984) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:52:01 devstack sudo[99948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1639a562-1c05-4c27-8583-b0385b326355 Sep 25 11:52:01 devstack sudo[99948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:01 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[40eedbf7-30ab-45a5-8b83-db84e3fdfa87]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:52:01 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8cac04de-14e6-4793-ae94-3d07bc3a61ad tempest-VolumesSnapshotTestJSON-1438674217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0e159705-5798-4c31-bea7-d45ce209014c {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:01 devstack sudo[99950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0e159705-5798-4c31-bea7-d45ce209014c Sep 25 11:52:01 devstack sudo[99950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:02 devstack sudo[99948]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:02 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e63b7f3a-5848-44f4-8d5b-104a1f2fba45 tempest-TestServerVolumeAttachScenarioOldVersion-1341439926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1639a562-1c05-4c27-8583-b0385b326355" returned: 0 in 0.431s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:02 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e63b7f3a-5848-44f4-8d5b-104a1f2fba45 tempest-TestServerVolumeAttachScenarioOldVersion-1341439926 None] Lock "cinder-quobyte-1639a562-1c05-4c27-8583-b0385b326355" released by "delete_volume" :: held 1.255s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:52:02 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-e63b7f3a-5848-44f4-8d5b-104a1f2fba45 tempest-TestServerVolumeAttachScenarioOldVersion-1341439926 None] Created reservations ['c18d9d43-567a-4a4f-bc7f-0eaf674ada79', 'c5faf354-3106-4e2e-9962-a72805baa779', 'e43bf4cf-8f62-4a47-8a99-61612b0080e5', 'dd8be81b-173c-4e11-b365-2818dd3bdfe1'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:52:02 devstack sudo[99950]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:02 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8cac04de-14e6-4793-ae94-3d07bc3a61ad tempest-VolumesSnapshotTestJSON-1438674217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0e159705-5798-4c31-bea7-d45ce209014c" returned: 0 in 0.538s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:02 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8cac04de-14e6-4793-ae94-3d07bc3a61ad tempest-VolumesSnapshotTestJSON-1438674217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0e159705-5798-4c31-bea7-d45ce209014c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0e159705-5798-4c31-bea7-d45ce209014c.27b8ff0c-c4ea-4bb5-aef8-3c0f2b3cc6cc 1G {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:02 devstack sudo[99956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0e159705-5798-4c31-bea7-d45ce209014c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0e159705-5798-4c31-bea7-d45ce209014c.27b8ff0c-c4ea-4bb5-aef8-3c0f2b3cc6cc 1G Sep 25 11:52:02 devstack sudo[99956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:02 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-e63b7f3a-5848-44f4-8d5b-104a1f2fba45 tempest-TestServerVolumeAttachScenarioOldVersion-1341439926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:52:02 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-e63b7f3a-5848-44f4-8d5b-104a1f2fba45 tempest-TestServerVolumeAttachScenarioOldVersion-1341439926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:52:02 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-e63b7f3a-5848-44f4-8d5b-104a1f2fba45 tempest-TestServerVolumeAttachScenarioOldVersion-1341439926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:52:02 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-e63b7f3a-5848-44f4-8d5b-104a1f2fba45 tempest-TestServerVolumeAttachScenarioOldVersion-1341439926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:52:02 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-e63b7f3a-5848-44f4-8d5b-104a1f2fba45 tempest-TestServerVolumeAttachScenarioOldVersion-1341439926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:52:02 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e63b7f3a-5848-44f4-8d5b-104a1f2fba45 tempest-TestServerVolumeAttachScenarioOldVersion-1341439926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:02 devstack sudo[99958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:52:02 devstack sudo[99958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:02 devstack sudo[99958]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:02 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e63b7f3a-5848-44f4-8d5b-104a1f2fba45 tempest-TestServerVolumeAttachScenarioOldVersion-1341439926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.396s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:02 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-e63b7f3a-5848-44f4-8d5b-104a1f2fba45 tempest-TestServerVolumeAttachScenarioOldVersion-1341439926 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:52:02 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-e63b7f3a-5848-44f4-8d5b-104a1f2fba45 tempest-TestServerVolumeAttachScenarioOldVersion-1341439926 None] Deleted volume successfully. Sep 25 11:52:02 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e63b7f3a-5848-44f4-8d5b-104a1f2fba45 tempest-TestServerVolumeAttachScenarioOldVersion-1341439926 None] Lock "cinder-1639a562-1c05-4c27-8583-b0385b326355-delete_volume" released by "delete_volume" :: held 2.037s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:52:03 devstack sudo[99956]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8cac04de-14e6-4793-ae94-3d07bc3a61ad tempest-VolumesSnapshotTestJSON-1438674217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0e159705-5798-4c31-bea7-d45ce209014c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0e159705-5798-4c31-bea7-d45ce209014c.27b8ff0c-c4ea-4bb5-aef8-3c0f2b3cc6cc 1G" returned: 0 in 0.671s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8cac04de-14e6-4793-ae94-3d07bc3a61ad tempest-VolumesSnapshotTestJSON-1438674217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e159705-5798-4c31-bea7-d45ce209014c -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0e159705-5798-4c31-bea7-d45ce209014c.27b8ff0c-c4ea-4bb5-aef8-3c0f2b3cc6cc {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:03 devstack sudo[99965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e159705-5798-4c31-bea7-d45ce209014c -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0e159705-5798-4c31-bea7-d45ce209014c.27b8ff0c-c4ea-4bb5-aef8-3c0f2b3cc6cc Sep 25 11:52:03 devstack sudo[99965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:03 devstack sudo[99965]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8cac04de-14e6-4793-ae94-3d07bc3a61ad tempest-VolumesSnapshotTestJSON-1438674217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e159705-5798-4c31-bea7-d45ce209014c -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0e159705-5798-4c31-bea7-d45ce209014c.27b8ff0c-c4ea-4bb5-aef8-3c0f2b3cc6cc" returned: 0 in 0.588s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:03 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-8cac04de-14e6-4793-ae94-3d07bc3a61ad tempest-VolumesSnapshotTestJSON-1438674217 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0e159705-5798-4c31-bea7-d45ce209014c.27b8ff0c-c4ea-4bb5-aef8-3c0f2b3cc6cc is being set with open permissions: ugo+rw Sep 25 11:52:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8cac04de-14e6-4793-ae94-3d07bc3a61ad tempest-VolumesSnapshotTestJSON-1438674217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0e159705-5798-4c31-bea7-d45ce209014c.27b8ff0c-c4ea-4bb5-aef8-3c0f2b3cc6cc {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:03 devstack sudo[99971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0e159705-5798-4c31-bea7-d45ce209014c.27b8ff0c-c4ea-4bb5-aef8-3c0f2b3cc6cc Sep 25 11:52:03 devstack sudo[99971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:03 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7c081af-cdf7-4125-b86e-d8f95af1e497 tempest-VolumesActionsTest-821311522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:52:03 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d7c081af-cdf7-4125-b86e-d8f95af1e497 tempest-VolumesActionsTest-821311522 None] Flow 'volume_create_manager' (9f3037f7-1fdd-4f1d-bf1d-9bbe58e36447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:52:03 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d7c081af-cdf7-4125-b86e-d8f95af1e497 tempest-VolumesActionsTest-821311522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32a45e0f-8988-4cf0-b858-06027d4f0aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:03 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d7c081af-cdf7-4125-b86e-d8f95af1e497 tempest-VolumesActionsTest-821311522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32a45e0f-8988-4cf0-b858-06027d4f0aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:52:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1784382932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=049d16f3-9de0-49d9-8ac8-fb817c1f5318,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af85dda72acd4db88b68cc01b7569e60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:52:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:52:04Z,use_quota=True,user_id='c370d3ebe2d24b02a5f064d1b7908383',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:03 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d7c081af-cdf7-4125-b86e-d8f95af1e497 tempest-VolumesActionsTest-821311522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ec9a5db-f9ef-4e03-b217-da6090124879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:04 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d7c081af-cdf7-4125-b86e-d8f95af1e497 tempest-VolumesActionsTest-821311522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ec9a5db-f9ef-4e03-b217-da6090124879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:04 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d7c081af-cdf7-4125-b86e-d8f95af1e497 tempest-VolumesActionsTest-821311522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2824e15c-90b1-4ae3-860b-49eb994f2322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:04 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d7c081af-cdf7-4125-b86e-d8f95af1e497 tempest-VolumesActionsTest-821311522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2824e15c-90b1-4ae3-860b-49eb994f2322) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '049d16f3-9de0-49d9-8ac8-fb817c1f5318', 'volume_name': 'volume-049d16f3-9de0-49d9-8ac8-fb817c1f5318', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:04 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d7c081af-cdf7-4125-b86e-d8f95af1e497 tempest-VolumesActionsTest-821311522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ed30b93-754c-4342-bfa2-e8db4480ad04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:04 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d7c081af-cdf7-4125-b86e-d8f95af1e497 tempest-VolumesActionsTest-821311522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ed30b93-754c-4342-bfa2-e8db4480ad04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:04 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d7c081af-cdf7-4125-b86e-d8f95af1e497 tempest-VolumesActionsTest-821311522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55a425cb-89ef-4fcc-92f7-e0768e7c8d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:04 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-d7c081af-cdf7-4125-b86e-d8f95af1e497 tempest-VolumesActionsTest-821311522 None] Volume 049d16f3-9de0-49d9-8ac8-fb817c1f5318: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-049d16f3-9de0-49d9-8ac8-fb817c1f5318', 'volume_size': 1} Sep 25 11:52:04 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d7c081af-cdf7-4125-b86e-d8f95af1e497 tempest-VolumesActionsTest-821311522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:52:04 devstack sudo[99971]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:04 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8cac04de-14e6-4793-ae94-3d07bc3a61ad tempest-VolumesSnapshotTestJSON-1438674217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0e159705-5798-4c31-bea7-d45ce209014c.27b8ff0c-c4ea-4bb5-aef8-3c0f2b3cc6cc" returned: 0 in 0.593s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:04 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8cac04de-14e6-4793-ae94-3d07bc3a61ad tempest-VolumesSnapshotTestJSON-1438674217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0e159705-5798-4c31-bea7-d45ce209014c.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:04 devstack sudo[99998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0e159705-5798-4c31-bea7-d45ce209014c.info Sep 25 11:52:04 devstack sudo[99998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:04 devstack sudo[99998]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:04 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8cac04de-14e6-4793-ae94-3d07bc3a61ad tempest-VolumesSnapshotTestJSON-1438674217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0e159705-5798-4c31-bea7-d45ce209014c.info" returned: 0 in 0.395s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:04 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-8cac04de-14e6-4793-ae94-3d07bc3a61ad tempest-VolumesSnapshotTestJSON-1438674217 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0e159705-5798-4c31-bea7-d45ce209014c.info is being set with open permissions: ugo+rw Sep 25 11:52:04 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8cac04de-14e6-4793-ae94-3d07bc3a61ad tempest-VolumesSnapshotTestJSON-1438674217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0e159705-5798-4c31-bea7-d45ce209014c.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:04 devstack sudo[100001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0e159705-5798-4c31-bea7-d45ce209014c.info Sep 25 11:52:04 devstack sudo[100001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:04 devstack sudo[100001]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:04 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8cac04de-14e6-4793-ae94-3d07bc3a61ad tempest-VolumesSnapshotTestJSON-1438674217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0e159705-5798-4c31-bea7-d45ce209014c.info" returned: 0 in 0.340s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-8cac04de-14e6-4793-ae94-3d07bc3a61ad tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.302s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:52:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d7c081af-cdf7-4125-b86e-d8f95af1e497 tempest-VolumesActionsTest-821311522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.956s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:52:05 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-d7c081af-cdf7-4125-b86e-d8f95af1e497 tempest-VolumesActionsTest-821311522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:52:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1784382932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=049d16f3-9de0-49d9-8ac8-fb817c1f5318,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af85dda72acd4db88b68cc01b7569e60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:52:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:52:04Z,use_quota=True,user_id='c370d3ebe2d24b02a5f064d1b7908383',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:52:05 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-d7c081af-cdf7-4125-b86e-d8f95af1e497 tempest-VolumesActionsTest-821311522 None] Creating volume 049d16f3-9de0-49d9-8ac8-fb817c1f5318 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:52:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d7c081af-cdf7-4125-b86e-d8f95af1e497 tempest-VolumesActionsTest-821311522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:52:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d7c081af-cdf7-4125-b86e-d8f95af1e497 tempest-VolumesActionsTest-821311522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:52:05 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-d7c081af-cdf7-4125-b86e-d8f95af1e497 tempest-VolumesActionsTest-821311522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:52:05 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-d7c081af-cdf7-4125-b86e-d8f95af1e497 tempest-VolumesActionsTest-821311522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:52:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d7c081af-cdf7-4125-b86e-d8f95af1e497 tempest-VolumesActionsTest-821311522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:52:05 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-d7c081af-cdf7-4125-b86e-d8f95af1e497 tempest-VolumesActionsTest-821311522 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:52:05 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-d7c081af-cdf7-4125-b86e-d8f95af1e497 tempest-VolumesActionsTest-821311522 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:52:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d7c081af-cdf7-4125-b86e-d8f95af1e497 tempest-VolumesActionsTest-821311522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-049d16f3-9de0-49d9-8ac8-fb817c1f5318 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:05 devstack sudo[100006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-049d16f3-9de0-49d9-8ac8-fb817c1f5318 1073741824 Sep 25 11:52:05 devstack sudo[100006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:05 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-8cac04de-14e6-4793-ae94-3d07bc3a61ad tempest-VolumesSnapshotTestJSON-1438674217 None] Create snapshot completed successfully Sep 25 11:52:05 devstack sudo[100006]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d7c081af-cdf7-4125-b86e-d8f95af1e497 tempest-VolumesActionsTest-821311522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-049d16f3-9de0-49d9-8ac8-fb817c1f5318 1073741824" returned: 0 in 0.631s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d7c081af-cdf7-4125-b86e-d8f95af1e497 tempest-VolumesActionsTest-821311522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-049d16f3-9de0-49d9-8ac8-fb817c1f5318 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:05 devstack sudo[100012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-049d16f3-9de0-49d9-8ac8-fb817c1f5318 Sep 25 11:52:05 devstack sudo[100012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:06 devstack sudo[100012]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d7c081af-cdf7-4125-b86e-d8f95af1e497 tempest-VolumesActionsTest-821311522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-049d16f3-9de0-49d9-8ac8-fb817c1f5318" returned: 0 in 0.384s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:06 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-d7c081af-cdf7-4125-b86e-d8f95af1e497 tempest-VolumesActionsTest-821311522 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:52:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d7c081af-cdf7-4125-b86e-d8f95af1e497 tempest-VolumesActionsTest-821311522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:52:06 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d7c081af-cdf7-4125-b86e-d8f95af1e497 tempest-VolumesActionsTest-821311522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55a425cb-89ef-4fcc-92f7-e0768e7c8d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-049d16f3-9de0-49d9-8ac8-fb817c1f5318', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:06 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d7c081af-cdf7-4125-b86e-d8f95af1e497 tempest-VolumesActionsTest-821311522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (245a55e5-830a-4ca2-9769-592905a9c29e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:06 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-d7c081af-cdf7-4125-b86e-d8f95af1e497 tempest-VolumesActionsTest-821311522 None] Volume volume-049d16f3-9de0-49d9-8ac8-fb817c1f5318 (049d16f3-9de0-49d9-8ac8-fb817c1f5318): created successfully Sep 25 11:52:06 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d7c081af-cdf7-4125-b86e-d8f95af1e497 tempest-VolumesActionsTest-821311522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (245a55e5-830a-4ca2-9769-592905a9c29e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:06 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d7c081af-cdf7-4125-b86e-d8f95af1e497 tempest-VolumesActionsTest-821311522 None] Flow 'volume_create_manager' (9f3037f7-1fdd-4f1d-bf1d-9bbe58e36447) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:52:06 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-d7c081af-cdf7-4125-b86e-d8f95af1e497 tempest-VolumesActionsTest-821311522 None] Created volume successfully. Sep 25 11:52:06 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-d90697a8-76c5-49ca-b1b1-f5a70974fe08 tempest-VolumesSnapshotTestJSON-1438674217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:52:07 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d90697a8-76c5-49ca-b1b1-f5a70974fe08 tempest-VolumesSnapshotTestJSON-1438674217 None] Flow 'volume_create_manager' (0ea67330-5ca7-4d3a-a2eb-08ff4fecce64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:52:07 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d90697a8-76c5-49ca-b1b1-f5a70974fe08 tempest-VolumesSnapshotTestJSON-1438674217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df6d098d-86e2-4d78-8fc2-6138beb4b8fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:07 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d90697a8-76c5-49ca-b1b1-f5a70974fe08 tempest-VolumesSnapshotTestJSON-1438674217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df6d098d-86e2-4d78-8fc2-6138beb4b8fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:52:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-996977045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=897566fa-2d57-4489-9182-c6849ce4f5ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2437d2ea68f4f68be08425e0599a9b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:52:07Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=27b8ff0c-c4ea-4bb5-aef8-3c0f2b3cc6cc,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:52:07Z,use_quota=True,user_id='0fe6a04643a34fc6a664bfb998b802f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:07 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d90697a8-76c5-49ca-b1b1-f5a70974fe08 tempest-VolumesSnapshotTestJSON-1438674217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (175ae9b3-e24d-40e4-8356-35b5d5f79c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:07 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d90697a8-76c5-49ca-b1b1-f5a70974fe08 tempest-VolumesSnapshotTestJSON-1438674217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (175ae9b3-e24d-40e4-8356-35b5d5f79c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:07 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d90697a8-76c5-49ca-b1b1-f5a70974fe08 tempest-VolumesSnapshotTestJSON-1438674217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b47a15a6-b171-4576-83af-60d32e29b202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:07 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d90697a8-76c5-49ca-b1b1-f5a70974fe08 tempest-VolumesSnapshotTestJSON-1438674217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b47a15a6-b171-4576-83af-60d32e29b202) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '897566fa-2d57-4489-9182-c6849ce4f5ad', 'volume_name': 'volume-897566fa-2d57-4489-9182-c6849ce4f5ad', 'volume_size': 2, 'snapshot_id': '27b8ff0c-c4ea-4bb5-aef8-3c0f2b3cc6cc'}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:07 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d90697a8-76c5-49ca-b1b1-f5a70974fe08 tempest-VolumesSnapshotTestJSON-1438674217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (290cb4e0-2299-45a0-a572-d635510d0d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:07 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d90697a8-76c5-49ca-b1b1-f5a70974fe08 tempest-VolumesSnapshotTestJSON-1438674217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (290cb4e0-2299-45a0-a572-d635510d0d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:07 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d90697a8-76c5-49ca-b1b1-f5a70974fe08 tempest-VolumesSnapshotTestJSON-1438674217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90a71ccc-b690-4ba8-8ef4-f7b687d5514f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:07 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-d90697a8-76c5-49ca-b1b1-f5a70974fe08 tempest-VolumesSnapshotTestJSON-1438674217 None] Volume 897566fa-2d57-4489-9182-c6849ce4f5ad: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-897566fa-2d57-4489-9182-c6849ce4f5ad', 'volume_size': 2, 'snapshot_id': '27b8ff0c-c4ea-4bb5-aef8-3c0f2b3cc6cc'} Sep 25 11:52:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d90697a8-76c5-49ca-b1b1-f5a70974fe08 tempest-VolumesSnapshotTestJSON-1438674217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:52:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d90697a8-76c5-49ca-b1b1-f5a70974fe08 tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:52:07 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-d90697a8-76c5-49ca-b1b1-f5a70974fe08 tempest-VolumesSnapshotTestJSON-1438674217 None] Acquiring lock "cinder-quobyte-27b8ff0c-c4ea-4bb5-aef8-3c0f2b3cc6cc-897566fa-2d57-4489-9182-c6849ce4f5ad" by "_create_volume_from_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:52:07 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-d90697a8-76c5-49ca-b1b1-f5a70974fe08 tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "cinder-quobyte-27b8ff0c-c4ea-4bb5-aef8-3c0f2b3cc6cc-897566fa-2d57-4489-9182-c6849ce4f5ad" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:52:07 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-d90697a8-76c5-49ca-b1b1-f5a70974fe08 tempest-VolumesSnapshotTestJSON-1438674217 None] Creating volume 897566fa-2d57-4489-9182-c6849ce4f5ad from snapshot 27b8ff0c-c4ea-4bb5-aef8-3c0f2b3cc6cc {{(pid=86984) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 11:52:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d90697a8-76c5-49ca-b1b1-f5a70974fe08 tempest-VolumesSnapshotTestJSON-1438674217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:52:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d90697a8-76c5-49ca-b1b1-f5a70974fe08 tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:52:07 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-d90697a8-76c5-49ca-b1b1-f5a70974fe08 tempest-VolumesSnapshotTestJSON-1438674217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:52:07 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-d90697a8-76c5-49ca-b1b1-f5a70974fe08 tempest-VolumesSnapshotTestJSON-1438674217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:52:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d90697a8-76c5-49ca-b1b1-f5a70974fe08 tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:52:07 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-d90697a8-76c5-49ca-b1b1-f5a70974fe08 tempest-VolumesSnapshotTestJSON-1438674217 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:52:07 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-d90697a8-76c5-49ca-b1b1-f5a70974fe08 tempest-VolumesSnapshotTestJSON-1438674217 None] Acquiring lock "cinder-quobyte-897566fa-2d57-4489-9182-c6849ce4f5ad" by "_copy_volume_from_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:52:07 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-d90697a8-76c5-49ca-b1b1-f5a70974fe08 tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "cinder-quobyte-897566fa-2d57-4489-9182-c6849ce4f5ad" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:52:07 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-d90697a8-76c5-49ca-b1b1-f5a70974fe08 tempest-VolumesSnapshotTestJSON-1438674217 None] snapshot: 27b8ff0c-c4ea-4bb5-aef8-3c0f2b3cc6cc, volume: 897566fa-2d57-4489-9182-c6849ce4f5ad, {{(pid=86984) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 11:52:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d90697a8-76c5-49ca-b1b1-f5a70974fe08 tempest-VolumesSnapshotTestJSON-1438674217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:52:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d90697a8-76c5-49ca-b1b1-f5a70974fe08 tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:52:07 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-d90697a8-76c5-49ca-b1b1-f5a70974fe08 tempest-VolumesSnapshotTestJSON-1438674217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:52:07 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-d90697a8-76c5-49ca-b1b1-f5a70974fe08 tempest-VolumesSnapshotTestJSON-1438674217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:52:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d90697a8-76c5-49ca-b1b1-f5a70974fe08 tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:52:07 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-96614c2c-28bf-450c-b6f5-d73a2dbba79b tempest-VolumesActionsTest-1180183357 None] Acquiring lock "cinder-049d16f3-9de0-49d9-8ac8-fb817c1f5318-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:52:07 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[af06440f-9d18-4e3e-afb8-7e2783d6385f]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:52:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d90697a8-76c5-49ca-b1b1-f5a70974fe08 tempest-VolumesSnapshotTestJSON-1438674217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0e159705-5798-4c31-bea7-d45ce209014c.27b8ff0c-c4ea-4bb5-aef8-3c0f2b3cc6cc {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:07 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-96614c2c-28bf-450c-b6f5-d73a2dbba79b tempest-VolumesActionsTest-1180183357 None] Lock "cinder-049d16f3-9de0-49d9-8ac8-fb817c1f5318-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:52:07 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-96614c2c-28bf-450c-b6f5-d73a2dbba79b tempest-VolumesActionsTest-1180183357 None] Acquiring lock "cinder-quobyte-049d16f3-9de0-49d9-8ac8-fb817c1f5318" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:52:07 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-96614c2c-28bf-450c-b6f5-d73a2dbba79b tempest-VolumesActionsTest-1180183357 None] Lock "cinder-quobyte-049d16f3-9de0-49d9-8ac8-fb817c1f5318" acquired by "delete_volume" :: waited 0.032s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:52:07 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c910d8f-ef2a-4cc1-8fdc-b49e12b951e1]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:52:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-96614c2c-28bf-450c-b6f5-d73a2dbba79b tempest-VolumesActionsTest-1180183357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-049d16f3-9de0-49d9-8ac8-fb817c1f5318 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:07 devstack sudo[100017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0e159705-5798-4c31-bea7-d45ce209014c.27b8ff0c-c4ea-4bb5-aef8-3c0f2b3cc6cc Sep 25 11:52:07 devstack sudo[100017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:07 devstack sudo[100018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-049d16f3-9de0-49d9-8ac8-fb817c1f5318 Sep 25 11:52:07 devstack sudo[100018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:08 devstack sudo[100018]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-96614c2c-28bf-450c-b6f5-d73a2dbba79b tempest-VolumesActionsTest-1180183357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-049d16f3-9de0-49d9-8ac8-fb817c1f5318" returned: 0 in 0.579s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:08 devstack sudo[100017]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-96614c2c-28bf-450c-b6f5-d73a2dbba79b tempest-VolumesActionsTest-1180183357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-049d16f3-9de0-49d9-8ac8-fb817c1f5318 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d90697a8-76c5-49ca-b1b1-f5a70974fe08 tempest-VolumesSnapshotTestJSON-1438674217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0e159705-5798-4c31-bea7-d45ce209014c.27b8ff0c-c4ea-4bb5-aef8-3c0f2b3cc6cc" returned: 0 in 0.852s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:08 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-d90697a8-76c5-49ca-b1b1-f5a70974fe08 tempest-VolumesSnapshotTestJSON-1438674217 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e159705-5798-4c31-bea7-d45ce209014c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86984) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:52:08 devstack sudo[100028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-049d16f3-9de0-49d9-8ac8-fb817c1f5318 Sep 25 11:52:08 devstack sudo[100028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:08 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[6beccae7-5bcc-4fdb-8aad-031100a5b323]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:52:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d90697a8-76c5-49ca-b1b1-f5a70974fe08 tempest-VolumesSnapshotTestJSON-1438674217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0e159705-5798-4c31-bea7-d45ce209014c {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:08 devstack sudo[100030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0e159705-5798-4c31-bea7-d45ce209014c Sep 25 11:52:08 devstack sudo[100030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:08 devstack sudo[100028]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-96614c2c-28bf-450c-b6f5-d73a2dbba79b tempest-VolumesActionsTest-1180183357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-049d16f3-9de0-49d9-8ac8-fb817c1f5318" returned: 0 in 0.542s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:08 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-96614c2c-28bf-450c-b6f5-d73a2dbba79b tempest-VolumesActionsTest-1180183357 None] Lock "cinder-quobyte-049d16f3-9de0-49d9-8ac8-fb817c1f5318" released by "delete_volume" :: held 1.279s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:52:08 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-96614c2c-28bf-450c-b6f5-d73a2dbba79b tempest-VolumesActionsTest-1180183357 None] Created reservations ['6dc3c8a4-26cd-4c24-be29-3d1ad73d627a', '561651a3-be66-4e4a-a624-c7b41ec3b8e6', 'e2d94459-31b3-4909-a024-0bc5f01c0459', '6163ca56-050d-451a-9077-ad0c026535e4'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:52:08 devstack sudo[100030]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d90697a8-76c5-49ca-b1b1-f5a70974fe08 tempest-VolumesSnapshotTestJSON-1438674217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0e159705-5798-4c31-bea7-d45ce209014c" returned: 0 in 0.660s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:08 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-d90697a8-76c5-49ca-b1b1-f5a70974fe08 tempest-VolumesSnapshotTestJSON-1438674217 None] will copy from snapshot at /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0e159705-5798-4c31-bea7-d45ce209014c {{(pid=86984) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 11:52:08 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-d90697a8-76c5-49ca-b1b1-f5a70974fe08 tempest-VolumesSnapshotTestJSON-1438674217 None] Creating direct copy from snapshot {{(pid=86984) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 11:52:08 devstack cinder-volume[86984]: DEBUG cinder.utils [None req-d90697a8-76c5-49ca-b1b1-f5a70974fe08 tempest-VolumesSnapshotTestJSON-1438674217 None] Path /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-897566fa-2d57-4489-9182-c6849ce4f5ad not found in is_blk_device check {{(pid=86984) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 11:52:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d90697a8-76c5-49ca-b1b1-f5a70974fe08 tempest-VolumesSnapshotTestJSON-1438674217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0e159705-5798-4c31-bea7-d45ce209014c /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-897566fa-2d57-4489-9182-c6849ce4f5ad {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:08 devstack sudo[100036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0e159705-5798-4c31-bea7-d45ce209014c /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-897566fa-2d57-4489-9182-c6849ce4f5ad Sep 25 11:52:08 devstack sudo[100036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-96614c2c-28bf-450c-b6f5-d73a2dbba79b tempest-VolumesActionsTest-1180183357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:52:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-96614c2c-28bf-450c-b6f5-d73a2dbba79b tempest-VolumesActionsTest-1180183357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:52:08 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-96614c2c-28bf-450c-b6f5-d73a2dbba79b tempest-VolumesActionsTest-1180183357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:52:08 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-96614c2c-28bf-450c-b6f5-d73a2dbba79b tempest-VolumesActionsTest-1180183357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:52:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-96614c2c-28bf-450c-b6f5-d73a2dbba79b tempest-VolumesActionsTest-1180183357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:52:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-96614c2c-28bf-450c-b6f5-d73a2dbba79b tempest-VolumesActionsTest-1180183357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:09 devstack sudo[100038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:52:09 devstack sudo[100038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:09 devstack sudo[100038]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-96614c2c-28bf-450c-b6f5-d73a2dbba79b tempest-VolumesActionsTest-1180183357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.346s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:09 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-96614c2c-28bf-450c-b6f5-d73a2dbba79b tempest-VolumesActionsTest-1180183357 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:52:09 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-96614c2c-28bf-450c-b6f5-d73a2dbba79b tempest-VolumesActionsTest-1180183357 None] Deleted volume successfully. Sep 25 11:52:09 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-96614c2c-28bf-450c-b6f5-d73a2dbba79b tempest-VolumesActionsTest-1180183357 None] Lock "cinder-049d16f3-9de0-49d9-8ac8-fb817c1f5318-delete_volume" released by "delete_volume" :: held 2.045s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:52:09 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-1285b6ad-977b-447d-a933-795b859e1658 tempest-TestImageHashVerification-1580856923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:52:09 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-1285b6ad-977b-447d-a933-795b859e1658 tempest-TestImageHashVerification-1580856923 None] Flow 'volume_create_manager' (84c85cc0-f04b-464d-a418-6fea123a017d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:52:09 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-1285b6ad-977b-447d-a933-795b859e1658 tempest-TestImageHashVerification-1580856923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56d57e18-9b25-4b54-a80b-3f5e1e1a6f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:09 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-1285b6ad-977b-447d-a933-795b859e1658 tempest-TestImageHashVerification-1580856923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56d57e18-9b25-4b54-a80b-3f5e1e1a6f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:52:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-49958510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3c02980-5404-41e4-be14-d1d845d694e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b125b5345649430a826e1ac84065dd5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:52:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:52:10Z,use_quota=True,user_id='df6ee63d296e4cdb825e7eb9d9922cfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:09 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-1285b6ad-977b-447d-a933-795b859e1658 tempest-TestImageHashVerification-1580856923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d2c8e9b-a75b-427d-b859-8db7575d150b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:09 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-1285b6ad-977b-447d-a933-795b859e1658 tempest-TestImageHashVerification-1580856923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d2c8e9b-a75b-427d-b859-8db7575d150b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:09 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-1285b6ad-977b-447d-a933-795b859e1658 tempest-TestImageHashVerification-1580856923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c01ff79-d133-4122-9385-0e4f637faaa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:09 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-1285b6ad-977b-447d-a933-795b859e1658 tempest-TestImageHashVerification-1580856923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c01ff79-d133-4122-9385-0e4f637faaa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3c02980-5404-41e4-be14-d1d845d694e3', 'volume_name': 'volume-c3c02980-5404-41e4-be14-d1d845d694e3', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:09 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-1285b6ad-977b-447d-a933-795b859e1658 tempest-TestImageHashVerification-1580856923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (853be58a-a1f8-4dbb-8410-ff2840668537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:09 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-1285b6ad-977b-447d-a933-795b859e1658 tempest-TestImageHashVerification-1580856923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (853be58a-a1f8-4dbb-8410-ff2840668537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:09 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-1285b6ad-977b-447d-a933-795b859e1658 tempest-TestImageHashVerification-1580856923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a87511b-c26e-47df-bfdc-0fe7ad3041ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:09 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-1285b6ad-977b-447d-a933-795b859e1658 tempest-TestImageHashVerification-1580856923 None] Volume c3c02980-5404-41e4-be14-d1d845d694e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3c02980-5404-41e4-be14-d1d845d694e3', 'volume_size': 1} Sep 25 11:52:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-1285b6ad-977b-447d-a933-795b859e1658 tempest-TestImageHashVerification-1580856923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:52:10 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-604a690a-ef0d-408b-b45d-5a4ec01d33fc tempest-VolumesActionsTest-821311522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:52:11 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-604a690a-ef0d-408b-b45d-5a4ec01d33fc tempest-VolumesActionsTest-821311522 None] Flow 'volume_create_manager' (722b3182-b99b-465b-96bc-1451a974b69a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:52:11 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-604a690a-ef0d-408b-b45d-5a4ec01d33fc tempest-VolumesActionsTest-821311522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (542ddd0a-43e2-4c1a-9e43-d46ec1bcf21a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:11 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-604a690a-ef0d-408b-b45d-5a4ec01d33fc tempest-VolumesActionsTest-821311522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (542ddd0a-43e2-4c1a-9e43-d46ec1bcf21a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:52:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-37261465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c78cc9a-e7d8-4709-9b56-2e79f226b799,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af85dda72acd4db88b68cc01b7569e60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:52:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:52:11Z,use_quota=True,user_id='c370d3ebe2d24b02a5f064d1b7908383',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:11 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-604a690a-ef0d-408b-b45d-5a4ec01d33fc tempest-VolumesActionsTest-821311522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1b95bd3-095a-41cf-9172-e16151c0d9a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:11 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-604a690a-ef0d-408b-b45d-5a4ec01d33fc tempest-VolumesActionsTest-821311522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1b95bd3-095a-41cf-9172-e16151c0d9a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:11 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-604a690a-ef0d-408b-b45d-5a4ec01d33fc tempest-VolumesActionsTest-821311522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3896fccd-e6fa-4bd0-977b-6657022180a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:11 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-604a690a-ef0d-408b-b45d-5a4ec01d33fc tempest-VolumesActionsTest-821311522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3896fccd-e6fa-4bd0-977b-6657022180a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c78cc9a-e7d8-4709-9b56-2e79f226b799', 'volume_name': 'volume-7c78cc9a-e7d8-4709-9b56-2e79f226b799', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:11 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-604a690a-ef0d-408b-b45d-5a4ec01d33fc tempest-VolumesActionsTest-821311522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c0cad54-f539-4f9f-a286-a607f58e8fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:11 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-604a690a-ef0d-408b-b45d-5a4ec01d33fc tempest-VolumesActionsTest-821311522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c0cad54-f539-4f9f-a286-a607f58e8fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:11 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-604a690a-ef0d-408b-b45d-5a4ec01d33fc tempest-VolumesActionsTest-821311522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c706c117-8571-4c70-99e5-4b2e56479a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:11 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-604a690a-ef0d-408b-b45d-5a4ec01d33fc tempest-VolumesActionsTest-821311522 None] Volume 7c78cc9a-e7d8-4709-9b56-2e79f226b799: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c78cc9a-e7d8-4709-9b56-2e79f226b799', 'volume_size': 1} Sep 25 11:52:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-604a690a-ef0d-408b-b45d-5a4ec01d33fc tempest-VolumesActionsTest-821311522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:52:17 devstack sudo[100036]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:17 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d90697a8-76c5-49ca-b1b1-f5a70974fe08 tempest-VolumesSnapshotTestJSON-1438674217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0e159705-5798-4c31-bea7-d45ce209014c /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-897566fa-2d57-4489-9182-c6849ce4f5ad" returned: 0 in 8.252s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:17 devstack cinder-volume[86984]: DEBUG cinder.image.image_utils [None req-d90697a8-76c5-49ca-b1b1-f5a70974fe08 tempest-VolumesSnapshotTestJSON-1438674217 None] Image conversion details: src /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0e159705-5798-4c31-bea7-d45ce209014c, size 1024.00 MB, duration 8.25 sec, destination /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-897566fa-2d57-4489-9182-c6849ce4f5ad {{(pid=86984) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 11:52:17 devstack cinder-volume[86984]: INFO cinder.image.image_utils [None req-d90697a8-76c5-49ca-b1b1-f5a70974fe08 tempest-VolumesSnapshotTestJSON-1438674217 None] Converted 1024.00 MB image at 124.08 MB/s Sep 25 11:52:17 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-d90697a8-76c5-49ca-b1b1-f5a70974fe08 tempest-VolumesSnapshotTestJSON-1438674217 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-897566fa-2d57-4489-9182-c6849ce4f5ad is being set with open permissions: ugo+rw Sep 25 11:52:17 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d90697a8-76c5-49ca-b1b1-f5a70974fe08 tempest-VolumesSnapshotTestJSON-1438674217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-897566fa-2d57-4489-9182-c6849ce4f5ad {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:17 devstack sudo[100054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-897566fa-2d57-4489-9182-c6849ce4f5ad Sep 25 11:52:17 devstack sudo[100054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:17 devstack sudo[100054]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:17 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d90697a8-76c5-49ca-b1b1-f5a70974fe08 tempest-VolumesSnapshotTestJSON-1438674217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-897566fa-2d57-4489-9182-c6849ce4f5ad" returned: 0 in 0.274s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:17 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-d90697a8-76c5-49ca-b1b1-f5a70974fe08 tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "cinder-quobyte-897566fa-2d57-4489-9182-c6849ce4f5ad" released by "_copy_volume_from_snapshot" :: held 10.206s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:52:17 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-d90697a8-76c5-49ca-b1b1-f5a70974fe08 tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "cinder-quobyte-27b8ff0c-c4ea-4bb5-aef8-3c0f2b3cc6cc-897566fa-2d57-4489-9182-c6849ce4f5ad" released by "_create_volume_from_snapshot" :: held 10.302s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:52:17 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d90697a8-76c5-49ca-b1b1-f5a70974fe08 tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.320s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:52:17 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-1285b6ad-977b-447d-a933-795b859e1658 tempest-TestImageHashVerification-1580856923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.572s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:52:17 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-1285b6ad-977b-447d-a933-795b859e1658 tempest-TestImageHashVerification-1580856923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:52:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-49958510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3c02980-5404-41e4-be14-d1d845d694e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b125b5345649430a826e1ac84065dd5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:52:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:52:10Z,use_quota=True,user_id='df6ee63d296e4cdb825e7eb9d9922cfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:52:17 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-1285b6ad-977b-447d-a933-795b859e1658 tempest-TestImageHashVerification-1580856923 None] Creating volume c3c02980-5404-41e4-be14-d1d845d694e3 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:52:17 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-1285b6ad-977b-447d-a933-795b859e1658 tempest-TestImageHashVerification-1580856923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:52:17 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-1285b6ad-977b-447d-a933-795b859e1658 tempest-TestImageHashVerification-1580856923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:52:17 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-1285b6ad-977b-447d-a933-795b859e1658 tempest-TestImageHashVerification-1580856923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:52:17 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-1285b6ad-977b-447d-a933-795b859e1658 tempest-TestImageHashVerification-1580856923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:52:17 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-1285b6ad-977b-447d-a933-795b859e1658 tempest-TestImageHashVerification-1580856923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:52:17 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-1285b6ad-977b-447d-a933-795b859e1658 tempest-TestImageHashVerification-1580856923 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:52:17 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-1285b6ad-977b-447d-a933-795b859e1658 tempest-TestImageHashVerification-1580856923 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:52:17 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-1285b6ad-977b-447d-a933-795b859e1658 tempest-TestImageHashVerification-1580856923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c3c02980-5404-41e4-be14-d1d845d694e3 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:17 devstack sudo[100057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c3c02980-5404-41e4-be14-d1d845d694e3 1073741824 Sep 25 11:52:17 devstack sudo[100057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:17 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d90697a8-76c5-49ca-b1b1-f5a70974fe08 tempest-VolumesSnapshotTestJSON-1438674217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90a71ccc-b690-4ba8-8ef4-f7b687d5514f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-897566fa-2d57-4489-9182-c6849ce4f5ad', 'volume_size': 2, 'snapshot_id': '27b8ff0c-c4ea-4bb5-aef8-3c0f2b3cc6cc'}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:17 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d90697a8-76c5-49ca-b1b1-f5a70974fe08 tempest-VolumesSnapshotTestJSON-1438674217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61c3a286-3a08-41ab-918f-89705180080a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:17 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-d90697a8-76c5-49ca-b1b1-f5a70974fe08 tempest-VolumesSnapshotTestJSON-1438674217 None] Volume volume-897566fa-2d57-4489-9182-c6849ce4f5ad (897566fa-2d57-4489-9182-c6849ce4f5ad): created successfully Sep 25 11:52:17 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d90697a8-76c5-49ca-b1b1-f5a70974fe08 tempest-VolumesSnapshotTestJSON-1438674217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61c3a286-3a08-41ab-918f-89705180080a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:17 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d90697a8-76c5-49ca-b1b1-f5a70974fe08 tempest-VolumesSnapshotTestJSON-1438674217 None] Flow 'volume_create_manager' (0ea67330-5ca7-4d3a-a2eb-08ff4fecce64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:52:17 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-d90697a8-76c5-49ca-b1b1-f5a70974fe08 tempest-VolumesSnapshotTestJSON-1438674217 None] Created volume successfully. Sep 25 11:52:18 devstack sudo[100057]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-1285b6ad-977b-447d-a933-795b859e1658 tempest-TestImageHashVerification-1580856923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c3c02980-5404-41e4-be14-d1d845d694e3 1073741824" returned: 0 in 0.621s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-1285b6ad-977b-447d-a933-795b859e1658 tempest-TestImageHashVerification-1580856923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c3c02980-5404-41e4-be14-d1d845d694e3 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:18 devstack sudo[100064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c3c02980-5404-41e4-be14-d1d845d694e3 Sep 25 11:52:18 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-6433a068-c682-4f9a-818d-eac0214edde3 tempest-VolumesSnapshotTestJSON-1438674217 None] Acquiring lock "cinder-897566fa-2d57-4489-9182-c6849ce4f5ad-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:52:18 devstack sudo[100064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:18 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-6433a068-c682-4f9a-818d-eac0214edde3 tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "cinder-897566fa-2d57-4489-9182-c6849ce4f5ad-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:52:18 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-6433a068-c682-4f9a-818d-eac0214edde3 tempest-VolumesSnapshotTestJSON-1438674217 None] Acquiring lock "cinder-quobyte-897566fa-2d57-4489-9182-c6849ce4f5ad" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:52:18 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-6433a068-c682-4f9a-818d-eac0214edde3 tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "cinder-quobyte-897566fa-2d57-4489-9182-c6849ce4f5ad" acquired by "delete_volume" :: waited 0.018s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:52:18 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c7cf6b-2de4-4eff-a584-7455305bdbc0]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:52:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6433a068-c682-4f9a-818d-eac0214edde3 tempest-VolumesSnapshotTestJSON-1438674217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-897566fa-2d57-4489-9182-c6849ce4f5ad {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:18 devstack sudo[100066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-897566fa-2d57-4489-9182-c6849ce4f5ad Sep 25 11:52:18 devstack sudo[100066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:18 devstack sudo[100064]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-1285b6ad-977b-447d-a933-795b859e1658 tempest-TestImageHashVerification-1580856923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c3c02980-5404-41e4-be14-d1d845d694e3" returned: 0 in 0.400s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:18 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-1285b6ad-977b-447d-a933-795b859e1658 tempest-TestImageHashVerification-1580856923 None] <== create_volume: return (1085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:52:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-1285b6ad-977b-447d-a933-795b859e1658 tempest-TestImageHashVerification-1580856923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:52:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-604a690a-ef0d-408b-b45d-5a4ec01d33fc tempest-VolumesActionsTest-821311522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.372s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:52:18 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-604a690a-ef0d-408b-b45d-5a4ec01d33fc tempest-VolumesActionsTest-821311522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:52:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-37261465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c78cc9a-e7d8-4709-9b56-2e79f226b799,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af85dda72acd4db88b68cc01b7569e60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:52:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:52:11Z,use_quota=True,user_id='c370d3ebe2d24b02a5f064d1b7908383',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:52:18 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-604a690a-ef0d-408b-b45d-5a4ec01d33fc tempest-VolumesActionsTest-821311522 None] Creating volume 7c78cc9a-e7d8-4709-9b56-2e79f226b799 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:52:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-604a690a-ef0d-408b-b45d-5a4ec01d33fc tempest-VolumesActionsTest-821311522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:52:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-604a690a-ef0d-408b-b45d-5a4ec01d33fc tempest-VolumesActionsTest-821311522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:52:18 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-604a690a-ef0d-408b-b45d-5a4ec01d33fc tempest-VolumesActionsTest-821311522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:52:18 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-604a690a-ef0d-408b-b45d-5a4ec01d33fc tempest-VolumesActionsTest-821311522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:52:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-604a690a-ef0d-408b-b45d-5a4ec01d33fc tempest-VolumesActionsTest-821311522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:52:18 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-604a690a-ef0d-408b-b45d-5a4ec01d33fc tempest-VolumesActionsTest-821311522 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:52:18 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-604a690a-ef0d-408b-b45d-5a4ec01d33fc tempest-VolumesActionsTest-821311522 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:52:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-604a690a-ef0d-408b-b45d-5a4ec01d33fc tempest-VolumesActionsTest-821311522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7c78cc9a-e7d8-4709-9b56-2e79f226b799 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:18 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-1285b6ad-977b-447d-a933-795b859e1658 tempest-TestImageHashVerification-1580856923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a87511b-c26e-47df-bfdc-0fe7ad3041ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3c02980-5404-41e4-be14-d1d845d694e3', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:18 devstack sudo[100069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7c78cc9a-e7d8-4709-9b56-2e79f226b799 1073741824 Sep 25 11:52:18 devstack sudo[100069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:18 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-1285b6ad-977b-447d-a933-795b859e1658 tempest-TestImageHashVerification-1580856923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9c859ca-bc42-44e9-b18f-df364f04cc5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:18 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-1285b6ad-977b-447d-a933-795b859e1658 tempest-TestImageHashVerification-1580856923 None] Volume volume-c3c02980-5404-41e4-be14-d1d845d694e3 (c3c02980-5404-41e4-be14-d1d845d694e3): created successfully Sep 25 11:52:18 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-1285b6ad-977b-447d-a933-795b859e1658 tempest-TestImageHashVerification-1580856923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9c859ca-bc42-44e9-b18f-df364f04cc5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:18 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-1285b6ad-977b-447d-a933-795b859e1658 tempest-TestImageHashVerification-1580856923 None] Flow 'volume_create_manager' (84c85cc0-f04b-464d-a418-6fea123a017d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:52:18 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-1285b6ad-977b-447d-a933-795b859e1658 tempest-TestImageHashVerification-1580856923 None] Created volume successfully. Sep 25 11:52:18 devstack sudo[100066]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6433a068-c682-4f9a-818d-eac0214edde3 tempest-VolumesSnapshotTestJSON-1438674217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-897566fa-2d57-4489-9182-c6849ce4f5ad" returned: 0 in 0.600s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6433a068-c682-4f9a-818d-eac0214edde3 tempest-VolumesSnapshotTestJSON-1438674217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-897566fa-2d57-4489-9182-c6849ce4f5ad {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:18 devstack sudo[100076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-897566fa-2d57-4489-9182-c6849ce4f5ad Sep 25 11:52:18 devstack sudo[100076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:19 devstack sudo[100069]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:19 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-604a690a-ef0d-408b-b45d-5a4ec01d33fc tempest-VolumesActionsTest-821311522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7c78cc9a-e7d8-4709-9b56-2e79f226b799 1073741824" returned: 0 in 0.687s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:19 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-604a690a-ef0d-408b-b45d-5a4ec01d33fc tempest-VolumesActionsTest-821311522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7c78cc9a-e7d8-4709-9b56-2e79f226b799 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:19 devstack sudo[100076]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:19 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6433a068-c682-4f9a-818d-eac0214edde3 tempest-VolumesSnapshotTestJSON-1438674217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-897566fa-2d57-4489-9182-c6849ce4f5ad" returned: 0 in 0.481s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:19 devstack sudo[100081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7c78cc9a-e7d8-4709-9b56-2e79f226b799 Sep 25 11:52:19 devstack sudo[100081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:19 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-6433a068-c682-4f9a-818d-eac0214edde3 tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "cinder-quobyte-897566fa-2d57-4489-9182-c6849ce4f5ad" released by "delete_volume" :: held 1.161s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:52:19 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-6433a068-c682-4f9a-818d-eac0214edde3 tempest-VolumesSnapshotTestJSON-1438674217 None] Created reservations ['87442861-acf1-45f9-8074-f167b9744ac8', 'ad9a18fa-0fc3-4dc9-b18d-f90993a58fa7', 'bd418b74-d263-48a2-8d7d-735d7d5ffd3b', 'ac755eb0-d6ae-4bc0-bc69-7605e61a032b'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:52:19 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-6433a068-c682-4f9a-818d-eac0214edde3 tempest-VolumesSnapshotTestJSON-1438674217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:52:19 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-6433a068-c682-4f9a-818d-eac0214edde3 tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:52:19 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-6433a068-c682-4f9a-818d-eac0214edde3 tempest-VolumesSnapshotTestJSON-1438674217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:52:19 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-6433a068-c682-4f9a-818d-eac0214edde3 tempest-VolumesSnapshotTestJSON-1438674217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:52:19 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-6433a068-c682-4f9a-818d-eac0214edde3 tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:52:19 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6433a068-c682-4f9a-818d-eac0214edde3 tempest-VolumesSnapshotTestJSON-1438674217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:19 devstack sudo[100084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:52:19 devstack sudo[100084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:19 devstack sudo[100081]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:19 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-604a690a-ef0d-408b-b45d-5a4ec01d33fc tempest-VolumesActionsTest-821311522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7c78cc9a-e7d8-4709-9b56-2e79f226b799" returned: 0 in 0.501s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:19 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-604a690a-ef0d-408b-b45d-5a4ec01d33fc tempest-VolumesActionsTest-821311522 None] <== create_volume: return (1307ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:52:19 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-604a690a-ef0d-408b-b45d-5a4ec01d33fc tempest-VolumesActionsTest-821311522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.311s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:52:19 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-604a690a-ef0d-408b-b45d-5a4ec01d33fc tempest-VolumesActionsTest-821311522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c706c117-8571-4c70-99e5-4b2e56479a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c78cc9a-e7d8-4709-9b56-2e79f226b799', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:19 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-604a690a-ef0d-408b-b45d-5a4ec01d33fc tempest-VolumesActionsTest-821311522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89fca8f6-1919-421a-939d-c42912181696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:19 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-604a690a-ef0d-408b-b45d-5a4ec01d33fc tempest-VolumesActionsTest-821311522 None] Volume volume-7c78cc9a-e7d8-4709-9b56-2e79f226b799 (7c78cc9a-e7d8-4709-9b56-2e79f226b799): created successfully Sep 25 11:52:19 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-604a690a-ef0d-408b-b45d-5a4ec01d33fc tempest-VolumesActionsTest-821311522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89fca8f6-1919-421a-939d-c42912181696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:20 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-604a690a-ef0d-408b-b45d-5a4ec01d33fc tempest-VolumesActionsTest-821311522 None] Flow 'volume_create_manager' (722b3182-b99b-465b-96bc-1451a974b69a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:52:20 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-604a690a-ef0d-408b-b45d-5a4ec01d33fc tempest-VolumesActionsTest-821311522 None] Created volume successfully. Sep 25 11:52:20 devstack sudo[100084]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6433a068-c682-4f9a-818d-eac0214edde3 tempest-VolumesSnapshotTestJSON-1438674217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.387s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:20 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-6433a068-c682-4f9a-818d-eac0214edde3 tempest-VolumesSnapshotTestJSON-1438674217 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:52:20 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-6433a068-c682-4f9a-818d-eac0214edde3 tempest-VolumesSnapshotTestJSON-1438674217 None] Deleted volume successfully. Sep 25 11:52:20 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-6433a068-c682-4f9a-818d-eac0214edde3 tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "cinder-897566fa-2d57-4489-9182-c6849ce4f5ad-delete_volume" released by "delete_volume" :: held 1.952s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:52:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-cc72d134-8f53-4e75-ada7-1d784b5a87fd tempest-TestImageHashVerification-1580856923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:52:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-cc72d134-8f53-4e75-ada7-1d784b5a87fd tempest-TestImageHashVerification-1580856923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:52:20 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e434399-7b10-4b7a-9667-f18512299e39]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:52:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cc72d134-8f53-4e75-ada7-1d784b5a87fd tempest-TestImageHashVerification-1580856923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c3c02980-5404-41e4-be14-d1d845d694e3 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:20 devstack sudo[100087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c3c02980-5404-41e4-be14-d1d845d694e3 Sep 25 11:52:20 devstack sudo[100087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:20 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-8d65d588-ea33-40ba-928d-61e8f554ef6d tempest-VolumesSnapshotTestJSON-1438674217 None] Acquiring lock "cinder-27b8ff0c-c4ea-4bb5-aef8-3c0f2b3cc6cc-delete_snapshot" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:52:20 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-8d65d588-ea33-40ba-928d-61e8f554ef6d tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "cinder-27b8ff0c-c4ea-4bb5-aef8-3c0f2b3cc6cc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:52:20 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-8d65d588-ea33-40ba-928d-61e8f554ef6d tempest-VolumesSnapshotTestJSON-1438674217 None] Acquiring lock "cinder-quobyte-0e159705-5798-4c31-bea7-d45ce209014c" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:52:20 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-8d65d588-ea33-40ba-928d-61e8f554ef6d tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "cinder-quobyte-0e159705-5798-4c31-bea7-d45ce209014c" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:52:20 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-8d65d588-ea33-40ba-928d-61e8f554ef6d tempest-VolumesSnapshotTestJSON-1438674217 None] Acquiring lock "cinder-quobyte-27b8ff0c-c4ea-4bb5-aef8-3c0f2b3cc6cc" by "_delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:52:20 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-8d65d588-ea33-40ba-928d-61e8f554ef6d tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "cinder-quobyte-27b8ff0c-c4ea-4bb5-aef8-3c0f2b3cc6cc" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:52:20 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-8d65d588-ea33-40ba-928d-61e8f554ef6d tempest-VolumesSnapshotTestJSON-1438674217 None] Deleting offline snapshot 27b8ff0c-c4ea-4bb5-aef8-3c0f2b3cc6cc of volume 0e159705-5798-4c31-bea7-d45ce209014c {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:52:20 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-8d65d588-ea33-40ba-928d-61e8f554ef6d tempest-VolumesSnapshotTestJSON-1438674217 None] snapshot_file for this snap is: volume-0e159705-5798-4c31-bea7-d45ce209014c.27b8ff0c-c4ea-4bb5-aef8-3c0f2b3cc6cc {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:52:20 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bcbcb7f-e037-4393-b2ad-3e6e19c70392]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:52:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8d65d588-ea33-40ba-928d-61e8f554ef6d tempest-VolumesSnapshotTestJSON-1438674217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0e159705-5798-4c31-bea7-d45ce209014c.27b8ff0c-c4ea-4bb5-aef8-3c0f2b3cc6cc {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:20 devstack sudo[100087]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cc72d134-8f53-4e75-ada7-1d784b5a87fd tempest-TestImageHashVerification-1580856923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c3c02980-5404-41e4-be14-d1d845d694e3" returned: 0 in 0.666s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:20 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[624d1aa0-4d16-40bc-8c29-ba645961ac4c]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:52:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cc72d134-8f53-4e75-ada7-1d784b5a87fd tempest-TestImageHashVerification-1580856923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c3c02980-5404-41e4-be14-d1d845d694e3 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:21 devstack sudo[100092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0e159705-5798-4c31-bea7-d45ce209014c.27b8ff0c-c4ea-4bb5-aef8-3c0f2b3cc6cc Sep 25 11:52:21 devstack sudo[100092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:21 devstack sudo[100094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c3c02980-5404-41e4-be14-d1d845d694e3 Sep 25 11:52:21 devstack sudo[100094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:21 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-0ec4728b-558d-4c7c-808b-65ecb29f8797 tempest-VolumesActionsTest-1180183357 None] Acquiring lock "cinder-7c78cc9a-e7d8-4709-9b56-2e79f226b799-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:52:21 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-0ec4728b-558d-4c7c-808b-65ecb29f8797 tempest-VolumesActionsTest-1180183357 None] Lock "cinder-7c78cc9a-e7d8-4709-9b56-2e79f226b799-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:52:21 devstack sudo[100092]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:21 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8d65d588-ea33-40ba-928d-61e8f554ef6d tempest-VolumesSnapshotTestJSON-1438674217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0e159705-5798-4c31-bea7-d45ce209014c.27b8ff0c-c4ea-4bb5-aef8-3c0f2b3cc6cc" returned: 0 in 0.529s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:21 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-8d65d588-ea33-40ba-928d-61e8f554ef6d tempest-VolumesSnapshotTestJSON-1438674217 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e159705-5798-4c31-bea7-d45ce209014c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86984) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:52:21 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-0ec4728b-558d-4c7c-808b-65ecb29f8797 tempest-VolumesActionsTest-1180183357 None] Acquiring lock "cinder-quobyte-7c78cc9a-e7d8-4709-9b56-2e79f226b799" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:52:21 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[857c0453-6116-4210-ba88-cecbfbb693bf]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:52:21 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8d65d588-ea33-40ba-928d-61e8f554ef6d tempest-VolumesSnapshotTestJSON-1438674217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0e159705-5798-4c31-bea7-d45ce209014c {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:21 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-0ec4728b-558d-4c7c-808b-65ecb29f8797 tempest-VolumesActionsTest-1180183357 None] Lock "cinder-quobyte-7c78cc9a-e7d8-4709-9b56-2e79f226b799" acquired by "delete_volume" :: waited 0.031s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:52:21 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca203a4-e670-4e11-8d92-fae5f1d90280]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:52:21 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-0ec4728b-558d-4c7c-808b-65ecb29f8797 tempest-VolumesActionsTest-1180183357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7c78cc9a-e7d8-4709-9b56-2e79f226b799 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:21 devstack sudo[100094]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:21 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cc72d134-8f53-4e75-ada7-1d784b5a87fd tempest-TestImageHashVerification-1580856923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c3c02980-5404-41e4-be14-d1d845d694e3" returned: 0 in 0.570s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:21 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cc72d134-8f53-4e75-ada7-1d784b5a87fd tempest-TestImageHashVerification-1580856923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c3c02980-5404-41e4-be14-d1d845d694e3 /opt/stack/data/cinder/conversion/c3c02980-5404-41e4-be14-d1d845d694e3.temp_image.ae774493-5e29-4267-8a21-745a4a458569o64xs1ao.img {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:21 devstack sudo[100102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0e159705-5798-4c31-bea7-d45ce209014c Sep 25 11:52:21 devstack sudo[100102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:21 devstack sudo[100106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c3c02980-5404-41e4-be14-d1d845d694e3 /opt/stack/data/cinder/conversion/c3c02980-5404-41e4-be14-d1d845d694e3.temp_image.ae774493-5e29-4267-8a21-745a4a458569o64xs1ao.img Sep 25 11:52:21 devstack sudo[100106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:21 devstack sudo[100105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7c78cc9a-e7d8-4709-9b56-2e79f226b799 Sep 25 11:52:21 devstack sudo[100105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:22 devstack sudo[100105]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:22 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-0ec4728b-558d-4c7c-808b-65ecb29f8797 tempest-VolumesActionsTest-1180183357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7c78cc9a-e7d8-4709-9b56-2e79f226b799" returned: 0 in 0.555s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:22 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-0ec4728b-558d-4c7c-808b-65ecb29f8797 tempest-VolumesActionsTest-1180183357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7c78cc9a-e7d8-4709-9b56-2e79f226b799 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:22 devstack sudo[100123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7c78cc9a-e7d8-4709-9b56-2e79f226b799 Sep 25 11:52:22 devstack sudo[100123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:22 devstack sudo[100102]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:22 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8d65d588-ea33-40ba-928d-61e8f554ef6d tempest-VolumesSnapshotTestJSON-1438674217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0e159705-5798-4c31-bea7-d45ce209014c" returned: 0 in 1.023s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:22 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8d65d588-ea33-40ba-928d-61e8f554ef6d tempest-VolumesSnapshotTestJSON-1438674217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0e159705-5798-4c31-bea7-d45ce209014c.27b8ff0c-c4ea-4bb5-aef8-3c0f2b3cc6cc {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:22 devstack sudo[100130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0e159705-5798-4c31-bea7-d45ce209014c.27b8ff0c-c4ea-4bb5-aef8-3c0f2b3cc6cc Sep 25 11:52:22 devstack sudo[100130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:22 devstack sudo[100123]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:22 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-0ec4728b-558d-4c7c-808b-65ecb29f8797 tempest-VolumesActionsTest-1180183357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7c78cc9a-e7d8-4709-9b56-2e79f226b799" returned: 0 in 0.618s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:22 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-0ec4728b-558d-4c7c-808b-65ecb29f8797 tempest-VolumesActionsTest-1180183357 None] Lock "cinder-quobyte-7c78cc9a-e7d8-4709-9b56-2e79f226b799" released by "delete_volume" :: held 1.277s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:52:22 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-0ec4728b-558d-4c7c-808b-65ecb29f8797 tempest-VolumesActionsTest-1180183357 None] Created reservations ['b16cd748-0924-4b12-917b-10a8e78d08c9', '8ce3ccf3-3133-4c84-93fb-33a6ecec345d', 'd050f3c8-cc1b-4629-a970-e1a7ad8d1e47', 'c9441d05-6c10-4d03-b3ce-21464a8b6682'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:52:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-0ec4728b-558d-4c7c-808b-65ecb29f8797 tempest-VolumesActionsTest-1180183357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:52:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-0ec4728b-558d-4c7c-808b-65ecb29f8797 tempest-VolumesActionsTest-1180183357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:52:23 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-0ec4728b-558d-4c7c-808b-65ecb29f8797 tempest-VolumesActionsTest-1180183357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:52:23 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-0ec4728b-558d-4c7c-808b-65ecb29f8797 tempest-VolumesActionsTest-1180183357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:52:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-0ec4728b-558d-4c7c-808b-65ecb29f8797 tempest-VolumesActionsTest-1180183357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:52:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-0ec4728b-558d-4c7c-808b-65ecb29f8797 tempest-VolumesActionsTest-1180183357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:23 devstack sudo[100137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:52:23 devstack sudo[100137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:23 devstack sudo[100130]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8d65d588-ea33-40ba-928d-61e8f554ef6d tempest-VolumesSnapshotTestJSON-1438674217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0e159705-5798-4c31-bea7-d45ce209014c.27b8ff0c-c4ea-4bb5-aef8-3c0f2b3cc6cc" returned: 0 in 0.930s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8d65d588-ea33-40ba-928d-61e8f554ef6d tempest-VolumesSnapshotTestJSON-1438674217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0e159705-5798-4c31-bea7-d45ce209014c.27b8ff0c-c4ea-4bb5-aef8-3c0f2b3cc6cc {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:23 devstack sudo[100140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0e159705-5798-4c31-bea7-d45ce209014c.27b8ff0c-c4ea-4bb5-aef8-3c0f2b3cc6cc Sep 25 11:52:23 devstack sudo[100140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:23 devstack sudo[100137]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-0ec4728b-558d-4c7c-808b-65ecb29f8797 tempest-VolumesActionsTest-1180183357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.594s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:23 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-0ec4728b-558d-4c7c-808b-65ecb29f8797 tempest-VolumesActionsTest-1180183357 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:52:23 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-0ec4728b-558d-4c7c-808b-65ecb29f8797 tempest-VolumesActionsTest-1180183357 None] Deleted volume successfully. Sep 25 11:52:23 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-0ec4728b-558d-4c7c-808b-65ecb29f8797 tempest-VolumesActionsTest-1180183357 None] Lock "cinder-7c78cc9a-e7d8-4709-9b56-2e79f226b799-delete_volume" released by "delete_volume" :: held 2.439s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:52:24 devstack sudo[100140]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:24 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8d65d588-ea33-40ba-928d-61e8f554ef6d tempest-VolumesSnapshotTestJSON-1438674217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0e159705-5798-4c31-bea7-d45ce209014c.27b8ff0c-c4ea-4bb5-aef8-3c0f2b3cc6cc" returned: 0 in 0.818s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:24 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-8d65d588-ea33-40ba-928d-61e8f554ef6d tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "cinder-quobyte-27b8ff0c-c4ea-4bb5-aef8-3c0f2b3cc6cc" released by "_delete_snapshot" :: held 3.543s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:52:24 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-8d65d588-ea33-40ba-928d-61e8f554ef6d tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "cinder-quobyte-0e159705-5798-4c31-bea7-d45ce209014c" released by "delete_snapshot" :: held 3.582s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:52:24 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-8d65d588-ea33-40ba-928d-61e8f554ef6d tempest-VolumesSnapshotTestJSON-1438674217 None] Created reservations ['98877a05-b00b-47a3-9f87-c386ee6e9d60', 'd7dfe748-06be-4385-af39-8faf1a1b41f3', '7c0733e6-2ee9-42ad-b2b2-974642aca745', 'f27851b7-2b42-45e5-9f42-891f3f9a25c3'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:52:24 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-8d65d588-ea33-40ba-928d-61e8f554ef6d tempest-VolumesSnapshotTestJSON-1438674217 None] Delete snapshot completed successfully. Sep 25 11:52:24 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-8d65d588-ea33-40ba-928d-61e8f554ef6d tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "cinder-27b8ff0c-c4ea-4bb5-aef8-3c0f2b3cc6cc-delete_snapshot" released by "delete_snapshot" :: held 4.007s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:52:25 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cfc139f-8b7f-4794-838f-6ca7baa36077 tempest-VolumesActionsTest-821311522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:52:25 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6cfc139f-8b7f-4794-838f-6ca7baa36077 tempest-VolumesActionsTest-821311522 None] Flow 'volume_create_manager' (21b77cfc-3e70-4602-aee2-dd8924fb1b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:52:25 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6cfc139f-8b7f-4794-838f-6ca7baa36077 tempest-VolumesActionsTest-821311522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9978fe6-704a-4df8-92b9-1b9cb91e15ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:25 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6cfc139f-8b7f-4794-838f-6ca7baa36077 tempest-VolumesActionsTest-821311522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9978fe6-704a-4df8-92b9-1b9cb91e15ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:52:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-363373546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c075432e-ff8c-4e5c-a809-c5c886c01175,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af85dda72acd4db88b68cc01b7569e60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:52:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:52:25Z,use_quota=True,user_id='c370d3ebe2d24b02a5f064d1b7908383',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:25 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6cfc139f-8b7f-4794-838f-6ca7baa36077 tempest-VolumesActionsTest-821311522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e088a5c2-c0f9-4302-9a2a-9baee6432a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:25 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6cfc139f-8b7f-4794-838f-6ca7baa36077 tempest-VolumesActionsTest-821311522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e088a5c2-c0f9-4302-9a2a-9baee6432a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:25 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6cfc139f-8b7f-4794-838f-6ca7baa36077 tempest-VolumesActionsTest-821311522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15a91783-ff4a-4df4-b193-1cdcb27d3207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:25 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6cfc139f-8b7f-4794-838f-6ca7baa36077 tempest-VolumesActionsTest-821311522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15a91783-ff4a-4df4-b193-1cdcb27d3207) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c075432e-ff8c-4e5c-a809-c5c886c01175', 'volume_name': 'volume-c075432e-ff8c-4e5c-a809-c5c886c01175', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:25 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6cfc139f-8b7f-4794-838f-6ca7baa36077 tempest-VolumesActionsTest-821311522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9aee6e5-d251-4866-83d4-ba270a160cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:25 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6cfc139f-8b7f-4794-838f-6ca7baa36077 tempest-VolumesActionsTest-821311522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9aee6e5-d251-4866-83d4-ba270a160cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:25 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6cfc139f-8b7f-4794-838f-6ca7baa36077 tempest-VolumesActionsTest-821311522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62e00899-562b-4508-98f1-fa53e0319772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:25 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-6cfc139f-8b7f-4794-838f-6ca7baa36077 tempest-VolumesActionsTest-821311522 None] Volume c075432e-ff8c-4e5c-a809-c5c886c01175: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c075432e-ff8c-4e5c-a809-c5c886c01175', 'volume_size': 1} Sep 25 11:52:25 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-6cfc139f-8b7f-4794-838f-6ca7baa36077 tempest-VolumesActionsTest-821311522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:52:25 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-6665fae2-ce75-4e9d-9c54-2d1c54c61b80 tempest-VolumesSnapshotTestJSON-1438674217 None] Acquiring lock "cinder-0e159705-5798-4c31-bea7-d45ce209014c-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:52:25 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-6665fae2-ce75-4e9d-9c54-2d1c54c61b80 tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "cinder-0e159705-5798-4c31-bea7-d45ce209014c-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:52:25 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-6665fae2-ce75-4e9d-9c54-2d1c54c61b80 tempest-VolumesSnapshotTestJSON-1438674217 None] Acquiring lock "cinder-quobyte-0e159705-5798-4c31-bea7-d45ce209014c" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:52:25 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-6665fae2-ce75-4e9d-9c54-2d1c54c61b80 tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "cinder-quobyte-0e159705-5798-4c31-bea7-d45ce209014c" acquired by "delete_volume" :: waited 0.034s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:52:25 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec5befae-fea5-4f05-8897-f9815120f3d7]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:52:25 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6665fae2-ce75-4e9d-9c54-2d1c54c61b80 tempest-VolumesSnapshotTestJSON-1438674217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0e159705-5798-4c31-bea7-d45ce209014c {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:25 devstack sudo[100145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0e159705-5798-4c31-bea7-d45ce209014c Sep 25 11:52:25 devstack sudo[100145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:26 devstack sudo[100145]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:26 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6665fae2-ce75-4e9d-9c54-2d1c54c61b80 tempest-VolumesSnapshotTestJSON-1438674217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0e159705-5798-4c31-bea7-d45ce209014c" returned: 0 in 0.861s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:26 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6665fae2-ce75-4e9d-9c54-2d1c54c61b80 tempest-VolumesSnapshotTestJSON-1438674217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0e159705-5798-4c31-bea7-d45ce209014c {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:26 devstack sudo[100151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0e159705-5798-4c31-bea7-d45ce209014c Sep 25 11:52:26 devstack sudo[100151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:27 devstack sudo[100151]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:27 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6665fae2-ce75-4e9d-9c54-2d1c54c61b80 tempest-VolumesSnapshotTestJSON-1438674217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0e159705-5798-4c31-bea7-d45ce209014c" returned: 0 in 0.430s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:27 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-6665fae2-ce75-4e9d-9c54-2d1c54c61b80 tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "cinder-quobyte-0e159705-5798-4c31-bea7-d45ce209014c" released by "delete_volume" :: held 1.484s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:52:27 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-6665fae2-ce75-4e9d-9c54-2d1c54c61b80 tempest-VolumesSnapshotTestJSON-1438674217 None] Created reservations ['4ab89d1c-5444-4392-be94-cc1a63bd2064', '9a6d38f3-6156-421e-862f-aecc6285536c', '804512c2-5dd6-419b-979e-1a2445b4106c', '37a86fe7-aae1-4053-9ec1-b1ff50f67728'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:52:27 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-6665fae2-ce75-4e9d-9c54-2d1c54c61b80 tempest-VolumesSnapshotTestJSON-1438674217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:52:27 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-6665fae2-ce75-4e9d-9c54-2d1c54c61b80 tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:52:27 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-6665fae2-ce75-4e9d-9c54-2d1c54c61b80 tempest-VolumesSnapshotTestJSON-1438674217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:52:27 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-6665fae2-ce75-4e9d-9c54-2d1c54c61b80 tempest-VolumesSnapshotTestJSON-1438674217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:52:27 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-6665fae2-ce75-4e9d-9c54-2d1c54c61b80 tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:52:27 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6665fae2-ce75-4e9d-9c54-2d1c54c61b80 tempest-VolumesSnapshotTestJSON-1438674217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:27 devstack sudo[100154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:52:27 devstack sudo[100154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:27 devstack sudo[100154]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:27 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6665fae2-ce75-4e9d-9c54-2d1c54c61b80 tempest-VolumesSnapshotTestJSON-1438674217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.545s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:27 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-6665fae2-ce75-4e9d-9c54-2d1c54c61b80 tempest-VolumesSnapshotTestJSON-1438674217 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:52:27 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-6665fae2-ce75-4e9d-9c54-2d1c54c61b80 tempest-VolumesSnapshotTestJSON-1438674217 None] Deleted volume successfully. Sep 25 11:52:27 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-6665fae2-ce75-4e9d-9c54-2d1c54c61b80 tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "cinder-0e159705-5798-4c31-bea7-d45ce209014c-delete_volume" released by "delete_volume" :: held 2.503s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:52:29 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-4186a934-176f-476d-b65f-ebb3281e2306 tempest-VolumesSnapshotTestJSON-1438674217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:52:29 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4186a934-176f-476d-b65f-ebb3281e2306 tempest-VolumesSnapshotTestJSON-1438674217 None] Flow 'volume_create_manager' (1557821f-bde0-4518-932f-b151865b02b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:52:29 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4186a934-176f-476d-b65f-ebb3281e2306 tempest-VolumesSnapshotTestJSON-1438674217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9052dd42-a85d-4810-97df-4cfd5ff3a75c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:29 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4186a934-176f-476d-b65f-ebb3281e2306 tempest-VolumesSnapshotTestJSON-1438674217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9052dd42-a85d-4810-97df-4cfd5ff3a75c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:52:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1590574503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aca30262-0e35-44c1-a5a5-1947211bbb4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2437d2ea68f4f68be08425e0599a9b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:52:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:52:30Z,use_quota=True,user_id='0fe6a04643a34fc6a664bfb998b802f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:29 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4186a934-176f-476d-b65f-ebb3281e2306 tempest-VolumesSnapshotTestJSON-1438674217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ad0ff10-75b3-4991-b29b-29d180319a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:29 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4186a934-176f-476d-b65f-ebb3281e2306 tempest-VolumesSnapshotTestJSON-1438674217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ad0ff10-75b3-4991-b29b-29d180319a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:29 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4186a934-176f-476d-b65f-ebb3281e2306 tempest-VolumesSnapshotTestJSON-1438674217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (039b96d7-4199-457e-95fd-a64505a98425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:29 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4186a934-176f-476d-b65f-ebb3281e2306 tempest-VolumesSnapshotTestJSON-1438674217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (039b96d7-4199-457e-95fd-a64505a98425) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aca30262-0e35-44c1-a5a5-1947211bbb4f', 'volume_name': 'volume-aca30262-0e35-44c1-a5a5-1947211bbb4f', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:29 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4186a934-176f-476d-b65f-ebb3281e2306 tempest-VolumesSnapshotTestJSON-1438674217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1efe1b70-a739-4283-830c-6671678f4041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:29 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4186a934-176f-476d-b65f-ebb3281e2306 tempest-VolumesSnapshotTestJSON-1438674217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1efe1b70-a739-4283-830c-6671678f4041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:29 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4186a934-176f-476d-b65f-ebb3281e2306 tempest-VolumesSnapshotTestJSON-1438674217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4a1d799-e3a4-453d-91a5-8e245c22e088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:29 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-4186a934-176f-476d-b65f-ebb3281e2306 tempest-VolumesSnapshotTestJSON-1438674217 None] Volume aca30262-0e35-44c1-a5a5-1947211bbb4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aca30262-0e35-44c1-a5a5-1947211bbb4f', 'volume_size': 1} Sep 25 11:52:29 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-4186a934-176f-476d-b65f-ebb3281e2306 tempest-VolumesSnapshotTestJSON-1438674217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:52:31 devstack sudo[100106]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:31 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cc72d134-8f53-4e75-ada7-1d784b5a87fd tempest-TestImageHashVerification-1580856923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c3c02980-5404-41e4-be14-d1d845d694e3 /opt/stack/data/cinder/conversion/c3c02980-5404-41e4-be14-d1d845d694e3.temp_image.ae774493-5e29-4267-8a21-745a4a458569o64xs1ao.img" returned: 0 in 9.579s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:31 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[5345a53f-4fcb-4d41-8033-ffbc3c960f09]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:52:31 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cc72d134-8f53-4e75-ada7-1d784b5a87fd tempest-TestImageHashVerification-1580856923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c3c02980-5404-41e4-be14-d1d845d694e3 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:31 devstack sudo[100160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c3c02980-5404-41e4-be14-d1d845d694e3 Sep 25 11:52:31 devstack sudo[100160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:31 devstack sudo[100160]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:31 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cc72d134-8f53-4e75-ada7-1d784b5a87fd tempest-TestImageHashVerification-1580856923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c3c02980-5404-41e4-be14-d1d845d694e3" returned: 0 in 0.631s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:31 devstack cinder-volume[86984]: DEBUG cinder.image.image_utils [None req-cc72d134-8f53-4e75-ada7-1d784b5a87fd tempest-TestImageHashVerification-1580856923 None] Image conversion details: src /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c3c02980-5404-41e4-be14-d1d845d694e3, size 1024.00 MB, duration 9.58 sec, destination /opt/stack/data/cinder/conversion/c3c02980-5404-41e4-be14-d1d845d694e3.temp_image.ae774493-5e29-4267-8a21-745a4a458569o64xs1ao.img {{(pid=86984) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 11:52:31 devstack cinder-volume[86984]: INFO cinder.image.image_utils [None req-cc72d134-8f53-4e75-ada7-1d784b5a87fd tempest-TestImageHashVerification-1580856923 None] Converted 1024.00 MB image at 106.88 MB/s Sep 25 11:52:31 devstack cinder-volume[86984]: DEBUG cinder.image.image_utils [None req-cc72d134-8f53-4e75-ada7-1d784b5a87fd tempest-TestImageHashVerification-1580856923 None] ae774493-5e29-4267-8a21-745a4a458569 was raw, no need to convert to raw {{(pid=86984) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 25 11:52:37 devstack cinder-volume[86984]: DEBUG dbcounter [-] [86984] Writing DB stats cinder:SELECT=93,cinder:UPDATE=91,cinder:INSERT=21,cinder:DELETE=7 {{(pid=86984) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:52:37 devstack cinder-volume[86984]: DEBUG dbcounter [-] [86984] Writing DB stats cinder:SELECT=89,cinder:UPDATE=96,cinder:INSERT=23,cinder:DELETE=9 {{(pid=86984) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:52:37 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2b45413-f8ef-4803-9495-6d010c5775d4 tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:52:37 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-a2b45413-f8ef-4803-9495-6d010c5775d4 tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] Flow 'volume_create_manager' (4048b3ab-3743-421f-ac7a-dc30451e1541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:52:37 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-a2b45413-f8ef-4803-9495-6d010c5775d4 tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (587b3a00-cbb7-4c91-877b-858874a7febd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:37 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-a2b45413-f8ef-4803-9495-6d010c5775d4 tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (587b3a00-cbb7-4c91-877b-858874a7febd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:52:37Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18ccb6f1-64a7-4567-bae4-8ff0366e3828,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adeab418fa924523b20edc9539bf3fc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:52:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:52:37Z,use_quota=True,user_id='716db98b76f04d8d9d8089b8d681438a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04739b3b-8cdf-449c-9081-fc8f6ab2942f),volume_type_id=04739b3b-8cdf-449c-9081-fc8f6ab2942f)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:37 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-a2b45413-f8ef-4803-9495-6d010c5775d4 tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0094704-f8d7-4588-a296-cead38bc9a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:37 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-a2b45413-f8ef-4803-9495-6d010c5775d4 tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0094704-f8d7-4588-a296-cead38bc9a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:37 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-a2b45413-f8ef-4803-9495-6d010c5775d4 tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (391b63fd-95d8-4c47-9563-daf87fa8c682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:37 devstack cinder-volume[86984]: DEBUG cinder.image.glance [None req-a2b45413-f8ef-4803-9495-6d010c5775d4 tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] Creating Keystone auth plugin from conf {{(pid=86984) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 11:52:37 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-a2b45413-f8ef-4803-9495-6d010c5775d4 tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (391b63fd-95d8-4c47-9563-daf87fa8c682) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '18ccb6f1-64a7-4567-bae4-8ff0366e3828', 'volume_name': 'volume-18ccb6f1-64a7-4567-bae4-8ff0366e3828', 'volume_size': 1, 'image_id': 'fbb496eb-26b3-471a-9de0-723d61aae46a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fbb496eb-26b3-471a-9de0-723d61aae46a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1a402988c7ac11b6e385fab4b4a18178', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'adeab418fa924523b20edc9539bf3fc6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '499f39abeb5adeb1df22c73eb26f64a9f8bdc40df39064f2ad0822975bb0a1414bd19e8a103ca61499bcbbafdbe205bff320869d4c2ddd60fac854b6de3c074d', 'id': 'fbb496eb-26b3-471a-9de0-723d61aae46a', 'created_at': datetime.datetime(2026, 9, 25, 9, 52, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 52, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fbb496eb-26b3-471a-9de0-723d61aae46a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:37 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-a2b45413-f8ef-4803-9495-6d010c5775d4 tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aff00d78-454f-45c7-84a6-9c3530ca0730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:37 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-a2b45413-f8ef-4803-9495-6d010c5775d4 tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aff00d78-454f-45c7-84a6-9c3530ca0730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:37 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-a2b45413-f8ef-4803-9495-6d010c5775d4 tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0925a9f4-ac0d-4d0b-bbdc-186350be2c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:37 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-a2b45413-f8ef-4803-9495-6d010c5775d4 tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] Volume 18ccb6f1-64a7-4567-bae4-8ff0366e3828: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-18ccb6f1-64a7-4567-bae4-8ff0366e3828', 'volume_size': 1, 'image_id': 'fbb496eb-26b3-471a-9de0-723d61aae46a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fbb496eb-26b3-471a-9de0-723d61aae46a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1a402988c7ac11b6e385fab4b4a18178', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'adeab418fa924523b20edc9539bf3fc6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '499f39abeb5adeb1df22c73eb26f64a9f8bdc40df39064f2ad0822975bb0a1414bd19e8a103ca61499bcbbafdbe205bff320869d4c2ddd60fac854b6de3c074d', 'id': 'fbb496eb-26b3-471a-9de0-723d61aae46a', 'created_at': datetime.datetime(2026, 9, 25, 9, 52, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 52, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fbb496eb-26b3-471a-9de0-723d61aae46a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 25 11:52:37 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2b45413-f8ef-4803-9495-6d010c5775d4 tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] Trying to clone 18ccb6f1-64a7-4567-bae4-8ff0366e3828 from image fbb496eb-26b3-471a-9de0-723d61aae46a at location (None, [{'url': 'file:///opt/stack/data/glance/images/fbb496eb-26b3-471a-9de0-723d61aae46a', 'metadata': {}}]). {{(pid=86984) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 11:52:37 devstack cinder-volume[86984]: DEBUG cinder.image.image_utils [None req-a2b45413-f8ef-4803-9495-6d010c5775d4 tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fbb496eb-26b3-471a-9de0-723d61aae46a_b65vpz2ydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86984) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 11:52:37 devstack cinder-volume[86984]: INFO cinder.image.image_utils [None req-a2b45413-f8ef-4803-9495-6d010c5775d4 tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] Image download 0.00 MB at 0.00 MB/s Sep 25 11:52:37 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ccc0a06-a6dc-49e5-8262-f10f7fab9287]: (4, 'raw') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:52:37 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a2b45413-f8ef-4803-9495-6d010c5775d4 tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fbb496eb-26b3-471a-9de0-723d61aae46a_b65vpz2ydevstack@QuobyteHD {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:38 devstack sudo[100167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fbb496eb-26b3-471a-9de0-723d61aae46a_b65vpz2ydevstack@QuobyteHD Sep 25 11:52:38 devstack sudo[100167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:38 devstack sudo[100167]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a2b45413-f8ef-4803-9495-6d010c5775d4 tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fbb496eb-26b3-471a-9de0-723d61aae46a_b65vpz2ydevstack@QuobyteHD" returned: 0 in 0.362s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a2b45413-f8ef-4803-9495-6d010c5775d4 tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fbb496eb-26b3-471a-9de0-723d61aae46a_b65vpz2ydevstack@QuobyteHD {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:38 devstack sudo[100171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fbb496eb-26b3-471a-9de0-723d61aae46a_b65vpz2ydevstack@QuobyteHD Sep 25 11:52:38 devstack sudo[100171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:38 devstack cinder-volume[86984]: DEBUG oslo_service.periodic_task [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:52:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:52:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:52:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:52:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:52:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:52:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:38 devstack sudo[100173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:52:38 devstack sudo[100173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:38 devstack sudo[100171]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a2b45413-f8ef-4803-9495-6d010c5775d4 tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fbb496eb-26b3-471a-9de0-723d61aae46a_b65vpz2ydevstack@QuobyteHD" returned: 1 in 0.392s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a2b45413-f8ef-4803-9495-6d010c5775d4 tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fbb496eb-26b3-471a-9de0-723d61aae46a_b65vpz2ydevstack@QuobyteHD' failed. Not Retrying. {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 11:52:38 devstack cinder-volume[86984]: DEBUG cinder.image.image_utils [None req-a2b45413-f8ef-4803-9495-6d010c5775d4 tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] Temporary image fbb496eb-26b3-471a-9de0-723d61aae46a is fetched for user 716db98b76f04d8d9d8089b8d681438a. {{(pid=86984) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 11:52:38 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fddb678-8b29-45f9-b212-9d260673552c]: (4, 'raw') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:52:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a2b45413-f8ef-4803-9495-6d010c5775d4 tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fbb496eb-26b3-471a-9de0-723d61aae46a_b65vpz2ydevstack@QuobyteHD {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:38 devstack sudo[100173]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.316s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:38 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:52:38 devstack cinder-volume[86984]: DEBUG oslo_service.periodic_task [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running periodic task VolumeManager._thread_info {{(pid=86984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:52:38 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] thread count: 28 {{(pid=86984) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 11:52:38 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] thread info: [<_MainThread(MainThread, started 132046492332160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86984) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 11:52:39 devstack sudo[100182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fbb496eb-26b3-471a-9de0-723d61aae46a_b65vpz2ydevstack@QuobyteHD Sep 25 11:52:39 devstack sudo[100182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:39 devstack sudo[100182]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a2b45413-f8ef-4803-9495-6d010c5775d4 tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fbb496eb-26b3-471a-9de0-723d61aae46a_b65vpz2ydevstack@QuobyteHD" returned: 0 in 0.379s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a2b45413-f8ef-4803-9495-6d010c5775d4 tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fbb496eb-26b3-471a-9de0-723d61aae46a_b65vpz2ydevstack@QuobyteHD {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:39 devstack sudo[100189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fbb496eb-26b3-471a-9de0-723d61aae46a_b65vpz2ydevstack@QuobyteHD Sep 25 11:52:39 devstack sudo[100189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:39 devstack sudo[100189]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a2b45413-f8ef-4803-9495-6d010c5775d4 tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fbb496eb-26b3-471a-9de0-723d61aae46a_b65vpz2ydevstack@QuobyteHD" returned: 1 in 0.371s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a2b45413-f8ef-4803-9495-6d010c5775d4 tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fbb496eb-26b3-471a-9de0-723d61aae46a_b65vpz2ydevstack@QuobyteHD' failed. Not Retrying. {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 11:52:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-a2b45413-f8ef-4803-9495-6d010c5775d4 tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:52:48 devstack cinder-volume[86984]: DEBUG dbcounter [-] [86984] Writing DB stats cinder:SELECT=1 {{(pid=86984) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:52:48 devstack cinder-volume[86984]: DEBUG dbcounter [-] [86984] Writing DB stats cinder:SELECT=2,cinder:INSERT=1 {{(pid=86984) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:52:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-cc72d134-8f53-4e75-ada7-1d784b5a87fd tempest-TestImageHashVerification-1580856923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 32.373s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:52:52 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cc72d134-8f53-4e75-ada7-1d784b5a87fd tempest-TestImageHashVerification-1580856923 None] Uploaded volume to glance image-id: ae774493-5e29-4267-8a21-745a4a458569. {{(pid=86984) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 25 11:52:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-6cfc139f-8b7f-4794-838f-6ca7baa36077 tempest-VolumesActionsTest-821311522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 27.306s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:52:52 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-6cfc139f-8b7f-4794-838f-6ca7baa36077 tempest-VolumesActionsTest-821311522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:52:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-363373546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c075432e-ff8c-4e5c-a809-c5c886c01175,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af85dda72acd4db88b68cc01b7569e60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:52:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:52:25Z,use_quota=True,user_id='c370d3ebe2d24b02a5f064d1b7908383',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:52:52 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-6cfc139f-8b7f-4794-838f-6ca7baa36077 tempest-VolumesActionsTest-821311522 None] Creating volume c075432e-ff8c-4e5c-a809-c5c886c01175 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:52:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-6cfc139f-8b7f-4794-838f-6ca7baa36077 tempest-VolumesActionsTest-821311522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:52:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-6cfc139f-8b7f-4794-838f-6ca7baa36077 tempest-VolumesActionsTest-821311522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:52:52 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-6cfc139f-8b7f-4794-838f-6ca7baa36077 tempest-VolumesActionsTest-821311522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:52:52 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-6cfc139f-8b7f-4794-838f-6ca7baa36077 tempest-VolumesActionsTest-821311522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:52:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-6cfc139f-8b7f-4794-838f-6ca7baa36077 tempest-VolumesActionsTest-821311522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:52:52 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-6cfc139f-8b7f-4794-838f-6ca7baa36077 tempest-VolumesActionsTest-821311522 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:52:52 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-6cfc139f-8b7f-4794-838f-6ca7baa36077 tempest-VolumesActionsTest-821311522 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:52:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6cfc139f-8b7f-4794-838f-6ca7baa36077 tempest-VolumesActionsTest-821311522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c075432e-ff8c-4e5c-a809-c5c886c01175 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:52 devstack sudo[100231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c075432e-ff8c-4e5c-a809-c5c886c01175 1073741824 Sep 25 11:52:52 devstack sudo[100231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:52 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-cc72d134-8f53-4e75-ada7-1d784b5a87fd tempest-TestImageHashVerification-1580856923 None] Copy volume to image completed successfully. Sep 25 11:52:53 devstack sudo[100231]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6cfc139f-8b7f-4794-838f-6ca7baa36077 tempest-VolumesActionsTest-821311522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c075432e-ff8c-4e5c-a809-c5c886c01175 1073741824" returned: 0 in 0.571s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6cfc139f-8b7f-4794-838f-6ca7baa36077 tempest-VolumesActionsTest-821311522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c075432e-ff8c-4e5c-a809-c5c886c01175 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:53 devstack sudo[100237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c075432e-ff8c-4e5c-a809-c5c886c01175 Sep 25 11:52:53 devstack sudo[100237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:53 devstack sudo[100237]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6cfc139f-8b7f-4794-838f-6ca7baa36077 tempest-VolumesActionsTest-821311522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c075432e-ff8c-4e5c-a809-c5c886c01175" returned: 0 in 0.381s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:53 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-6cfc139f-8b7f-4794-838f-6ca7baa36077 tempest-VolumesActionsTest-821311522 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:52:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-6cfc139f-8b7f-4794-838f-6ca7baa36077 tempest-VolumesActionsTest-821311522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:52:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-4186a934-176f-476d-b65f-ebb3281e2306 tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 23.668s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:52:53 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-4186a934-176f-476d-b65f-ebb3281e2306 tempest-VolumesSnapshotTestJSON-1438674217 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:52:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1590574503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aca30262-0e35-44c1-a5a5-1947211bbb4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2437d2ea68f4f68be08425e0599a9b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:52:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:52:30Z,use_quota=True,user_id='0fe6a04643a34fc6a664bfb998b802f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:52:53 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-4186a934-176f-476d-b65f-ebb3281e2306 tempest-VolumesSnapshotTestJSON-1438674217 None] Creating volume aca30262-0e35-44c1-a5a5-1947211bbb4f {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:52:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-4186a934-176f-476d-b65f-ebb3281e2306 tempest-VolumesSnapshotTestJSON-1438674217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:52:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-4186a934-176f-476d-b65f-ebb3281e2306 tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:52:53 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-4186a934-176f-476d-b65f-ebb3281e2306 tempest-VolumesSnapshotTestJSON-1438674217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:52:53 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-4186a934-176f-476d-b65f-ebb3281e2306 tempest-VolumesSnapshotTestJSON-1438674217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:52:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-4186a934-176f-476d-b65f-ebb3281e2306 tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:52:53 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-4186a934-176f-476d-b65f-ebb3281e2306 tempest-VolumesSnapshotTestJSON-1438674217 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:52:53 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-4186a934-176f-476d-b65f-ebb3281e2306 tempest-VolumesSnapshotTestJSON-1438674217 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:52:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-4186a934-176f-476d-b65f-ebb3281e2306 tempest-VolumesSnapshotTestJSON-1438674217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aca30262-0e35-44c1-a5a5-1947211bbb4f 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:53 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6cfc139f-8b7f-4794-838f-6ca7baa36077 tempest-VolumesActionsTest-821311522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62e00899-562b-4508-98f1-fa53e0319772) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c075432e-ff8c-4e5c-a809-c5c886c01175', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:53 devstack sudo[100241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aca30262-0e35-44c1-a5a5-1947211bbb4f 1073741824 Sep 25 11:52:53 devstack sudo[100241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:53 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6cfc139f-8b7f-4794-838f-6ca7baa36077 tempest-VolumesActionsTest-821311522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46653281-740a-4694-bf8d-b1b496af33c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:53 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-6cfc139f-8b7f-4794-838f-6ca7baa36077 tempest-VolumesActionsTest-821311522 None] Volume volume-c075432e-ff8c-4e5c-a809-c5c886c01175 (c075432e-ff8c-4e5c-a809-c5c886c01175): created successfully Sep 25 11:52:53 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6cfc139f-8b7f-4794-838f-6ca7baa36077 tempest-VolumesActionsTest-821311522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46653281-740a-4694-bf8d-b1b496af33c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:53 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6cfc139f-8b7f-4794-838f-6ca7baa36077 tempest-VolumesActionsTest-821311522 None] Flow 'volume_create_manager' (21b77cfc-3e70-4602-aee2-dd8924fb1b9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:52:53 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-6cfc139f-8b7f-4794-838f-6ca7baa36077 tempest-VolumesActionsTest-821311522 None] Created volume successfully. Sep 25 11:52:53 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-54233fbb-cf33-449b-b0b3-76f5dac1bd72 tempest-TestImageHashVerification-1580856923 None] Acquiring lock "cinder-c3c02980-5404-41e4-be14-d1d845d694e3-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:52:53 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-54233fbb-cf33-449b-b0b3-76f5dac1bd72 tempest-TestImageHashVerification-1580856923 None] Lock "cinder-c3c02980-5404-41e4-be14-d1d845d694e3-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:52:54 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-54233fbb-cf33-449b-b0b3-76f5dac1bd72 tempest-TestImageHashVerification-1580856923 None] Acquiring lock "cinder-quobyte-c3c02980-5404-41e4-be14-d1d845d694e3" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:52:54 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-54233fbb-cf33-449b-b0b3-76f5dac1bd72 tempest-TestImageHashVerification-1580856923 None] Lock "cinder-quobyte-c3c02980-5404-41e4-be14-d1d845d694e3" acquired by "delete_volume" :: waited 0.020s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:52:54 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b321cf-6949-4b3e-ba8f-94b99212a93a]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:52:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-54233fbb-cf33-449b-b0b3-76f5dac1bd72 tempest-TestImageHashVerification-1580856923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c3c02980-5404-41e4-be14-d1d845d694e3 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:54 devstack sudo[100246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c3c02980-5404-41e4-be14-d1d845d694e3 Sep 25 11:52:54 devstack sudo[100246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:54 devstack sudo[100241]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-4186a934-176f-476d-b65f-ebb3281e2306 tempest-VolumesSnapshotTestJSON-1438674217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aca30262-0e35-44c1-a5a5-1947211bbb4f 1073741824" returned: 0 in 0.686s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-4186a934-176f-476d-b65f-ebb3281e2306 tempest-VolumesSnapshotTestJSON-1438674217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aca30262-0e35-44c1-a5a5-1947211bbb4f {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:54 devstack sudo[100249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aca30262-0e35-44c1-a5a5-1947211bbb4f Sep 25 11:52:54 devstack sudo[100249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:54 devstack sudo[100246]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-54233fbb-cf33-449b-b0b3-76f5dac1bd72 tempest-TestImageHashVerification-1580856923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c3c02980-5404-41e4-be14-d1d845d694e3" returned: 0 in 0.511s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-54233fbb-cf33-449b-b0b3-76f5dac1bd72 tempest-TestImageHashVerification-1580856923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c3c02980-5404-41e4-be14-d1d845d694e3 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:54 devstack sudo[100254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c3c02980-5404-41e4-be14-d1d845d694e3 Sep 25 11:52:54 devstack sudo[100254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:54 devstack sudo[100249]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-4186a934-176f-476d-b65f-ebb3281e2306 tempest-VolumesSnapshotTestJSON-1438674217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aca30262-0e35-44c1-a5a5-1947211bbb4f" returned: 0 in 0.312s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:54 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-4186a934-176f-476d-b65f-ebb3281e2306 tempest-VolumesSnapshotTestJSON-1438674217 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:52:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-4186a934-176f-476d-b65f-ebb3281e2306 tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:52:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-a2b45413-f8ef-4803-9495-6d010c5775d4 tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.057s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:52:54 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-a2b45413-f8ef-4803-9495-6d010c5775d4 tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:52:37Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18ccb6f1-64a7-4567-bae4-8ff0366e3828,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adeab418fa924523b20edc9539bf3fc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:52:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:52:37Z,use_quota=True,user_id='716db98b76f04d8d9d8089b8d681438a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04739b3b-8cdf-449c-9081-fc8f6ab2942f),volume_type_id=04739b3b-8cdf-449c-9081-fc8f6ab2942f)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:52:54 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-a2b45413-f8ef-4803-9495-6d010c5775d4 tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] Creating volume 18ccb6f1-64a7-4567-bae4-8ff0366e3828 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:52:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-a2b45413-f8ef-4803-9495-6d010c5775d4 tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:52:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-a2b45413-f8ef-4803-9495-6d010c5775d4 tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:52:54 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-a2b45413-f8ef-4803-9495-6d010c5775d4 tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:52:54 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-a2b45413-f8ef-4803-9495-6d010c5775d4 tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:52:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-a2b45413-f8ef-4803-9495-6d010c5775d4 tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:52:54 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-a2b45413-f8ef-4803-9495-6d010c5775d4 tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:52:54 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-a2b45413-f8ef-4803-9495-6d010c5775d4 tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:52:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a2b45413-f8ef-4803-9495-6d010c5775d4 tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-18ccb6f1-64a7-4567-bae4-8ff0366e3828 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:54 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4186a934-176f-476d-b65f-ebb3281e2306 tempest-VolumesSnapshotTestJSON-1438674217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4a1d799-e3a4-453d-91a5-8e245c22e088) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aca30262-0e35-44c1-a5a5-1947211bbb4f', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:54 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4186a934-176f-476d-b65f-ebb3281e2306 tempest-VolumesSnapshotTestJSON-1438674217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e12a4c5-bc09-4b01-b093-dd2ee616f2e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:54 devstack sudo[100257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-18ccb6f1-64a7-4567-bae4-8ff0366e3828 1073741824 Sep 25 11:52:54 devstack sudo[100257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:54 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-4186a934-176f-476d-b65f-ebb3281e2306 tempest-VolumesSnapshotTestJSON-1438674217 None] Volume volume-aca30262-0e35-44c1-a5a5-1947211bbb4f (aca30262-0e35-44c1-a5a5-1947211bbb4f): created successfully Sep 25 11:52:54 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4186a934-176f-476d-b65f-ebb3281e2306 tempest-VolumesSnapshotTestJSON-1438674217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e12a4c5-bc09-4b01-b093-dd2ee616f2e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:54 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4186a934-176f-476d-b65f-ebb3281e2306 tempest-VolumesSnapshotTestJSON-1438674217 None] Flow 'volume_create_manager' (1557821f-bde0-4518-932f-b151865b02b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:52:54 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-4186a934-176f-476d-b65f-ebb3281e2306 tempest-VolumesSnapshotTestJSON-1438674217 None] Created volume successfully. Sep 25 11:52:54 devstack sudo[100254]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-54233fbb-cf33-449b-b0b3-76f5dac1bd72 tempest-TestImageHashVerification-1580856923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c3c02980-5404-41e4-be14-d1d845d694e3" returned: 0 in 0.426s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:55 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-54233fbb-cf33-449b-b0b3-76f5dac1bd72 tempest-TestImageHashVerification-1580856923 None] Lock "cinder-quobyte-c3c02980-5404-41e4-be14-d1d845d694e3" released by "delete_volume" :: held 1.006s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:52:55 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-43c76c60-39b4-4d3b-8228-5d3dceee302c tempest-VolumesActionsTest-1180183357 None] Acquiring lock "cinder-c075432e-ff8c-4e5c-a809-c5c886c01175-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:52:55 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-43c76c60-39b4-4d3b-8228-5d3dceee302c tempest-VolumesActionsTest-1180183357 None] Lock "cinder-c075432e-ff8c-4e5c-a809-c5c886c01175-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:52:55 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-54233fbb-cf33-449b-b0b3-76f5dac1bd72 tempest-TestImageHashVerification-1580856923 None] Created reservations ['3a2d7847-4693-4591-98af-61dc5882aee4', '66f76778-0f34-4cb8-9609-95d72a187b4c', '10346fa4-b02d-400f-b534-dddc0ee2faab', '810e2419-f829-43b0-a39a-f52c6d3b1f06'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:52:55 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-43c76c60-39b4-4d3b-8228-5d3dceee302c tempest-VolumesActionsTest-1180183357 None] Acquiring lock "cinder-quobyte-c075432e-ff8c-4e5c-a809-c5c886c01175" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:52:55 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-43c76c60-39b4-4d3b-8228-5d3dceee302c tempest-VolumesActionsTest-1180183357 None] Lock "cinder-quobyte-c075432e-ff8c-4e5c-a809-c5c886c01175" acquired by "delete_volume" :: waited 0.034s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:52:55 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd643c43-e698-4e0c-8de7-cfc956a54b95]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:52:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-43c76c60-39b4-4d3b-8228-5d3dceee302c tempest-VolumesActionsTest-1180183357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c075432e-ff8c-4e5c-a809-c5c886c01175 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-54233fbb-cf33-449b-b0b3-76f5dac1bd72 tempest-TestImageHashVerification-1580856923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:52:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-54233fbb-cf33-449b-b0b3-76f5dac1bd72 tempest-TestImageHashVerification-1580856923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:52:55 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-54233fbb-cf33-449b-b0b3-76f5dac1bd72 tempest-TestImageHashVerification-1580856923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:52:55 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-54233fbb-cf33-449b-b0b3-76f5dac1bd72 tempest-TestImageHashVerification-1580856923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:52:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-54233fbb-cf33-449b-b0b3-76f5dac1bd72 tempest-TestImageHashVerification-1580856923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:52:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-54233fbb-cf33-449b-b0b3-76f5dac1bd72 tempest-TestImageHashVerification-1580856923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:55 devstack sudo[100265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:52:55 devstack sudo[100265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:55 devstack sudo[100263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c075432e-ff8c-4e5c-a809-c5c886c01175 Sep 25 11:52:55 devstack sudo[100263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:55 devstack sudo[100257]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a2b45413-f8ef-4803-9495-6d010c5775d4 tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-18ccb6f1-64a7-4567-bae4-8ff0366e3828 1073741824" returned: 0 in 0.820s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a2b45413-f8ef-4803-9495-6d010c5775d4 tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-18ccb6f1-64a7-4567-bae4-8ff0366e3828 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:55 devstack sudo[100268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-18ccb6f1-64a7-4567-bae4-8ff0366e3828 Sep 25 11:52:55 devstack sudo[100268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-eb914eab-f3da-4fc8-bfc3-72439c973c2c tempest-VolumesSnapshotTestJSON-1438674217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:52:55 devstack sudo[100265]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-54233fbb-cf33-449b-b0b3-76f5dac1bd72 tempest-TestImageHashVerification-1580856923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.459s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:55 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-54233fbb-cf33-449b-b0b3-76f5dac1bd72 tempest-TestImageHashVerification-1580856923 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:52:55 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-54233fbb-cf33-449b-b0b3-76f5dac1bd72 tempest-TestImageHashVerification-1580856923 None] Deleted volume successfully. Sep 25 11:52:55 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-54233fbb-cf33-449b-b0b3-76f5dac1bd72 tempest-TestImageHashVerification-1580856923 None] Lock "cinder-c3c02980-5404-41e4-be14-d1d845d694e3-delete_volume" released by "delete_volume" :: held 1.932s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:52:55 devstack sudo[100263]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-43c76c60-39b4-4d3b-8228-5d3dceee302c tempest-VolumesActionsTest-1180183357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c075432e-ff8c-4e5c-a809-c5c886c01175" returned: 0 in 0.652s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-43c76c60-39b4-4d3b-8228-5d3dceee302c tempest-VolumesActionsTest-1180183357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c075432e-ff8c-4e5c-a809-c5c886c01175 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:55 devstack sudo[100274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c075432e-ff8c-4e5c-a809-c5c886c01175 Sep 25 11:52:55 devstack sudo[100274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:56 devstack sudo[100268]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:56 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a2b45413-f8ef-4803-9495-6d010c5775d4 tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-18ccb6f1-64a7-4567-bae4-8ff0366e3828" returned: 0 in 0.439s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:56 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-a2b45413-f8ef-4803-9495-6d010c5775d4 tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] <== create_volume: return (1337ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:52:56 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-a2b45413-f8ef-4803-9495-6d010c5775d4 tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.341s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:52:56 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-eb914eab-f3da-4fc8-bfc3-72439c973c2c tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.362s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:52:56 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-eb914eab-f3da-4fc8-bfc3-72439c973c2c tempest-VolumesSnapshotTestJSON-1438674217 None] Creating offline snapshot e10029c2-5741-4917-ad97-742608c64009 of volume aca30262-0e35-44c1-a5a5-1947211bbb4f {{(pid=86984) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:52:56 devstack cinder-volume[86984]: DEBUG cinder.volume.volume_utils [None req-a2b45413-f8ef-4803-9495-6d010c5775d4 tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] Attempting download of fbb496eb-26b3-471a-9de0-723d61aae46a ((None, [{'url': 'file:///opt/stack/data/glance/images/fbb496eb-26b3-471a-9de0-723d61aae46a', 'metadata': {}}])) to volume 18ccb6f1-64a7-4567-bae4-8ff0366e3828. {{(pid=86984) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 11:52:56 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[960e195d-ea85-49b2-8a3e-c4f0ab6d5e50]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:52:56 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-eb914eab-f3da-4fc8-bfc3-72439c973c2c tempest-VolumesSnapshotTestJSON-1438674217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aca30262-0e35-44c1-a5a5-1947211bbb4f {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:56 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2467f91-bbf4-4150-9eb8-711e9cd6449e]: (4, 'raw') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:52:56 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a2b45413-f8ef-4803-9495-6d010c5775d4 tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fbb496eb-26b3-471a-9de0-723d61aae46a_qt1g_pec {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:56 devstack sudo[100277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aca30262-0e35-44c1-a5a5-1947211bbb4f Sep 25 11:52:56 devstack sudo[100277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:56 devstack sudo[100274]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:56 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-43c76c60-39b4-4d3b-8228-5d3dceee302c tempest-VolumesActionsTest-1180183357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c075432e-ff8c-4e5c-a809-c5c886c01175" returned: 0 in 0.528s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:56 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-43c76c60-39b4-4d3b-8228-5d3dceee302c tempest-VolumesActionsTest-1180183357 None] Lock "cinder-quobyte-c075432e-ff8c-4e5c-a809-c5c886c01175" released by "delete_volume" :: held 1.269s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:52:56 devstack sudo[100278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fbb496eb-26b3-471a-9de0-723d61aae46a_qt1g_pec Sep 25 11:52:56 devstack sudo[100278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:56 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-43c76c60-39b4-4d3b-8228-5d3dceee302c tempest-VolumesActionsTest-1180183357 None] Created reservations ['0b5ddd65-dd32-4160-9676-5cba297e6574', '106f693c-672b-4658-bde6-7666f83f7b40', 'd976ade1-32e1-4a0d-9a4e-d32fa6197831', '0644bce2-3ed3-43c9-9c13-e4e63b500d1a'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:52:56 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-43c76c60-39b4-4d3b-8228-5d3dceee302c tempest-VolumesActionsTest-1180183357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:52:56 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-43c76c60-39b4-4d3b-8228-5d3dceee302c tempest-VolumesActionsTest-1180183357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:52:56 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-43c76c60-39b4-4d3b-8228-5d3dceee302c tempest-VolumesActionsTest-1180183357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:52:56 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-43c76c60-39b4-4d3b-8228-5d3dceee302c tempest-VolumesActionsTest-1180183357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:52:56 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-43c76c60-39b4-4d3b-8228-5d3dceee302c tempest-VolumesActionsTest-1180183357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:52:56 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-43c76c60-39b4-4d3b-8228-5d3dceee302c tempest-VolumesActionsTest-1180183357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:56 devstack sudo[100285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:52:56 devstack sudo[100285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:56 devstack sudo[100277]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:56 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-eb914eab-f3da-4fc8-bfc3-72439c973c2c tempest-VolumesSnapshotTestJSON-1438674217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aca30262-0e35-44c1-a5a5-1947211bbb4f" returned: 0 in 0.753s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:56 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-eb914eab-f3da-4fc8-bfc3-72439c973c2c tempest-VolumesSnapshotTestJSON-1438674217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aca30262-0e35-44c1-a5a5-1947211bbb4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aca30262-0e35-44c1-a5a5-1947211bbb4f.e10029c2-5741-4917-ad97-742608c64009 1G {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:56 devstack sudo[100287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aca30262-0e35-44c1-a5a5-1947211bbb4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aca30262-0e35-44c1-a5a5-1947211bbb4f.e10029c2-5741-4917-ad97-742608c64009 1G Sep 25 11:52:56 devstack sudo[100287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:57 devstack sudo[100278]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:57 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a2b45413-f8ef-4803-9495-6d010c5775d4 tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fbb496eb-26b3-471a-9de0-723d61aae46a_qt1g_pec" returned: 0 in 0.709s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:57 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a2b45413-f8ef-4803-9495-6d010c5775d4 tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fbb496eb-26b3-471a-9de0-723d61aae46a_qt1g_pec {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:57 devstack sudo[100291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fbb496eb-26b3-471a-9de0-723d61aae46a_qt1g_pec Sep 25 11:52:57 devstack sudo[100291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:57 devstack sudo[100285]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:57 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-43c76c60-39b4-4d3b-8228-5d3dceee302c tempest-VolumesActionsTest-1180183357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.417s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:57 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-43c76c60-39b4-4d3b-8228-5d3dceee302c tempest-VolumesActionsTest-1180183357 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:52:57 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-43c76c60-39b4-4d3b-8228-5d3dceee302c tempest-VolumesActionsTest-1180183357 None] Deleted volume successfully. Sep 25 11:52:57 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-43c76c60-39b4-4d3b-8228-5d3dceee302c tempest-VolumesActionsTest-1180183357 None] Lock "cinder-c075432e-ff8c-4e5c-a809-c5c886c01175-delete_volume" released by "delete_volume" :: held 2.225s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:52:57 devstack sudo[100291]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:57 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a2b45413-f8ef-4803-9495-6d010c5775d4 tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fbb496eb-26b3-471a-9de0-723d61aae46a_qt1g_pec" returned: 1 in 0.623s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:57 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a2b45413-f8ef-4803-9495-6d010c5775d4 tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fbb496eb-26b3-471a-9de0-723d61aae46a_qt1g_pec' failed. Not Retrying. {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 11:52:57 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d878cf-b6d8-4535-be98-c26390f606e7]: (4, 'raw') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:52:57 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a2b45413-f8ef-4803-9495-6d010c5775d4 tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fbb496eb-26b3-471a-9de0-723d61aae46a_b65vpz2ydevstack@QuobyteHD {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:57 devstack sudo[100287]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:57 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-eb914eab-f3da-4fc8-bfc3-72439c973c2c tempest-VolumesSnapshotTestJSON-1438674217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aca30262-0e35-44c1-a5a5-1947211bbb4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aca30262-0e35-44c1-a5a5-1947211bbb4f.e10029c2-5741-4917-ad97-742608c64009 1G" returned: 0 in 0.844s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:57 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-eb914eab-f3da-4fc8-bfc3-72439c973c2c tempest-VolumesSnapshotTestJSON-1438674217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aca30262-0e35-44c1-a5a5-1947211bbb4f -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aca30262-0e35-44c1-a5a5-1947211bbb4f.e10029c2-5741-4917-ad97-742608c64009 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:57 devstack sudo[100301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aca30262-0e35-44c1-a5a5-1947211bbb4f -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aca30262-0e35-44c1-a5a5-1947211bbb4f.e10029c2-5741-4917-ad97-742608c64009 Sep 25 11:52:57 devstack sudo[100301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:57 devstack sudo[100300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fbb496eb-26b3-471a-9de0-723d61aae46a_b65vpz2ydevstack@QuobyteHD Sep 25 11:52:57 devstack sudo[100300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:58 devstack sudo[100300]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:58 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a2b45413-f8ef-4803-9495-6d010c5775d4 tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fbb496eb-26b3-471a-9de0-723d61aae46a_b65vpz2ydevstack@QuobyteHD" returned: 0 in 0.728s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:58 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a2b45413-f8ef-4803-9495-6d010c5775d4 tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fbb496eb-26b3-471a-9de0-723d61aae46a_b65vpz2ydevstack@QuobyteHD {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:58 devstack sudo[100301]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:58 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-eb914eab-f3da-4fc8-bfc3-72439c973c2c tempest-VolumesSnapshotTestJSON-1438674217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aca30262-0e35-44c1-a5a5-1947211bbb4f -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aca30262-0e35-44c1-a5a5-1947211bbb4f.e10029c2-5741-4917-ad97-742608c64009" returned: 0 in 0.783s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:58 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-eb914eab-f3da-4fc8-bfc3-72439c973c2c tempest-VolumesSnapshotTestJSON-1438674217 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aca30262-0e35-44c1-a5a5-1947211bbb4f.e10029c2-5741-4917-ad97-742608c64009 is being set with open permissions: ugo+rw Sep 25 11:52:58 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-eb914eab-f3da-4fc8-bfc3-72439c973c2c tempest-VolumesSnapshotTestJSON-1438674217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aca30262-0e35-44c1-a5a5-1947211bbb4f.e10029c2-5741-4917-ad97-742608c64009 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:58 devstack sudo[100309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fbb496eb-26b3-471a-9de0-723d61aae46a_b65vpz2ydevstack@QuobyteHD Sep 25 11:52:58 devstack sudo[100309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:58 devstack sudo[100313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aca30262-0e35-44c1-a5a5-1947211bbb4f.e10029c2-5741-4917-ad97-742608c64009 Sep 25 11:52:58 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-d94f60f1-3a38-4633-8548-79ef37e70de2 tempest-VolumesActionsTest-821311522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:52:58 devstack sudo[100313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:58 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d94f60f1-3a38-4633-8548-79ef37e70de2 tempest-VolumesActionsTest-821311522 None] Flow 'volume_create_manager' (4e136df9-3a30-4d83-8651-7dbcb344f117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:52:58 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d94f60f1-3a38-4633-8548-79ef37e70de2 tempest-VolumesActionsTest-821311522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (619e2ce0-46bd-4713-85f2-ba93ed0489a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:58 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d94f60f1-3a38-4633-8548-79ef37e70de2 tempest-VolumesActionsTest-821311522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (619e2ce0-46bd-4713-85f2-ba93ed0489a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:52:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-77959114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2e30d57-7da8-4e10-b583-642ca99c4110,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af85dda72acd4db88b68cc01b7569e60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:52:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:52:58Z,use_quota=True,user_id='c370d3ebe2d24b02a5f064d1b7908383',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:58 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d94f60f1-3a38-4633-8548-79ef37e70de2 tempest-VolumesActionsTest-821311522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad232541-ea14-4883-a357-e6d2c65c2aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:58 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d94f60f1-3a38-4633-8548-79ef37e70de2 tempest-VolumesActionsTest-821311522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad232541-ea14-4883-a357-e6d2c65c2aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:58 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d94f60f1-3a38-4633-8548-79ef37e70de2 tempest-VolumesActionsTest-821311522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2007cefb-8db9-493b-a546-91e2abd2d876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:58 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d94f60f1-3a38-4633-8548-79ef37e70de2 tempest-VolumesActionsTest-821311522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2007cefb-8db9-493b-a546-91e2abd2d876) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2e30d57-7da8-4e10-b583-642ca99c4110', 'volume_name': 'volume-f2e30d57-7da8-4e10-b583-642ca99c4110', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:58 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d94f60f1-3a38-4633-8548-79ef37e70de2 tempest-VolumesActionsTest-821311522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1041891-33d4-4058-bc84-e10390c67808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:58 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d94f60f1-3a38-4633-8548-79ef37e70de2 tempest-VolumesActionsTest-821311522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1041891-33d4-4058-bc84-e10390c67808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:52:58 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d94f60f1-3a38-4633-8548-79ef37e70de2 tempest-VolumesActionsTest-821311522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (619c6b0d-7971-46a5-b73d-0068045a5f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:52:58 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-d94f60f1-3a38-4633-8548-79ef37e70de2 tempest-VolumesActionsTest-821311522 None] Volume f2e30d57-7da8-4e10-b583-642ca99c4110: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2e30d57-7da8-4e10-b583-642ca99c4110', 'volume_size': 1} Sep 25 11:52:58 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d94f60f1-3a38-4633-8548-79ef37e70de2 tempest-VolumesActionsTest-821311522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:52:58 devstack sudo[100309]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:58 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a2b45413-f8ef-4803-9495-6d010c5775d4 tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fbb496eb-26b3-471a-9de0-723d61aae46a_b65vpz2ydevstack@QuobyteHD" returned: 1 in 0.525s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:58 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a2b45413-f8ef-4803-9495-6d010c5775d4 tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fbb496eb-26b3-471a-9de0-723d61aae46a_b65vpz2ydevstack@QuobyteHD' failed. Not Retrying. {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 11:52:58 devstack cinder-volume[86984]: DEBUG cinder.image.image_utils [None req-a2b45413-f8ef-4803-9495-6d010c5775d4 tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] fbb496eb-26b3-471a-9de0-723d61aae46a was raw, converting to qcow2 {{(pid=86984) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 11:52:58 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a2b45413-f8ef-4803-9495-6d010c5775d4 tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_fbb496eb-26b3-471a-9de0-723d61aae46a_b65vpz2ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-18ccb6f1-64a7-4567-bae4-8ff0366e3828 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:58 devstack sudo[100313]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:58 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-eb914eab-f3da-4fc8-bfc3-72439c973c2c tempest-VolumesSnapshotTestJSON-1438674217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aca30262-0e35-44c1-a5a5-1947211bbb4f.e10029c2-5741-4917-ad97-742608c64009" returned: 0 in 0.388s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:58 devstack sudo[100320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_fbb496eb-26b3-471a-9de0-723d61aae46a_b65vpz2ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-18ccb6f1-64a7-4567-bae4-8ff0366e3828 Sep 25 11:52:58 devstack sudo[100320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:59 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-eb914eab-f3da-4fc8-bfc3-72439c973c2c tempest-VolumesSnapshotTestJSON-1438674217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aca30262-0e35-44c1-a5a5-1947211bbb4f.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:59 devstack sudo[100322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aca30262-0e35-44c1-a5a5-1947211bbb4f.info Sep 25 11:52:59 devstack sudo[100322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:59 devstack sudo[100322]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:59 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-eb914eab-f3da-4fc8-bfc3-72439c973c2c tempest-VolumesSnapshotTestJSON-1438674217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aca30262-0e35-44c1-a5a5-1947211bbb4f.info" returned: 0 in 0.471s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:59 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-eb914eab-f3da-4fc8-bfc3-72439c973c2c tempest-VolumesSnapshotTestJSON-1438674217 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aca30262-0e35-44c1-a5a5-1947211bbb4f.info is being set with open permissions: ugo+rw Sep 25 11:52:59 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-eb914eab-f3da-4fc8-bfc3-72439c973c2c tempest-VolumesSnapshotTestJSON-1438674217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aca30262-0e35-44c1-a5a5-1947211bbb4f.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:59 devstack sudo[100328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aca30262-0e35-44c1-a5a5-1947211bbb4f.info Sep 25 11:52:59 devstack sudo[100328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:59 devstack sudo[100320]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:59 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a2b45413-f8ef-4803-9495-6d010c5775d4 tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_fbb496eb-26b3-471a-9de0-723d61aae46a_b65vpz2ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-18ccb6f1-64a7-4567-bae4-8ff0366e3828" returned: 0 in 0.762s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:59 devstack cinder-volume[86984]: DEBUG cinder.image.image_utils [None req-a2b45413-f8ef-4803-9495-6d010c5775d4 tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fbb496eb-26b3-471a-9de0-723d61aae46a_b65vpz2ydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-18ccb6f1-64a7-4567-bae4-8ff0366e3828 {{(pid=86984) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 11:52:59 devstack cinder-volume[86984]: INFO cinder.image.image_utils [None req-a2b45413-f8ef-4803-9495-6d010c5775d4 tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] Converted 0.00 MB image at 0.00 MB/s Sep 25 11:52:59 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a2b45413-f8ef-4803-9495-6d010c5775d4 tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-18ccb6f1-64a7-4567-bae4-8ff0366e3828 1G {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:52:59 devstack sudo[100331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-18ccb6f1-64a7-4567-bae4-8ff0366e3828 1G Sep 25 11:52:59 devstack sudo[100331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:52:59 devstack sudo[100328]: pam_unix(sudo:session): session closed for user root Sep 25 11:52:59 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-eb914eab-f3da-4fc8-bfc3-72439c973c2c tempest-VolumesSnapshotTestJSON-1438674217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aca30262-0e35-44c1-a5a5-1947211bbb4f.info" returned: 0 in 0.415s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:52:59 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-eb914eab-f3da-4fc8-bfc3-72439c973c2c tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.866s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:52:59 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d94f60f1-3a38-4633-8548-79ef37e70de2 tempest-VolumesActionsTest-821311522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.231s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:52:59 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-d94f60f1-3a38-4633-8548-79ef37e70de2 tempest-VolumesActionsTest-821311522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:52:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-77959114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2e30d57-7da8-4e10-b583-642ca99c4110,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af85dda72acd4db88b68cc01b7569e60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:52:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:52:58Z,use_quota=True,user_id='c370d3ebe2d24b02a5f064d1b7908383',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:52:59 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-d94f60f1-3a38-4633-8548-79ef37e70de2 tempest-VolumesActionsTest-821311522 None] Creating volume f2e30d57-7da8-4e10-b583-642ca99c4110 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:52:59 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d94f60f1-3a38-4633-8548-79ef37e70de2 tempest-VolumesActionsTest-821311522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:52:59 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d94f60f1-3a38-4633-8548-79ef37e70de2 tempest-VolumesActionsTest-821311522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:52:59 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-d94f60f1-3a38-4633-8548-79ef37e70de2 tempest-VolumesActionsTest-821311522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:52:59 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-d94f60f1-3a38-4633-8548-79ef37e70de2 tempest-VolumesActionsTest-821311522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:52:59 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d94f60f1-3a38-4633-8548-79ef37e70de2 tempest-VolumesActionsTest-821311522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:52:59 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-d94f60f1-3a38-4633-8548-79ef37e70de2 tempest-VolumesActionsTest-821311522 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:52:59 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-d94f60f1-3a38-4633-8548-79ef37e70de2 tempest-VolumesActionsTest-821311522 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:52:59 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d94f60f1-3a38-4633-8548-79ef37e70de2 tempest-VolumesActionsTest-821311522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f2e30d57-7da8-4e10-b583-642ca99c4110 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:00 devstack sudo[100334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f2e30d57-7da8-4e10-b583-642ca99c4110 1073741824 Sep 25 11:53:00 devstack sudo[100334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:00 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-eb914eab-f3da-4fc8-bfc3-72439c973c2c tempest-VolumesSnapshotTestJSON-1438674217 None] Create snapshot completed successfully Sep 25 11:53:00 devstack sudo[100331]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:00 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a2b45413-f8ef-4803-9495-6d010c5775d4 tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-18ccb6f1-64a7-4567-bae4-8ff0366e3828 1G" returned: 0 in 0.517s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:00 devstack cinder-volume[86984]: DEBUG cinder.volume.volume_utils [None req-a2b45413-f8ef-4803-9495-6d010c5775d4 tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] Downloaded image fbb496eb-26b3-471a-9de0-723d61aae46a ((None, [{'url': 'file:///opt/stack/data/glance/images/fbb496eb-26b3-471a-9de0-723d61aae46a', 'metadata': {}}])) to volume 18ccb6f1-64a7-4567-bae4-8ff0366e3828 successfully. {{(pid=86984) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 11:53:00 devstack cinder-volume[86984]: DEBUG cinder.image.image_utils [None req-a2b45413-f8ef-4803-9495-6d010c5775d4 tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] Temporary image fbb496eb-26b3-471a-9de0-723d61aae46a for user 716db98b76f04d8d9d8089b8d681438a is deleted. {{(pid=86984) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 11:53:00 devstack cinder-volume[86984]: DEBUG cinder.volume.volume_utils [None req-a2b45413-f8ef-4803-9495-6d010c5775d4 tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] Marking volume 18ccb6f1-64a7-4567-bae4-8ff0366e3828 as bootable. {{(pid=86984) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 11:53:00 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2b45413-f8ef-4803-9495-6d010c5775d4 tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] Copying metadata from image fbb496eb-26b3-471a-9de0-723d61aae46a to 18ccb6f1-64a7-4567-bae4-8ff0366e3828. {{(pid=86984) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 11:53:00 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2b45413-f8ef-4803-9495-6d010c5775d4 tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] Creating volume glance metadata for volume 18ccb6f1-64a7-4567-bae4-8ff0366e3828 backed by image fbb496eb-26b3-471a-9de0-723d61aae46a with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'fbb496eb-26b3-471a-9de0-723d61aae46a', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '1a402988c7ac11b6e385fab4b4a18178', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86984) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 11:53:00 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-a2b45413-f8ef-4803-9495-6d010c5775d4 tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0925a9f4-ac0d-4d0b-bbdc-186350be2c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18ccb6f1-64a7-4567-bae4-8ff0366e3828', 'volume_size': 1, 'image_id': 'fbb496eb-26b3-471a-9de0-723d61aae46a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fbb496eb-26b3-471a-9de0-723d61aae46a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1a402988c7ac11b6e385fab4b4a18178', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'adeab418fa924523b20edc9539bf3fc6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '499f39abeb5adeb1df22c73eb26f64a9f8bdc40df39064f2ad0822975bb0a1414bd19e8a103ca61499bcbbafdbe205bff320869d4c2ddd60fac854b6de3c074d', 'id': 'fbb496eb-26b3-471a-9de0-723d61aae46a', 'created_at': datetime.datetime(2026, 9, 25, 9, 52, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 52, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fbb496eb-26b3-471a-9de0-723d61aae46a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:00 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-a2b45413-f8ef-4803-9495-6d010c5775d4 tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e079580-f844-412e-9e70-2563ec6de149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:00 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-a2b45413-f8ef-4803-9495-6d010c5775d4 tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] Volume volume-18ccb6f1-64a7-4567-bae4-8ff0366e3828 (18ccb6f1-64a7-4567-bae4-8ff0366e3828): created successfully Sep 25 11:53:00 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-a2b45413-f8ef-4803-9495-6d010c5775d4 tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e079580-f844-412e-9e70-2563ec6de149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:00 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-a2b45413-f8ef-4803-9495-6d010c5775d4 tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] Flow 'volume_create_manager' (4048b3ab-3743-421f-ac7a-dc30451e1541) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:53:00 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-a2b45413-f8ef-4803-9495-6d010c5775d4 tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] Created volume successfully. Sep 25 11:53:00 devstack sudo[100334]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:00 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d94f60f1-3a38-4633-8548-79ef37e70de2 tempest-VolumesActionsTest-821311522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f2e30d57-7da8-4e10-b583-642ca99c4110 1073741824" returned: 0 in 0.779s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:00 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d94f60f1-3a38-4633-8548-79ef37e70de2 tempest-VolumesActionsTest-821311522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f2e30d57-7da8-4e10-b583-642ca99c4110 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:00 devstack sudo[100344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f2e30d57-7da8-4e10-b583-642ca99c4110 Sep 25 11:53:00 devstack sudo[100344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:01 devstack sudo[100344]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:01 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d94f60f1-3a38-4633-8548-79ef37e70de2 tempest-VolumesActionsTest-821311522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f2e30d57-7da8-4e10-b583-642ca99c4110" returned: 0 in 0.418s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:01 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-d94f60f1-3a38-4633-8548-79ef37e70de2 tempest-VolumesActionsTest-821311522 None] <== create_volume: return (1269ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:53:01 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d94f60f1-3a38-4633-8548-79ef37e70de2 tempest-VolumesActionsTest-821311522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.277s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:53:01 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d94f60f1-3a38-4633-8548-79ef37e70de2 tempest-VolumesActionsTest-821311522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (619c6b0d-7971-46a5-b73d-0068045a5f3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2e30d57-7da8-4e10-b583-642ca99c4110', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:01 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d94f60f1-3a38-4633-8548-79ef37e70de2 tempest-VolumesActionsTest-821311522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1084b554-491d-4cd1-aa39-27624ac9ce58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:01 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-d94f60f1-3a38-4633-8548-79ef37e70de2 tempest-VolumesActionsTest-821311522 None] Volume volume-f2e30d57-7da8-4e10-b583-642ca99c4110 (f2e30d57-7da8-4e10-b583-642ca99c4110): created successfully Sep 25 11:53:01 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d94f60f1-3a38-4633-8548-79ef37e70de2 tempest-VolumesActionsTest-821311522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1084b554-491d-4cd1-aa39-27624ac9ce58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:01 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d94f60f1-3a38-4633-8548-79ef37e70de2 tempest-VolumesActionsTest-821311522 None] Flow 'volume_create_manager' (4e136df9-3a30-4d83-8651-7dbcb344f117) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:53:01 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-d94f60f1-3a38-4633-8548-79ef37e70de2 tempest-VolumesActionsTest-821311522 None] Created volume successfully. Sep 25 11:53:01 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-dcac7b5d-b470-438e-86a7-0d8a40dddc0c tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] Acquiring lock "cinder-18ccb6f1-64a7-4567-bae4-8ff0366e3828-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:53:01 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-dcac7b5d-b470-438e-86a7-0d8a40dddc0c tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] Lock "cinder-18ccb6f1-64a7-4567-bae4-8ff0366e3828-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:53:01 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-dcac7b5d-b470-438e-86a7-0d8a40dddc0c tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] Acquiring lock "cinder-quobyte-18ccb6f1-64a7-4567-bae4-8ff0366e3828" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:53:01 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-dcac7b5d-b470-438e-86a7-0d8a40dddc0c tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] Lock "cinder-quobyte-18ccb6f1-64a7-4567-bae4-8ff0366e3828" acquired by "delete_volume" :: waited 0.022s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:53:01 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e529eb1-0dd9-4933-bf5e-52dc7ac62d28]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:53:01 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-dcac7b5d-b470-438e-86a7-0d8a40dddc0c tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-18ccb6f1-64a7-4567-bae4-8ff0366e3828 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:01 devstack sudo[100347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-18ccb6f1-64a7-4567-bae4-8ff0366e3828 Sep 25 11:53:01 devstack sudo[100347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:02 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-80d8ae24-c834-4948-aea3-933ab4917a4f tempest-VolumesSnapshotTestJSON-1438674217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:53:02 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-80d8ae24-c834-4948-aea3-933ab4917a4f tempest-VolumesSnapshotTestJSON-1438674217 None] Flow 'volume_create_manager' (9306c787-b038-4440-93f6-2370c84b8b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:53:02 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-80d8ae24-c834-4948-aea3-933ab4917a4f tempest-VolumesSnapshotTestJSON-1438674217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bd02744-bb90-45db-a83d-84527b0eebc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:02 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-46b813ba-60b5-4c23-b5b7-45ba40744169 tempest-VolumesActionsTest-1180183357 None] Acquiring lock "cinder-f2e30d57-7da8-4e10-b583-642ca99c4110-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:53:02 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-80d8ae24-c834-4948-aea3-933ab4917a4f tempest-VolumesSnapshotTestJSON-1438674217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bd02744-bb90-45db-a83d-84527b0eebc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:53:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1611344491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a17798fe-bd34-43c1-ad6c-6ecce848e441,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2437d2ea68f4f68be08425e0599a9b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:53:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e10029c2-5741-4917-ad97-742608c64009,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:53:02Z,use_quota=True,user_id='0fe6a04643a34fc6a664bfb998b802f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:02 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-80d8ae24-c834-4948-aea3-933ab4917a4f tempest-VolumesSnapshotTestJSON-1438674217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (087c4df2-a687-4679-a598-652b3a0c8bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:02 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-80d8ae24-c834-4948-aea3-933ab4917a4f tempest-VolumesSnapshotTestJSON-1438674217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (087c4df2-a687-4679-a598-652b3a0c8bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:02 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-80d8ae24-c834-4948-aea3-933ab4917a4f tempest-VolumesSnapshotTestJSON-1438674217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1269396b-5751-443a-a6c3-c60d00b05055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:02 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-80d8ae24-c834-4948-aea3-933ab4917a4f tempest-VolumesSnapshotTestJSON-1438674217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1269396b-5751-443a-a6c3-c60d00b05055) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a17798fe-bd34-43c1-ad6c-6ecce848e441', 'volume_name': 'volume-a17798fe-bd34-43c1-ad6c-6ecce848e441', 'volume_size': 1, 'snapshot_id': 'e10029c2-5741-4917-ad97-742608c64009'}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:02 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-80d8ae24-c834-4948-aea3-933ab4917a4f tempest-VolumesSnapshotTestJSON-1438674217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1455d570-7d91-4756-8741-c34f8720a9b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:02 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-80d8ae24-c834-4948-aea3-933ab4917a4f tempest-VolumesSnapshotTestJSON-1438674217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1455d570-7d91-4756-8741-c34f8720a9b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:02 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-80d8ae24-c834-4948-aea3-933ab4917a4f tempest-VolumesSnapshotTestJSON-1438674217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fc9fc53-812d-453f-8f01-a1e4d3858153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:02 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-80d8ae24-c834-4948-aea3-933ab4917a4f tempest-VolumesSnapshotTestJSON-1438674217 None] Volume a17798fe-bd34-43c1-ad6c-6ecce848e441: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a17798fe-bd34-43c1-ad6c-6ecce848e441', 'volume_size': 1, 'snapshot_id': 'e10029c2-5741-4917-ad97-742608c64009'} Sep 25 11:53:02 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-80d8ae24-c834-4948-aea3-933ab4917a4f tempest-VolumesSnapshotTestJSON-1438674217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:53:02 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-80d8ae24-c834-4948-aea3-933ab4917a4f tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:53:02 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-80d8ae24-c834-4948-aea3-933ab4917a4f tempest-VolumesSnapshotTestJSON-1438674217 None] Acquiring lock "cinder-quobyte-e10029c2-5741-4917-ad97-742608c64009-a17798fe-bd34-43c1-ad6c-6ecce848e441" by "_create_volume_from_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:53:02 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-46b813ba-60b5-4c23-b5b7-45ba40744169 tempest-VolumesActionsTest-1180183357 None] Lock "cinder-f2e30d57-7da8-4e10-b583-642ca99c4110-delete_volume" acquired by "delete_volume" :: waited 0.122s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:53:02 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-80d8ae24-c834-4948-aea3-933ab4917a4f tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "cinder-quobyte-e10029c2-5741-4917-ad97-742608c64009-a17798fe-bd34-43c1-ad6c-6ecce848e441" acquired by "_create_volume_from_snapshot" :: waited 0.049s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:53:02 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-80d8ae24-c834-4948-aea3-933ab4917a4f tempest-VolumesSnapshotTestJSON-1438674217 None] Creating volume a17798fe-bd34-43c1-ad6c-6ecce848e441 from snapshot e10029c2-5741-4917-ad97-742608c64009 {{(pid=86984) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 11:53:02 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-80d8ae24-c834-4948-aea3-933ab4917a4f tempest-VolumesSnapshotTestJSON-1438674217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:53:02 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-80d8ae24-c834-4948-aea3-933ab4917a4f tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:53:02 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-80d8ae24-c834-4948-aea3-933ab4917a4f tempest-VolumesSnapshotTestJSON-1438674217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:53:02 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-80d8ae24-c834-4948-aea3-933ab4917a4f tempest-VolumesSnapshotTestJSON-1438674217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:53:02 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-80d8ae24-c834-4948-aea3-933ab4917a4f tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:53:02 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-80d8ae24-c834-4948-aea3-933ab4917a4f tempest-VolumesSnapshotTestJSON-1438674217 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:53:02 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-80d8ae24-c834-4948-aea3-933ab4917a4f tempest-VolumesSnapshotTestJSON-1438674217 None] Acquiring lock "cinder-quobyte-a17798fe-bd34-43c1-ad6c-6ecce848e441" by "_copy_volume_from_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:53:02 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-46b813ba-60b5-4c23-b5b7-45ba40744169 tempest-VolumesActionsTest-1180183357 None] Acquiring lock "cinder-quobyte-f2e30d57-7da8-4e10-b583-642ca99c4110" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:53:02 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-80d8ae24-c834-4948-aea3-933ab4917a4f tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "cinder-quobyte-a17798fe-bd34-43c1-ad6c-6ecce848e441" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:53:02 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-80d8ae24-c834-4948-aea3-933ab4917a4f tempest-VolumesSnapshotTestJSON-1438674217 None] snapshot: e10029c2-5741-4917-ad97-742608c64009, volume: a17798fe-bd34-43c1-ad6c-6ecce848e441, {{(pid=86984) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 11:53:02 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-46b813ba-60b5-4c23-b5b7-45ba40744169 tempest-VolumesActionsTest-1180183357 None] Lock "cinder-quobyte-f2e30d57-7da8-4e10-b583-642ca99c4110" acquired by "delete_volume" :: waited 0.032s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:53:02 devstack sudo[100347]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:02 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-80d8ae24-c834-4948-aea3-933ab4917a4f tempest-VolumesSnapshotTestJSON-1438674217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:53:02 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-80d8ae24-c834-4948-aea3-933ab4917a4f tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:53:02 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-80d8ae24-c834-4948-aea3-933ab4917a4f tempest-VolumesSnapshotTestJSON-1438674217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:53:02 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-80d8ae24-c834-4948-aea3-933ab4917a4f tempest-VolumesSnapshotTestJSON-1438674217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:53:02 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-80d8ae24-c834-4948-aea3-933ab4917a4f tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:53:02 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[04769d6b-3d76-4fc9-9b68-cc01b6384afe]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:53:02 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-46b813ba-60b5-4c23-b5b7-45ba40744169 tempest-VolumesActionsTest-1180183357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f2e30d57-7da8-4e10-b583-642ca99c4110 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:02 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-dcac7b5d-b470-438e-86a7-0d8a40dddc0c tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-18ccb6f1-64a7-4567-bae4-8ff0366e3828" returned: 0 in 0.697s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:02 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-dcac7b5d-b470-438e-86a7-0d8a40dddc0c tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-18ccb6f1-64a7-4567-bae4-8ff0366e3828 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:02 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc99bdd3-c76b-4fd8-bcd0-234d94445f92]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:53:02 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-80d8ae24-c834-4948-aea3-933ab4917a4f tempest-VolumesSnapshotTestJSON-1438674217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aca30262-0e35-44c1-a5a5-1947211bbb4f.e10029c2-5741-4917-ad97-742608c64009 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:02 devstack sudo[100353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-18ccb6f1-64a7-4567-bae4-8ff0366e3828 Sep 25 11:53:02 devstack sudo[100353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:02 devstack sudo[100352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f2e30d57-7da8-4e10-b583-642ca99c4110 Sep 25 11:53:02 devstack sudo[100352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:02 devstack sudo[100354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aca30262-0e35-44c1-a5a5-1947211bbb4f.e10029c2-5741-4917-ad97-742608c64009 Sep 25 11:53:02 devstack sudo[100354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:03 devstack sudo[100353]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-dcac7b5d-b470-438e-86a7-0d8a40dddc0c tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-18ccb6f1-64a7-4567-bae4-8ff0366e3828" returned: 0 in 0.689s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:03 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-dcac7b5d-b470-438e-86a7-0d8a40dddc0c tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] Lock "cinder-quobyte-18ccb6f1-64a7-4567-bae4-8ff0366e3828" released by "delete_volume" :: held 1.492s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:53:03 devstack sudo[100352]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-46b813ba-60b5-4c23-b5b7-45ba40744169 tempest-VolumesActionsTest-1180183357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f2e30d57-7da8-4e10-b583-642ca99c4110" returned: 0 in 0.807s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-46b813ba-60b5-4c23-b5b7-45ba40744169 tempest-VolumesActionsTest-1180183357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f2e30d57-7da8-4e10-b583-642ca99c4110 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:03 devstack cinder-volume[86984]: WARNING cinder.quota [None req-dcac7b5d-b470-438e-86a7-0d8a40dddc0c tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 25 11:53:03 devstack cinder-volume[86984]: WARNING cinder.quota [None req-dcac7b5d-b470-438e-86a7-0d8a40dddc0c tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 25 11:53:03 devstack sudo[100354]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-80d8ae24-c834-4948-aea3-933ab4917a4f tempest-VolumesSnapshotTestJSON-1438674217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aca30262-0e35-44c1-a5a5-1947211bbb4f.e10029c2-5741-4917-ad97-742608c64009" returned: 0 in 0.848s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:03 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-80d8ae24-c834-4948-aea3-933ab4917a4f tempest-VolumesSnapshotTestJSON-1438674217 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aca30262-0e35-44c1-a5a5-1947211bbb4f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86984) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:53:03 devstack sudo[100365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f2e30d57-7da8-4e10-b583-642ca99c4110 Sep 25 11:53:03 devstack sudo[100365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:03 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f04a4ec-7f08-4c91-86d2-8e23dac18a08]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:53:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-80d8ae24-c834-4948-aea3-933ab4917a4f tempest-VolumesSnapshotTestJSON-1438674217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aca30262-0e35-44c1-a5a5-1947211bbb4f {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:03 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-dcac7b5d-b470-438e-86a7-0d8a40dddc0c tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] Created reservations ['2f57bd9d-3bfd-422b-829c-4f8440f2f898', '2e792553-cea4-4698-84e5-a9d4bd45ab7b', '20cd7a22-48fe-4ab8-b3b1-b8c0b17f7a61', '641dce83-ef89-47db-88e0-b4985d3787ba'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:53:03 devstack sudo[100367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aca30262-0e35-44c1-a5a5-1947211bbb4f Sep 25 11:53:03 devstack sudo[100367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-dcac7b5d-b470-438e-86a7-0d8a40dddc0c tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:53:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-dcac7b5d-b470-438e-86a7-0d8a40dddc0c tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:53:03 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-dcac7b5d-b470-438e-86a7-0d8a40dddc0c tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:53:03 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-dcac7b5d-b470-438e-86a7-0d8a40dddc0c tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:53:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-dcac7b5d-b470-438e-86a7-0d8a40dddc0c tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:53:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-dcac7b5d-b470-438e-86a7-0d8a40dddc0c tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:03 devstack sudo[100370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:53:03 devstack sudo[100370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:03 devstack sudo[100365]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-46b813ba-60b5-4c23-b5b7-45ba40744169 tempest-VolumesActionsTest-1180183357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f2e30d57-7da8-4e10-b583-642ca99c4110" returned: 0 in 0.655s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:03 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-46b813ba-60b5-4c23-b5b7-45ba40744169 tempest-VolumesActionsTest-1180183357 None] Lock "cinder-quobyte-f2e30d57-7da8-4e10-b583-642ca99c4110" released by "delete_volume" :: held 1.601s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:53:04 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-46b813ba-60b5-4c23-b5b7-45ba40744169 tempest-VolumesActionsTest-1180183357 None] Created reservations ['62d20b74-16ea-403a-8465-1b9a024bbc85', 'bf367200-be1e-4ae9-ae42-5fd8eb57ee73', '0952abe0-faa8-4beb-bd73-835366933e0a', '00e7ef06-6dae-49b9-9bbe-6826d5b56af3'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:53:04 devstack sudo[100367]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:04 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-80d8ae24-c834-4948-aea3-933ab4917a4f tempest-VolumesSnapshotTestJSON-1438674217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aca30262-0e35-44c1-a5a5-1947211bbb4f" returned: 0 in 0.886s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:04 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-80d8ae24-c834-4948-aea3-933ab4917a4f tempest-VolumesSnapshotTestJSON-1438674217 None] will copy from snapshot at /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aca30262-0e35-44c1-a5a5-1947211bbb4f {{(pid=86984) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 11:53:04 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-80d8ae24-c834-4948-aea3-933ab4917a4f tempest-VolumesSnapshotTestJSON-1438674217 None] Creating direct copy from snapshot {{(pid=86984) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 11:53:04 devstack cinder-volume[86984]: DEBUG cinder.utils [None req-80d8ae24-c834-4948-aea3-933ab4917a4f tempest-VolumesSnapshotTestJSON-1438674217 None] Path /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a17798fe-bd34-43c1-ad6c-6ecce848e441 not found in is_blk_device check {{(pid=86984) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 11:53:04 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-80d8ae24-c834-4948-aea3-933ab4917a4f tempest-VolumesSnapshotTestJSON-1438674217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aca30262-0e35-44c1-a5a5-1947211bbb4f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a17798fe-bd34-43c1-ad6c-6ecce848e441 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:04 devstack sudo[100370]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:04 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-dcac7b5d-b470-438e-86a7-0d8a40dddc0c tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.696s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:04 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-dcac7b5d-b470-438e-86a7-0d8a40dddc0c tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:53:04 devstack sudo[100377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aca30262-0e35-44c1-a5a5-1947211bbb4f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a17798fe-bd34-43c1-ad6c-6ecce848e441 Sep 25 11:53:04 devstack sudo[100377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:04 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-dcac7b5d-b470-438e-86a7-0d8a40dddc0c tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] Deleted volume successfully. Sep 25 11:53:04 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-dcac7b5d-b470-438e-86a7-0d8a40dddc0c tempest-VolumeAndVolumeTypeFromImageTest-1356414509 None] Lock "cinder-18ccb6f1-64a7-4567-bae4-8ff0366e3828-delete_volume" released by "delete_volume" :: held 2.814s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:53:04 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-46b813ba-60b5-4c23-b5b7-45ba40744169 tempest-VolumesActionsTest-1180183357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:53:04 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-46b813ba-60b5-4c23-b5b7-45ba40744169 tempest-VolumesActionsTest-1180183357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:53:04 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-46b813ba-60b5-4c23-b5b7-45ba40744169 tempest-VolumesActionsTest-1180183357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:53:04 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-46b813ba-60b5-4c23-b5b7-45ba40744169 tempest-VolumesActionsTest-1180183357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:53:04 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-46b813ba-60b5-4c23-b5b7-45ba40744169 tempest-VolumesActionsTest-1180183357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:53:04 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-46b813ba-60b5-4c23-b5b7-45ba40744169 tempest-VolumesActionsTest-1180183357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:04 devstack sudo[100380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:53:04 devstack sudo[100380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:05 devstack sudo[100380]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-46b813ba-60b5-4c23-b5b7-45ba40744169 tempest-VolumesActionsTest-1180183357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.684s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:05 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-46b813ba-60b5-4c23-b5b7-45ba40744169 tempest-VolumesActionsTest-1180183357 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:53:05 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-46b813ba-60b5-4c23-b5b7-45ba40744169 tempest-VolumesActionsTest-1180183357 None] Deleted volume successfully. Sep 25 11:53:05 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-46b813ba-60b5-4c23-b5b7-45ba40744169 tempest-VolumesActionsTest-1180183357 None] Lock "cinder-f2e30d57-7da8-4e10-b583-642ca99c4110-delete_volume" released by "delete_volume" :: held 3.026s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:53:05 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-73c86acc-36e2-4cba-b4ae-410866ffd9df tempest-VolumesActionsTest-821311522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:53:06 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-73c86acc-36e2-4cba-b4ae-410866ffd9df tempest-VolumesActionsTest-821311522 None] Flow 'volume_create_manager' (83484ac0-4c6b-433c-8b94-59c13a99e210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:53:06 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-73c86acc-36e2-4cba-b4ae-410866ffd9df tempest-VolumesActionsTest-821311522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fedb89f-a85e-4500-b027-bab608530c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:06 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-73c86acc-36e2-4cba-b4ae-410866ffd9df tempest-VolumesActionsTest-821311522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fedb89f-a85e-4500-b027-bab608530c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:53:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-121077320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8d16ebb-949d-47b3-8a60-5d6a2620305f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af85dda72acd4db88b68cc01b7569e60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:53:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:53:06Z,use_quota=True,user_id='c370d3ebe2d24b02a5f064d1b7908383',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:06 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-73c86acc-36e2-4cba-b4ae-410866ffd9df tempest-VolumesActionsTest-821311522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12ff550a-6a84-4b4f-bc60-f0707828bea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:06 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-73c86acc-36e2-4cba-b4ae-410866ffd9df tempest-VolumesActionsTest-821311522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12ff550a-6a84-4b4f-bc60-f0707828bea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:06 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-73c86acc-36e2-4cba-b4ae-410866ffd9df tempest-VolumesActionsTest-821311522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94c206db-bedd-4d59-88f5-3911f8ac23dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:06 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-73c86acc-36e2-4cba-b4ae-410866ffd9df tempest-VolumesActionsTest-821311522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94c206db-bedd-4d59-88f5-3911f8ac23dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8d16ebb-949d-47b3-8a60-5d6a2620305f', 'volume_name': 'volume-d8d16ebb-949d-47b3-8a60-5d6a2620305f', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:06 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-73c86acc-36e2-4cba-b4ae-410866ffd9df tempest-VolumesActionsTest-821311522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70eb7ebe-247e-403a-9444-e8504bd162c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:06 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-73c86acc-36e2-4cba-b4ae-410866ffd9df tempest-VolumesActionsTest-821311522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70eb7ebe-247e-403a-9444-e8504bd162c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:06 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-73c86acc-36e2-4cba-b4ae-410866ffd9df tempest-VolumesActionsTest-821311522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b8b83cc-8afd-403a-ad1b-a970a3d843e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:06 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-73c86acc-36e2-4cba-b4ae-410866ffd9df tempest-VolumesActionsTest-821311522 None] Volume d8d16ebb-949d-47b3-8a60-5d6a2620305f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8d16ebb-949d-47b3-8a60-5d6a2620305f', 'volume_size': 1} Sep 25 11:53:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-73c86acc-36e2-4cba-b4ae-410866ffd9df tempest-VolumesActionsTest-821311522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:53:14 devstack sudo[100377]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:14 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-80d8ae24-c834-4948-aea3-933ab4917a4f tempest-VolumesSnapshotTestJSON-1438674217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aca30262-0e35-44c1-a5a5-1947211bbb4f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a17798fe-bd34-43c1-ad6c-6ecce848e441" returned: 0 in 10.654s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:14 devstack cinder-volume[86984]: DEBUG cinder.image.image_utils [None req-80d8ae24-c834-4948-aea3-933ab4917a4f tempest-VolumesSnapshotTestJSON-1438674217 None] Image conversion details: src /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aca30262-0e35-44c1-a5a5-1947211bbb4f, size 1024.00 MB, duration 10.66 sec, destination /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a17798fe-bd34-43c1-ad6c-6ecce848e441 {{(pid=86984) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 11:53:14 devstack cinder-volume[86984]: INFO cinder.image.image_utils [None req-80d8ae24-c834-4948-aea3-933ab4917a4f tempest-VolumesSnapshotTestJSON-1438674217 None] Converted 1024.00 MB image at 96.10 MB/s Sep 25 11:53:14 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-80d8ae24-c834-4948-aea3-933ab4917a4f tempest-VolumesSnapshotTestJSON-1438674217 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a17798fe-bd34-43c1-ad6c-6ecce848e441 is being set with open permissions: ugo+rw Sep 25 11:53:14 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-80d8ae24-c834-4948-aea3-933ab4917a4f tempest-VolumesSnapshotTestJSON-1438674217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a17798fe-bd34-43c1-ad6c-6ecce848e441 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:14 devstack sudo[100396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a17798fe-bd34-43c1-ad6c-6ecce848e441 Sep 25 11:53:14 devstack sudo[100396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:15 devstack sudo[100396]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:15 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-80d8ae24-c834-4948-aea3-933ab4917a4f tempest-VolumesSnapshotTestJSON-1438674217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a17798fe-bd34-43c1-ad6c-6ecce848e441" returned: 0 in 0.394s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:15 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-80d8ae24-c834-4948-aea3-933ab4917a4f tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "cinder-quobyte-a17798fe-bd34-43c1-ad6c-6ecce848e441" released by "_copy_volume_from_snapshot" :: held 13.013s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:53:15 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-80d8ae24-c834-4948-aea3-933ab4917a4f tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "cinder-quobyte-e10029c2-5741-4917-ad97-742608c64009-a17798fe-bd34-43c1-ad6c-6ecce848e441" released by "_create_volume_from_snapshot" :: held 13.122s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:53:15 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-80d8ae24-c834-4948-aea3-933ab4917a4f tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.172s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:53:15 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-73c86acc-36e2-4cba-b4ae-410866ffd9df tempest-VolumesActionsTest-821311522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.178s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:53:15 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-73c86acc-36e2-4cba-b4ae-410866ffd9df tempest-VolumesActionsTest-821311522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:53:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-121077320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8d16ebb-949d-47b3-8a60-5d6a2620305f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af85dda72acd4db88b68cc01b7569e60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:53:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:53:06Z,use_quota=True,user_id='c370d3ebe2d24b02a5f064d1b7908383',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:53:15 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-73c86acc-36e2-4cba-b4ae-410866ffd9df tempest-VolumesActionsTest-821311522 None] Creating volume d8d16ebb-949d-47b3-8a60-5d6a2620305f {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:53:15 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-73c86acc-36e2-4cba-b4ae-410866ffd9df tempest-VolumesActionsTest-821311522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:53:15 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-73c86acc-36e2-4cba-b4ae-410866ffd9df tempest-VolumesActionsTest-821311522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:53:15 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-73c86acc-36e2-4cba-b4ae-410866ffd9df tempest-VolumesActionsTest-821311522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:53:15 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-73c86acc-36e2-4cba-b4ae-410866ffd9df tempest-VolumesActionsTest-821311522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:53:15 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-73c86acc-36e2-4cba-b4ae-410866ffd9df tempest-VolumesActionsTest-821311522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:53:15 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-73c86acc-36e2-4cba-b4ae-410866ffd9df tempest-VolumesActionsTest-821311522 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:53:15 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-73c86acc-36e2-4cba-b4ae-410866ffd9df tempest-VolumesActionsTest-821311522 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:53:15 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-73c86acc-36e2-4cba-b4ae-410866ffd9df tempest-VolumesActionsTest-821311522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-d8d16ebb-949d-47b3-8a60-5d6a2620305f 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:15 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-80d8ae24-c834-4948-aea3-933ab4917a4f tempest-VolumesSnapshotTestJSON-1438674217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fc9fc53-812d-453f-8f01-a1e4d3858153) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a17798fe-bd34-43c1-ad6c-6ecce848e441', 'volume_size': 1, 'snapshot_id': 'e10029c2-5741-4917-ad97-742608c64009'}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:15 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-80d8ae24-c834-4948-aea3-933ab4917a4f tempest-VolumesSnapshotTestJSON-1438674217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee4d455b-2ce5-44d5-a67e-c9db269e5853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:15 devstack sudo[100399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-d8d16ebb-949d-47b3-8a60-5d6a2620305f 1073741824 Sep 25 11:53:15 devstack sudo[100399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:15 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-80d8ae24-c834-4948-aea3-933ab4917a4f tempest-VolumesSnapshotTestJSON-1438674217 None] Volume volume-a17798fe-bd34-43c1-ad6c-6ecce848e441 (a17798fe-bd34-43c1-ad6c-6ecce848e441): created successfully Sep 25 11:53:15 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-80d8ae24-c834-4948-aea3-933ab4917a4f tempest-VolumesSnapshotTestJSON-1438674217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee4d455b-2ce5-44d5-a67e-c9db269e5853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:15 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-80d8ae24-c834-4948-aea3-933ab4917a4f tempest-VolumesSnapshotTestJSON-1438674217 None] Flow 'volume_create_manager' (9306c787-b038-4440-93f6-2370c84b8b87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:53:15 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-80d8ae24-c834-4948-aea3-933ab4917a4f tempest-VolumesSnapshotTestJSON-1438674217 None] Created volume successfully. Sep 25 11:53:16 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-eb58dc94-dc1c-46b3-b6a6-17718d71dd90 tempest-VolumesSnapshotTestJSON-1438674217 None] Acquiring lock "cinder-a17798fe-bd34-43c1-ad6c-6ecce848e441-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:53:16 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-eb58dc94-dc1c-46b3-b6a6-17718d71dd90 tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "cinder-a17798fe-bd34-43c1-ad6c-6ecce848e441-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:53:16 devstack sudo[100399]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:16 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-73c86acc-36e2-4cba-b4ae-410866ffd9df tempest-VolumesActionsTest-821311522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-d8d16ebb-949d-47b3-8a60-5d6a2620305f 1073741824" returned: 0 in 0.808s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:16 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-eb58dc94-dc1c-46b3-b6a6-17718d71dd90 tempest-VolumesSnapshotTestJSON-1438674217 None] Acquiring lock "cinder-quobyte-a17798fe-bd34-43c1-ad6c-6ecce848e441" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:53:16 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-eb58dc94-dc1c-46b3-b6a6-17718d71dd90 tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "cinder-quobyte-a17798fe-bd34-43c1-ad6c-6ecce848e441" acquired by "delete_volume" :: waited 0.030s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:53:16 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-73c86acc-36e2-4cba-b4ae-410866ffd9df tempest-VolumesActionsTest-821311522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-d8d16ebb-949d-47b3-8a60-5d6a2620305f {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:16 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d3c3d81-9519-4427-98b7-4b72ab76e7d7]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:53:16 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-eb58dc94-dc1c-46b3-b6a6-17718d71dd90 tempest-VolumesSnapshotTestJSON-1438674217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a17798fe-bd34-43c1-ad6c-6ecce848e441 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:16 devstack sudo[100404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-d8d16ebb-949d-47b3-8a60-5d6a2620305f Sep 25 11:53:16 devstack sudo[100404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:16 devstack sudo[100405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a17798fe-bd34-43c1-ad6c-6ecce848e441 Sep 25 11:53:16 devstack sudo[100405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:16 devstack sudo[100404]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:16 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-73c86acc-36e2-4cba-b4ae-410866ffd9df tempest-VolumesActionsTest-821311522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-d8d16ebb-949d-47b3-8a60-5d6a2620305f" returned: 0 in 0.462s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:16 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-73c86acc-36e2-4cba-b4ae-410866ffd9df tempest-VolumesActionsTest-821311522 None] <== create_volume: return (1356ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:53:16 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-73c86acc-36e2-4cba-b4ae-410866ffd9df tempest-VolumesActionsTest-821311522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.360s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:53:16 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-73c86acc-36e2-4cba-b4ae-410866ffd9df tempest-VolumesActionsTest-821311522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b8b83cc-8afd-403a-ad1b-a970a3d843e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8d16ebb-949d-47b3-8a60-5d6a2620305f', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:16 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-73c86acc-36e2-4cba-b4ae-410866ffd9df tempest-VolumesActionsTest-821311522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bef886ce-2738-4414-9dbc-615191712cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:16 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-73c86acc-36e2-4cba-b4ae-410866ffd9df tempest-VolumesActionsTest-821311522 None] Volume volume-d8d16ebb-949d-47b3-8a60-5d6a2620305f (d8d16ebb-949d-47b3-8a60-5d6a2620305f): created successfully Sep 25 11:53:16 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-73c86acc-36e2-4cba-b4ae-410866ffd9df tempest-VolumesActionsTest-821311522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bef886ce-2738-4414-9dbc-615191712cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:16 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-73c86acc-36e2-4cba-b4ae-410866ffd9df tempest-VolumesActionsTest-821311522 None] Flow 'volume_create_manager' (83484ac0-4c6b-433c-8b94-59c13a99e210) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:53:16 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-73c86acc-36e2-4cba-b4ae-410866ffd9df tempest-VolumesActionsTest-821311522 None] Created volume successfully. Sep 25 11:53:16 devstack sudo[100405]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:16 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-eb58dc94-dc1c-46b3-b6a6-17718d71dd90 tempest-VolumesSnapshotTestJSON-1438674217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a17798fe-bd34-43c1-ad6c-6ecce848e441" returned: 0 in 0.644s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:16 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-eb58dc94-dc1c-46b3-b6a6-17718d71dd90 tempest-VolumesSnapshotTestJSON-1438674217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a17798fe-bd34-43c1-ad6c-6ecce848e441 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:16 devstack sudo[100413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a17798fe-bd34-43c1-ad6c-6ecce848e441 Sep 25 11:53:17 devstack sudo[100413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:17 devstack sudo[100413]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:17 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-eb58dc94-dc1c-46b3-b6a6-17718d71dd90 tempest-VolumesSnapshotTestJSON-1438674217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a17798fe-bd34-43c1-ad6c-6ecce848e441" returned: 0 in 0.335s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:17 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-eb58dc94-dc1c-46b3-b6a6-17718d71dd90 tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "cinder-quobyte-a17798fe-bd34-43c1-ad6c-6ecce848e441" released by "delete_volume" :: held 1.069s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:53:17 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-eb58dc94-dc1c-46b3-b6a6-17718d71dd90 tempest-VolumesSnapshotTestJSON-1438674217 None] Created reservations ['396a7510-669d-46ea-898d-740f576a2af1', 'ef9b9c8c-84c0-4285-8cd0-797cae5d9e42', 'c6a5d344-e6a8-4a4b-9554-5985d3de4217', '63622ac6-fe9b-4896-810d-4d7c228aeda3'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:53:17 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-eb58dc94-dc1c-46b3-b6a6-17718d71dd90 tempest-VolumesSnapshotTestJSON-1438674217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:53:17 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-eb58dc94-dc1c-46b3-b6a6-17718d71dd90 tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:53:17 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-eb58dc94-dc1c-46b3-b6a6-17718d71dd90 tempest-VolumesSnapshotTestJSON-1438674217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:53:17 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-eb58dc94-dc1c-46b3-b6a6-17718d71dd90 tempest-VolumesSnapshotTestJSON-1438674217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:53:17 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-eb58dc94-dc1c-46b3-b6a6-17718d71dd90 tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:53:17 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-eb58dc94-dc1c-46b3-b6a6-17718d71dd90 tempest-VolumesSnapshotTestJSON-1438674217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:17 devstack sudo[100416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:53:17 devstack sudo[100416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:17 devstack sudo[100416]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:17 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-eb58dc94-dc1c-46b3-b6a6-17718d71dd90 tempest-VolumesSnapshotTestJSON-1438674217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.414s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:17 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-eb58dc94-dc1c-46b3-b6a6-17718d71dd90 tempest-VolumesSnapshotTestJSON-1438674217 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:53:17 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-eb58dc94-dc1c-46b3-b6a6-17718d71dd90 tempest-VolumesSnapshotTestJSON-1438674217 None] Deleted volume successfully. Sep 25 11:53:18 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-eb58dc94-dc1c-46b3-b6a6-17718d71dd90 tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "cinder-a17798fe-bd34-43c1-ad6c-6ecce848e441-delete_volume" released by "delete_volume" :: held 1.888s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:53:18 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-b4a1651f-e17d-4851-89b7-54fc7fc198ef tempest-VolumesSnapshotTestJSON-1438674217 None] Acquiring lock "cinder-e10029c2-5741-4917-ad97-742608c64009-delete_snapshot" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:53:18 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-b4a1651f-e17d-4851-89b7-54fc7fc198ef tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "cinder-e10029c2-5741-4917-ad97-742608c64009-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:53:18 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-b4a1651f-e17d-4851-89b7-54fc7fc198ef tempest-VolumesSnapshotTestJSON-1438674217 None] Acquiring lock "cinder-quobyte-aca30262-0e35-44c1-a5a5-1947211bbb4f" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:53:18 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-b4a1651f-e17d-4851-89b7-54fc7fc198ef tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "cinder-quobyte-aca30262-0e35-44c1-a5a5-1947211bbb4f" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:53:18 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-b4a1651f-e17d-4851-89b7-54fc7fc198ef tempest-VolumesSnapshotTestJSON-1438674217 None] Acquiring lock "cinder-quobyte-e10029c2-5741-4917-ad97-742608c64009" by "_delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:53:18 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-b4a1651f-e17d-4851-89b7-54fc7fc198ef tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "cinder-quobyte-e10029c2-5741-4917-ad97-742608c64009" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:53:18 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-b4a1651f-e17d-4851-89b7-54fc7fc198ef tempest-VolumesSnapshotTestJSON-1438674217 None] Deleting offline snapshot e10029c2-5741-4917-ad97-742608c64009 of volume aca30262-0e35-44c1-a5a5-1947211bbb4f {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:53:18 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-b4a1651f-e17d-4851-89b7-54fc7fc198ef tempest-VolumesSnapshotTestJSON-1438674217 None] snapshot_file for this snap is: volume-aca30262-0e35-44c1-a5a5-1947211bbb4f.e10029c2-5741-4917-ad97-742608c64009 {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:53:18 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-33439382-3bcf-4bc5-9ff4-8eb4871afa1f tempest-VolumesActionsTest-821311522 None] Acquiring lock "cinder-d8d16ebb-949d-47b3-8a60-5d6a2620305f-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:53:18 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d6bd7a9-2f2b-437b-a161-bbd7164928a2]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:53:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-b4a1651f-e17d-4851-89b7-54fc7fc198ef tempest-VolumesSnapshotTestJSON-1438674217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aca30262-0e35-44c1-a5a5-1947211bbb4f.e10029c2-5741-4917-ad97-742608c64009 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:18 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-33439382-3bcf-4bc5-9ff4-8eb4871afa1f tempest-VolumesActionsTest-821311522 None] Lock "cinder-d8d16ebb-949d-47b3-8a60-5d6a2620305f-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:53:18 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-33439382-3bcf-4bc5-9ff4-8eb4871afa1f tempest-VolumesActionsTest-821311522 None] Acquiring lock "cinder-quobyte-d8d16ebb-949d-47b3-8a60-5d6a2620305f" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:53:18 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-33439382-3bcf-4bc5-9ff4-8eb4871afa1f tempest-VolumesActionsTest-821311522 None] Lock "cinder-quobyte-d8d16ebb-949d-47b3-8a60-5d6a2620305f" acquired by "delete_volume" :: waited 0.025s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:53:18 devstack sudo[100419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aca30262-0e35-44c1-a5a5-1947211bbb4f.e10029c2-5741-4917-ad97-742608c64009 Sep 25 11:53:18 devstack sudo[100419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:18 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd0eb50-9ce1-4a2a-95bd-15c7dbc1dc52]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:53:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-33439382-3bcf-4bc5-9ff4-8eb4871afa1f tempest-VolumesActionsTest-821311522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-d8d16ebb-949d-47b3-8a60-5d6a2620305f {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:19 devstack sudo[100421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-d8d16ebb-949d-47b3-8a60-5d6a2620305f Sep 25 11:53:19 devstack sudo[100421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:19 devstack sudo[100419]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:19 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-b4a1651f-e17d-4851-89b7-54fc7fc198ef tempest-VolumesSnapshotTestJSON-1438674217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aca30262-0e35-44c1-a5a5-1947211bbb4f.e10029c2-5741-4917-ad97-742608c64009" returned: 0 in 0.593s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:19 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-b4a1651f-e17d-4851-89b7-54fc7fc198ef tempest-VolumesSnapshotTestJSON-1438674217 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aca30262-0e35-44c1-a5a5-1947211bbb4f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86984) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:53:19 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d73f93-06b1-4415-9373-847a82bab8f7]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:53:19 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-b4a1651f-e17d-4851-89b7-54fc7fc198ef tempest-VolumesSnapshotTestJSON-1438674217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aca30262-0e35-44c1-a5a5-1947211bbb4f {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:19 devstack sudo[100421]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:19 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-33439382-3bcf-4bc5-9ff4-8eb4871afa1f tempest-VolumesActionsTest-821311522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-d8d16ebb-949d-47b3-8a60-5d6a2620305f" returned: 0 in 0.598s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:19 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-33439382-3bcf-4bc5-9ff4-8eb4871afa1f tempest-VolumesActionsTest-821311522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-d8d16ebb-949d-47b3-8a60-5d6a2620305f {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:19 devstack sudo[100426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aca30262-0e35-44c1-a5a5-1947211bbb4f Sep 25 11:53:19 devstack sudo[100426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:19 devstack sudo[100430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-d8d16ebb-949d-47b3-8a60-5d6a2620305f Sep 25 11:53:19 devstack sudo[100430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:20 devstack sudo[100430]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-33439382-3bcf-4bc5-9ff4-8eb4871afa1f tempest-VolumesActionsTest-821311522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-d8d16ebb-949d-47b3-8a60-5d6a2620305f" returned: 0 in 0.457s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:20 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-33439382-3bcf-4bc5-9ff4-8eb4871afa1f tempest-VolumesActionsTest-821311522 None] Lock "cinder-quobyte-d8d16ebb-949d-47b3-8a60-5d6a2620305f" released by "delete_volume" :: held 1.141s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:53:20 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-33439382-3bcf-4bc5-9ff4-8eb4871afa1f tempest-VolumesActionsTest-821311522 None] Created reservations ['69a54702-83cd-427e-9861-b9fa85c65323', '60f397f0-fe26-4e67-8d1e-e406b2e51ca8', '7bbdc99a-0fc2-4548-8c27-0ea737833e96', '3d92c4b9-401f-48e7-a0e4-4aab26050f63'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:53:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-33439382-3bcf-4bc5-9ff4-8eb4871afa1f tempest-VolumesActionsTest-821311522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:53:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-33439382-3bcf-4bc5-9ff4-8eb4871afa1f tempest-VolumesActionsTest-821311522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:53:20 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-33439382-3bcf-4bc5-9ff4-8eb4871afa1f tempest-VolumesActionsTest-821311522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:53:20 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-33439382-3bcf-4bc5-9ff4-8eb4871afa1f tempest-VolumesActionsTest-821311522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:53:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-33439382-3bcf-4bc5-9ff4-8eb4871afa1f tempest-VolumesActionsTest-821311522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:53:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-33439382-3bcf-4bc5-9ff4-8eb4871afa1f tempest-VolumesActionsTest-821311522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:20 devstack sudo[100437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:53:20 devstack sudo[100437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:20 devstack sudo[100426]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-b4a1651f-e17d-4851-89b7-54fc7fc198ef tempest-VolumesSnapshotTestJSON-1438674217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aca30262-0e35-44c1-a5a5-1947211bbb4f" returned: 0 in 0.933s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-b4a1651f-e17d-4851-89b7-54fc7fc198ef tempest-VolumesSnapshotTestJSON-1438674217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aca30262-0e35-44c1-a5a5-1947211bbb4f.e10029c2-5741-4917-ad97-742608c64009 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:20 devstack sudo[100439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aca30262-0e35-44c1-a5a5-1947211bbb4f.e10029c2-5741-4917-ad97-742608c64009 Sep 25 11:53:20 devstack sudo[100439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:20 devstack sudo[100437]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-33439382-3bcf-4bc5-9ff4-8eb4871afa1f tempest-VolumesActionsTest-821311522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.384s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:20 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-33439382-3bcf-4bc5-9ff4-8eb4871afa1f tempest-VolumesActionsTest-821311522 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:53:20 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-33439382-3bcf-4bc5-9ff4-8eb4871afa1f tempest-VolumesActionsTest-821311522 None] Deleted volume successfully. Sep 25 11:53:20 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-33439382-3bcf-4bc5-9ff4-8eb4871afa1f tempest-VolumesActionsTest-821311522 None] Lock "cinder-d8d16ebb-949d-47b3-8a60-5d6a2620305f-delete_volume" released by "delete_volume" :: held 1.904s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:53:20 devstack sudo[100439]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-b4a1651f-e17d-4851-89b7-54fc7fc198ef tempest-VolumesSnapshotTestJSON-1438674217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aca30262-0e35-44c1-a5a5-1947211bbb4f.e10029c2-5741-4917-ad97-742608c64009" returned: 0 in 0.484s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-b4a1651f-e17d-4851-89b7-54fc7fc198ef tempest-VolumesSnapshotTestJSON-1438674217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aca30262-0e35-44c1-a5a5-1947211bbb4f.e10029c2-5741-4917-ad97-742608c64009 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:20 devstack sudo[100445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aca30262-0e35-44c1-a5a5-1947211bbb4f.e10029c2-5741-4917-ad97-742608c64009 Sep 25 11:53:20 devstack sudo[100445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:21 devstack sudo[100445]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:21 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-b4a1651f-e17d-4851-89b7-54fc7fc198ef tempest-VolumesSnapshotTestJSON-1438674217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aca30262-0e35-44c1-a5a5-1947211bbb4f.e10029c2-5741-4917-ad97-742608c64009" returned: 0 in 0.332s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:21 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-b4a1651f-e17d-4851-89b7-54fc7fc198ef tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "cinder-quobyte-e10029c2-5741-4917-ad97-742608c64009" released by "_delete_snapshot" :: held 2.547s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:53:21 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-b4a1651f-e17d-4851-89b7-54fc7fc198ef tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "cinder-quobyte-aca30262-0e35-44c1-a5a5-1947211bbb4f" released by "delete_snapshot" :: held 2.602s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:53:21 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-b4a1651f-e17d-4851-89b7-54fc7fc198ef tempest-VolumesSnapshotTestJSON-1438674217 None] Created reservations ['32ec7c42-a8e7-48f2-b885-75c93584bc5a', '1e396804-a48c-4a61-97a2-2ae8229846e0', '1460ce28-7487-4d06-bf34-5ea7261fe8c8', 'c2e656ad-3397-4dc1-b4e1-9235d2336e19'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:53:21 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-b4a1651f-e17d-4851-89b7-54fc7fc198ef tempest-VolumesSnapshotTestJSON-1438674217 None] Delete snapshot completed successfully. Sep 25 11:53:21 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-b4a1651f-e17d-4851-89b7-54fc7fc198ef tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "cinder-e10029c2-5741-4917-ad97-742608c64009-delete_snapshot" released by "delete_snapshot" :: held 2.867s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:53:22 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-42c3a5a0-3b85-47d2-8dce-16fee07ca1dd tempest-VolumesSnapshotTestJSON-1438674217 None] Acquiring lock "cinder-aca30262-0e35-44c1-a5a5-1947211bbb4f-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:53:22 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-42c3a5a0-3b85-47d2-8dce-16fee07ca1dd tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "cinder-aca30262-0e35-44c1-a5a5-1947211bbb4f-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:53:22 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-42c3a5a0-3b85-47d2-8dce-16fee07ca1dd tempest-VolumesSnapshotTestJSON-1438674217 None] Acquiring lock "cinder-quobyte-aca30262-0e35-44c1-a5a5-1947211bbb4f" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:53:22 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-42c3a5a0-3b85-47d2-8dce-16fee07ca1dd tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "cinder-quobyte-aca30262-0e35-44c1-a5a5-1947211bbb4f" acquired by "delete_volume" :: waited 0.022s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:53:22 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b9a5dd-1cdf-4037-9cc4-c393182aac3d]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:53:22 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-42c3a5a0-3b85-47d2-8dce-16fee07ca1dd tempest-VolumesSnapshotTestJSON-1438674217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aca30262-0e35-44c1-a5a5-1947211bbb4f {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:22 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a53a1f9-8bd0-41f9-927d-ae45efb1471f tempest-CreateVolumesFromSnapshotTest-2139566359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:53:22 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8a53a1f9-8bd0-41f9-927d-ae45efb1471f tempest-CreateVolumesFromSnapshotTest-2139566359 None] Flow 'volume_create_manager' (9db4ed19-67d6-436a-8324-5db1559355ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:53:22 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8a53a1f9-8bd0-41f9-927d-ae45efb1471f tempest-CreateVolumesFromSnapshotTest-2139566359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b7f16b9-362d-4520-8789-aa8019e8f199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:22 devstack sudo[100448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aca30262-0e35-44c1-a5a5-1947211bbb4f Sep 25 11:53:22 devstack sudo[100448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:22 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8a53a1f9-8bd0-41f9-927d-ae45efb1471f tempest-CreateVolumesFromSnapshotTest-2139566359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b7f16b9-362d-4520-8789-aa8019e8f199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:53:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1528062023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f38f056-1938-4978-9ba6-ee75d0319555,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fb06e9d002d47088d210f9f53c135ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:53:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:53:22Z,use_quota=True,user_id='888a05a2888f4e1b840303fe62e8a14c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:22 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8a53a1f9-8bd0-41f9-927d-ae45efb1471f tempest-CreateVolumesFromSnapshotTest-2139566359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44e455c3-2c79-44e2-aa2d-2443df49b89f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:22 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8a53a1f9-8bd0-41f9-927d-ae45efb1471f tempest-CreateVolumesFromSnapshotTest-2139566359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44e455c3-2c79-44e2-aa2d-2443df49b89f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:22 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8a53a1f9-8bd0-41f9-927d-ae45efb1471f tempest-CreateVolumesFromSnapshotTest-2139566359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e716fafc-5740-4ed3-acc6-a3a25787f07c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:22 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8a53a1f9-8bd0-41f9-927d-ae45efb1471f tempest-CreateVolumesFromSnapshotTest-2139566359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e716fafc-5740-4ed3-acc6-a3a25787f07c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f38f056-1938-4978-9ba6-ee75d0319555', 'volume_name': 'volume-0f38f056-1938-4978-9ba6-ee75d0319555', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:22 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8a53a1f9-8bd0-41f9-927d-ae45efb1471f tempest-CreateVolumesFromSnapshotTest-2139566359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (355ebfb4-9c4b-4773-9794-5722e2209d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:22 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8a53a1f9-8bd0-41f9-927d-ae45efb1471f tempest-CreateVolumesFromSnapshotTest-2139566359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (355ebfb4-9c4b-4773-9794-5722e2209d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:22 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8a53a1f9-8bd0-41f9-927d-ae45efb1471f tempest-CreateVolumesFromSnapshotTest-2139566359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (881b4f71-3ca8-4b92-aff6-297896cb1d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:22 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-8a53a1f9-8bd0-41f9-927d-ae45efb1471f tempest-CreateVolumesFromSnapshotTest-2139566359 None] Volume 0f38f056-1938-4978-9ba6-ee75d0319555: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f38f056-1938-4978-9ba6-ee75d0319555', 'volume_size': 1} Sep 25 11:53:22 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-8a53a1f9-8bd0-41f9-927d-ae45efb1471f tempest-CreateVolumesFromSnapshotTest-2139566359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:53:22 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-8a53a1f9-8bd0-41f9-927d-ae45efb1471f tempest-CreateVolumesFromSnapshotTest-2139566359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:53:22 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-8a53a1f9-8bd0-41f9-927d-ae45efb1471f tempest-CreateVolumesFromSnapshotTest-2139566359 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:53:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1528062023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f38f056-1938-4978-9ba6-ee75d0319555,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fb06e9d002d47088d210f9f53c135ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:53:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:53:22Z,use_quota=True,user_id='888a05a2888f4e1b840303fe62e8a14c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:53:22 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-8a53a1f9-8bd0-41f9-927d-ae45efb1471f tempest-CreateVolumesFromSnapshotTest-2139566359 None] Creating volume 0f38f056-1938-4978-9ba6-ee75d0319555 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:53:22 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-8a53a1f9-8bd0-41f9-927d-ae45efb1471f tempest-CreateVolumesFromSnapshotTest-2139566359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:53:22 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-8a53a1f9-8bd0-41f9-927d-ae45efb1471f tempest-CreateVolumesFromSnapshotTest-2139566359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:53:22 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-8a53a1f9-8bd0-41f9-927d-ae45efb1471f tempest-CreateVolumesFromSnapshotTest-2139566359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:53:22 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-8a53a1f9-8bd0-41f9-927d-ae45efb1471f tempest-CreateVolumesFromSnapshotTest-2139566359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:53:22 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-8a53a1f9-8bd0-41f9-927d-ae45efb1471f tempest-CreateVolumesFromSnapshotTest-2139566359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:53:22 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-8a53a1f9-8bd0-41f9-927d-ae45efb1471f tempest-CreateVolumesFromSnapshotTest-2139566359 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:53:22 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-8a53a1f9-8bd0-41f9-927d-ae45efb1471f tempest-CreateVolumesFromSnapshotTest-2139566359 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:53:22 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8a53a1f9-8bd0-41f9-927d-ae45efb1471f tempest-CreateVolumesFromSnapshotTest-2139566359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0f38f056-1938-4978-9ba6-ee75d0319555 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:22 devstack sudo[100450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0f38f056-1938-4978-9ba6-ee75d0319555 1073741824 Sep 25 11:53:22 devstack sudo[100450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:22 devstack sudo[100448]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:22 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-42c3a5a0-3b85-47d2-8dce-16fee07ca1dd tempest-VolumesSnapshotTestJSON-1438674217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aca30262-0e35-44c1-a5a5-1947211bbb4f" returned: 0 in 0.600s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:22 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-42c3a5a0-3b85-47d2-8dce-16fee07ca1dd tempest-VolumesSnapshotTestJSON-1438674217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aca30262-0e35-44c1-a5a5-1947211bbb4f {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:22 devstack sudo[100456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aca30262-0e35-44c1-a5a5-1947211bbb4f Sep 25 11:53:22 devstack sudo[100456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:23 devstack sudo[100450]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:23 devstack sudo[100456]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8a53a1f9-8bd0-41f9-927d-ae45efb1471f tempest-CreateVolumesFromSnapshotTest-2139566359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0f38f056-1938-4978-9ba6-ee75d0319555 1073741824" returned: 0 in 0.565s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-42c3a5a0-3b85-47d2-8dce-16fee07ca1dd tempest-VolumesSnapshotTestJSON-1438674217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aca30262-0e35-44c1-a5a5-1947211bbb4f" returned: 0 in 0.356s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:23 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-42c3a5a0-3b85-47d2-8dce-16fee07ca1dd tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "cinder-quobyte-aca30262-0e35-44c1-a5a5-1947211bbb4f" released by "delete_volume" :: held 1.082s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:53:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8a53a1f9-8bd0-41f9-927d-ae45efb1471f tempest-CreateVolumesFromSnapshotTest-2139566359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0f38f056-1938-4978-9ba6-ee75d0319555 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:23 devstack sudo[100463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0f38f056-1938-4978-9ba6-ee75d0319555 Sep 25 11:53:23 devstack sudo[100463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:23 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-42c3a5a0-3b85-47d2-8dce-16fee07ca1dd tempest-VolumesSnapshotTestJSON-1438674217 None] Created reservations ['c9848679-cc85-4f52-95bb-54538484643e', '65fa5516-1831-4425-a2eb-308dc9deaf1c', '46394e12-1714-4a5a-b77c-38925b1c965f', 'a0420e6b-3ed2-4464-b6e7-2a593f5e0cab'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:53:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-42c3a5a0-3b85-47d2-8dce-16fee07ca1dd tempest-VolumesSnapshotTestJSON-1438674217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:53:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-42c3a5a0-3b85-47d2-8dce-16fee07ca1dd tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:53:23 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-42c3a5a0-3b85-47d2-8dce-16fee07ca1dd tempest-VolumesSnapshotTestJSON-1438674217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:53:23 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-42c3a5a0-3b85-47d2-8dce-16fee07ca1dd tempest-VolumesSnapshotTestJSON-1438674217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:53:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-42c3a5a0-3b85-47d2-8dce-16fee07ca1dd tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:53:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-42c3a5a0-3b85-47d2-8dce-16fee07ca1dd tempest-VolumesSnapshotTestJSON-1438674217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:23 devstack sudo[100466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:53:23 devstack sudo[100466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:23 devstack sudo[100463]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8a53a1f9-8bd0-41f9-927d-ae45efb1471f tempest-CreateVolumesFromSnapshotTest-2139566359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0f38f056-1938-4978-9ba6-ee75d0319555" returned: 0 in 0.390s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:23 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-8a53a1f9-8bd0-41f9-927d-ae45efb1471f tempest-CreateVolumesFromSnapshotTest-2139566359 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:53:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-8a53a1f9-8bd0-41f9-927d-ae45efb1471f tempest-CreateVolumesFromSnapshotTest-2139566359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:53:23 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8a53a1f9-8bd0-41f9-927d-ae45efb1471f tempest-CreateVolumesFromSnapshotTest-2139566359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (881b4f71-3ca8-4b92-aff6-297896cb1d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f38f056-1938-4978-9ba6-ee75d0319555', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:23 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8a53a1f9-8bd0-41f9-927d-ae45efb1471f tempest-CreateVolumesFromSnapshotTest-2139566359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ff3ee50-6555-4c41-8fae-96fbb10953a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:23 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-8a53a1f9-8bd0-41f9-927d-ae45efb1471f tempest-CreateVolumesFromSnapshotTest-2139566359 None] Volume volume-0f38f056-1938-4978-9ba6-ee75d0319555 (0f38f056-1938-4978-9ba6-ee75d0319555): created successfully Sep 25 11:53:23 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8a53a1f9-8bd0-41f9-927d-ae45efb1471f tempest-CreateVolumesFromSnapshotTest-2139566359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ff3ee50-6555-4c41-8fae-96fbb10953a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:23 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8a53a1f9-8bd0-41f9-927d-ae45efb1471f tempest-CreateVolumesFromSnapshotTest-2139566359 None] Flow 'volume_create_manager' (9db4ed19-67d6-436a-8324-5db1559355ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:53:23 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-8a53a1f9-8bd0-41f9-927d-ae45efb1471f tempest-CreateVolumesFromSnapshotTest-2139566359 None] Created volume successfully. Sep 25 11:53:23 devstack sudo[100466]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-42c3a5a0-3b85-47d2-8dce-16fee07ca1dd tempest-VolumesSnapshotTestJSON-1438674217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.398s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:23 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-42c3a5a0-3b85-47d2-8dce-16fee07ca1dd tempest-VolumesSnapshotTestJSON-1438674217 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:53:23 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-42c3a5a0-3b85-47d2-8dce-16fee07ca1dd tempest-VolumesSnapshotTestJSON-1438674217 None] Deleted volume successfully. Sep 25 11:53:23 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-42c3a5a0-3b85-47d2-8dce-16fee07ca1dd tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "cinder-aca30262-0e35-44c1-a5a5-1947211bbb4f-delete_volume" released by "delete_volume" :: held 1.841s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:53:24 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-0c4799a3-905f-4dbc-b3ae-c486a86e2aa0 tempest-VolumesSnapshotTestJSON-1438674217 None] Acquiring lock "cinder-2735b2c5-5134-45a1-9304-38b95c375c0c-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:53:24 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-0c4799a3-905f-4dbc-b3ae-c486a86e2aa0 tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "cinder-2735b2c5-5134-45a1-9304-38b95c375c0c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:53:24 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-0c4799a3-905f-4dbc-b3ae-c486a86e2aa0 tempest-VolumesSnapshotTestJSON-1438674217 None] Acquiring lock "cinder-quobyte-2735b2c5-5134-45a1-9304-38b95c375c0c" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:53:24 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-0c4799a3-905f-4dbc-b3ae-c486a86e2aa0 tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "cinder-quobyte-2735b2c5-5134-45a1-9304-38b95c375c0c" acquired by "delete_volume" :: waited 0.024s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:53:24 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[4818bc24-244b-49f6-8f95-a275bf45190b]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:53:24 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-0c4799a3-905f-4dbc-b3ae-c486a86e2aa0 tempest-VolumesSnapshotTestJSON-1438674217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2735b2c5-5134-45a1-9304-38b95c375c0c {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:24 devstack sudo[100472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2735b2c5-5134-45a1-9304-38b95c375c0c Sep 25 11:53:24 devstack sudo[100472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:25 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f935f6f6-73be-4462-af82-e629020489d6 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:53:25 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f935f6f6-73be-4462-af82-e629020489d6 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:53:25 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-f935f6f6-73be-4462-af82-e629020489d6 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Creating offline snapshot fade9ef5-9914-4acb-89c9-2fd959da6ace of volume 0f38f056-1938-4978-9ba6-ee75d0319555 {{(pid=86984) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:53:25 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff5d9382-8582-4522-b2ae-538211ebc487]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:53:25 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f935f6f6-73be-4462-af82-e629020489d6 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0f38f056-1938-4978-9ba6-ee75d0319555 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:25 devstack sudo[100474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0f38f056-1938-4978-9ba6-ee75d0319555 Sep 25 11:53:25 devstack sudo[100474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:25 devstack sudo[100472]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:25 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-0c4799a3-905f-4dbc-b3ae-c486a86e2aa0 tempest-VolumesSnapshotTestJSON-1438674217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2735b2c5-5134-45a1-9304-38b95c375c0c" returned: 0 in 0.678s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:25 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-0c4799a3-905f-4dbc-b3ae-c486a86e2aa0 tempest-VolumesSnapshotTestJSON-1438674217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2735b2c5-5134-45a1-9304-38b95c375c0c {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:25 devstack sudo[100479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2735b2c5-5134-45a1-9304-38b95c375c0c Sep 25 11:53:25 devstack sudo[100479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:25 devstack sudo[100474]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:25 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f935f6f6-73be-4462-af82-e629020489d6 tempest-CreateVolumesFromSnapshotTest-2139566359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0f38f056-1938-4978-9ba6-ee75d0319555" returned: 0 in 0.639s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:25 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f935f6f6-73be-4462-af82-e629020489d6 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0f38f056-1938-4978-9ba6-ee75d0319555,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0f38f056-1938-4978-9ba6-ee75d0319555.fade9ef5-9914-4acb-89c9-2fd959da6ace 1G {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:25 devstack sudo[100485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0f38f056-1938-4978-9ba6-ee75d0319555,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0f38f056-1938-4978-9ba6-ee75d0319555.fade9ef5-9914-4acb-89c9-2fd959da6ace 1G Sep 25 11:53:25 devstack sudo[100485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:25 devstack sudo[100479]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:25 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-0c4799a3-905f-4dbc-b3ae-c486a86e2aa0 tempest-VolumesSnapshotTestJSON-1438674217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2735b2c5-5134-45a1-9304-38b95c375c0c" returned: 0 in 0.471s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:25 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-0c4799a3-905f-4dbc-b3ae-c486a86e2aa0 tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "cinder-quobyte-2735b2c5-5134-45a1-9304-38b95c375c0c" released by "delete_volume" :: held 1.280s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:53:25 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-0c4799a3-905f-4dbc-b3ae-c486a86e2aa0 tempest-VolumesSnapshotTestJSON-1438674217 None] Created reservations ['9d18d890-cd59-4a6b-93d1-4c47df5cb254', '4c2d7358-ec92-4b29-b909-3f5c4c465cb2', '5ea70835-7fd0-4f9b-8e4a-005837903c49', '82d766e9-6bb8-47d6-82b3-815256f31bd4'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:53:26 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-0c4799a3-905f-4dbc-b3ae-c486a86e2aa0 tempest-VolumesSnapshotTestJSON-1438674217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:53:26 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-0c4799a3-905f-4dbc-b3ae-c486a86e2aa0 tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:53:26 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-0c4799a3-905f-4dbc-b3ae-c486a86e2aa0 tempest-VolumesSnapshotTestJSON-1438674217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:53:26 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-0c4799a3-905f-4dbc-b3ae-c486a86e2aa0 tempest-VolumesSnapshotTestJSON-1438674217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:53:26 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-0c4799a3-905f-4dbc-b3ae-c486a86e2aa0 tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:53:26 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-0c4799a3-905f-4dbc-b3ae-c486a86e2aa0 tempest-VolumesSnapshotTestJSON-1438674217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:26 devstack sudo[100491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:53:26 devstack sudo[100491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:26 devstack sudo[100485]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:26 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f935f6f6-73be-4462-af82-e629020489d6 tempest-CreateVolumesFromSnapshotTest-2139566359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0f38f056-1938-4978-9ba6-ee75d0319555,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0f38f056-1938-4978-9ba6-ee75d0319555.fade9ef5-9914-4acb-89c9-2fd959da6ace 1G" returned: 0 in 0.653s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:26 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f935f6f6-73be-4462-af82-e629020489d6 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f38f056-1938-4978-9ba6-ee75d0319555 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0f38f056-1938-4978-9ba6-ee75d0319555.fade9ef5-9914-4acb-89c9-2fd959da6ace {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:26 devstack sudo[100493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f38f056-1938-4978-9ba6-ee75d0319555 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0f38f056-1938-4978-9ba6-ee75d0319555.fade9ef5-9914-4acb-89c9-2fd959da6ace Sep 25 11:53:26 devstack sudo[100493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:26 devstack sudo[100491]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:26 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-0c4799a3-905f-4dbc-b3ae-c486a86e2aa0 tempest-VolumesSnapshotTestJSON-1438674217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.451s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:26 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-0c4799a3-905f-4dbc-b3ae-c486a86e2aa0 tempest-VolumesSnapshotTestJSON-1438674217 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:53:26 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-0c4799a3-905f-4dbc-b3ae-c486a86e2aa0 tempest-VolumesSnapshotTestJSON-1438674217 None] Deleted volume successfully. Sep 25 11:53:26 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-0c4799a3-905f-4dbc-b3ae-c486a86e2aa0 tempest-VolumesSnapshotTestJSON-1438674217 None] Lock "cinder-2735b2c5-5134-45a1-9304-38b95c375c0c-delete_volume" released by "delete_volume" :: held 2.234s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:53:26 devstack sudo[100493]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:26 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f935f6f6-73be-4462-af82-e629020489d6 tempest-CreateVolumesFromSnapshotTest-2139566359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f38f056-1938-4978-9ba6-ee75d0319555 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0f38f056-1938-4978-9ba6-ee75d0319555.fade9ef5-9914-4acb-89c9-2fd959da6ace" returned: 0 in 0.600s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:26 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-f935f6f6-73be-4462-af82-e629020489d6 tempest-CreateVolumesFromSnapshotTest-2139566359 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0f38f056-1938-4978-9ba6-ee75d0319555.fade9ef5-9914-4acb-89c9-2fd959da6ace is being set with open permissions: ugo+rw Sep 25 11:53:26 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f935f6f6-73be-4462-af82-e629020489d6 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0f38f056-1938-4978-9ba6-ee75d0319555.fade9ef5-9914-4acb-89c9-2fd959da6ace {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:27 devstack sudo[100500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0f38f056-1938-4978-9ba6-ee75d0319555.fade9ef5-9914-4acb-89c9-2fd959da6ace Sep 25 11:53:27 devstack sudo[100500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:27 devstack sudo[100500]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:27 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f935f6f6-73be-4462-af82-e629020489d6 tempest-CreateVolumesFromSnapshotTest-2139566359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0f38f056-1938-4978-9ba6-ee75d0319555.fade9ef5-9914-4acb-89c9-2fd959da6ace" returned: 0 in 0.414s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:27 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f935f6f6-73be-4462-af82-e629020489d6 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0f38f056-1938-4978-9ba6-ee75d0319555.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:27 devstack sudo[100503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0f38f056-1938-4978-9ba6-ee75d0319555.info Sep 25 11:53:27 devstack sudo[100503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:27 devstack sudo[100503]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:27 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f935f6f6-73be-4462-af82-e629020489d6 tempest-CreateVolumesFromSnapshotTest-2139566359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0f38f056-1938-4978-9ba6-ee75d0319555.info" returned: 0 in 0.420s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:27 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-f935f6f6-73be-4462-af82-e629020489d6 tempest-CreateVolumesFromSnapshotTest-2139566359 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0f38f056-1938-4978-9ba6-ee75d0319555.info is being set with open permissions: ugo+rw Sep 25 11:53:27 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f935f6f6-73be-4462-af82-e629020489d6 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0f38f056-1938-4978-9ba6-ee75d0319555.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:27 devstack sudo[100507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0f38f056-1938-4978-9ba6-ee75d0319555.info Sep 25 11:53:27 devstack sudo[100507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:28 devstack sudo[100507]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:28 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f935f6f6-73be-4462-af82-e629020489d6 tempest-CreateVolumesFromSnapshotTest-2139566359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0f38f056-1938-4978-9ba6-ee75d0319555.info" returned: 0 in 0.414s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:28 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f935f6f6-73be-4462-af82-e629020489d6 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.291s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:53:28 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-f935f6f6-73be-4462-af82-e629020489d6 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Create snapshot completed successfully Sep 25 11:53:30 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-b43aeab7-de4b-4c00-a23e-2389defb7402 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:53:30 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b43aeab7-de4b-4c00-a23e-2389defb7402 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Flow 'volume_create_manager' (dc4210cb-30c8-4f72-b540-dcb35e18b625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:53:30 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b43aeab7-de4b-4c00-a23e-2389defb7402 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3847da7-ff7b-465c-b3e8-666e74dc1455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:30 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b43aeab7-de4b-4c00-a23e-2389defb7402 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3847da7-ff7b-465c-b3e8-666e74dc1455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:53:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-636448222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41dec876-2389-48ac-9944-6d694cff8adb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fb06e9d002d47088d210f9f53c135ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:53:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:53:30Z,use_quota=True,user_id='888a05a2888f4e1b840303fe62e8a14c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:30 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b43aeab7-de4b-4c00-a23e-2389defb7402 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff825173-0c0f-406c-bde7-98e00334163f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:30 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b43aeab7-de4b-4c00-a23e-2389defb7402 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff825173-0c0f-406c-bde7-98e00334163f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:30 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b43aeab7-de4b-4c00-a23e-2389defb7402 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aacf4075-2fd1-4602-8eff-e99af921deab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:30 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b43aeab7-de4b-4c00-a23e-2389defb7402 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aacf4075-2fd1-4602-8eff-e99af921deab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41dec876-2389-48ac-9944-6d694cff8adb', 'volume_name': 'volume-41dec876-2389-48ac-9944-6d694cff8adb', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:30 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b43aeab7-de4b-4c00-a23e-2389defb7402 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eeed527-e2e7-4b5e-9c46-56340c412d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:30 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b43aeab7-de4b-4c00-a23e-2389defb7402 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eeed527-e2e7-4b5e-9c46-56340c412d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:30 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b43aeab7-de4b-4c00-a23e-2389defb7402 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dda666a-6311-4fa8-aa7f-ada6b9750d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:30 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-b43aeab7-de4b-4c00-a23e-2389defb7402 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Volume 41dec876-2389-48ac-9944-6d694cff8adb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41dec876-2389-48ac-9944-6d694cff8adb', 'volume_size': 1} Sep 25 11:53:30 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-b43aeab7-de4b-4c00-a23e-2389defb7402 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:53:30 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-b43aeab7-de4b-4c00-a23e-2389defb7402 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:53:30 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-b43aeab7-de4b-4c00-a23e-2389defb7402 tempest-CreateVolumesFromSnapshotTest-2139566359 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:53:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-636448222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41dec876-2389-48ac-9944-6d694cff8adb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fb06e9d002d47088d210f9f53c135ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:53:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:53:30Z,use_quota=True,user_id='888a05a2888f4e1b840303fe62e8a14c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:53:30 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-b43aeab7-de4b-4c00-a23e-2389defb7402 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Creating volume 41dec876-2389-48ac-9944-6d694cff8adb {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:53:30 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-b43aeab7-de4b-4c00-a23e-2389defb7402 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:53:30 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-b43aeab7-de4b-4c00-a23e-2389defb7402 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:53:30 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-b43aeab7-de4b-4c00-a23e-2389defb7402 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:53:30 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-b43aeab7-de4b-4c00-a23e-2389defb7402 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:53:30 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-b43aeab7-de4b-4c00-a23e-2389defb7402 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:53:30 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-b43aeab7-de4b-4c00-a23e-2389defb7402 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:53:30 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-b43aeab7-de4b-4c00-a23e-2389defb7402 tempest-CreateVolumesFromSnapshotTest-2139566359 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:53:30 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-b43aeab7-de4b-4c00-a23e-2389defb7402 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-41dec876-2389-48ac-9944-6d694cff8adb 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:30 devstack sudo[100514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-41dec876-2389-48ac-9944-6d694cff8adb 1073741824 Sep 25 11:53:30 devstack sudo[100514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:30 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-62aa3b85-611d-4cf2-8883-407723215838 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:53:30 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-62aa3b85-611d-4cf2-8883-407723215838 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Flow 'volume_create_manager' (0e3cfd1e-3d0a-4af1-b3cc-7192e9fc6c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:53:30 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-62aa3b85-611d-4cf2-8883-407723215838 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a56fa887-2b06-410e-beef-80c972aab9e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:30 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-62aa3b85-611d-4cf2-8883-407723215838 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a56fa887-2b06-410e-beef-80c972aab9e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:53:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1561169434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd7a2a5b-929c-43e6-ae93-5b8a21748b08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fb06e9d002d47088d210f9f53c135ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:53:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:53:30Z,use_quota=True,user_id='888a05a2888f4e1b840303fe62e8a14c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:30 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-62aa3b85-611d-4cf2-8883-407723215838 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3de1f4de-9322-40d4-9ae9-acd015794997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:30 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-62aa3b85-611d-4cf2-8883-407723215838 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3de1f4de-9322-40d4-9ae9-acd015794997) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:30 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-62aa3b85-611d-4cf2-8883-407723215838 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cb26746-b6c9-4e6e-a621-a38086ef437f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:30 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-62aa3b85-611d-4cf2-8883-407723215838 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cb26746-b6c9-4e6e-a621-a38086ef437f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd7a2a5b-929c-43e6-ae93-5b8a21748b08', 'volume_name': 'volume-bd7a2a5b-929c-43e6-ae93-5b8a21748b08', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:30 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-62aa3b85-611d-4cf2-8883-407723215838 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ec21ef2-c92e-4555-8da8-65595088191d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:30 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-62aa3b85-611d-4cf2-8883-407723215838 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ec21ef2-c92e-4555-8da8-65595088191d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:30 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-62aa3b85-611d-4cf2-8883-407723215838 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67bc1ab0-c558-41e7-851c-bd5361cac47c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:30 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-62aa3b85-611d-4cf2-8883-407723215838 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Volume bd7a2a5b-929c-43e6-ae93-5b8a21748b08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd7a2a5b-929c-43e6-ae93-5b8a21748b08', 'volume_size': 1} Sep 25 11:53:30 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-62aa3b85-611d-4cf2-8883-407723215838 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:53:31 devstack sudo[100514]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:31 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-b43aeab7-de4b-4c00-a23e-2389defb7402 tempest-CreateVolumesFromSnapshotTest-2139566359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-41dec876-2389-48ac-9944-6d694cff8adb 1073741824" returned: 0 in 1.043s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:31 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-efe6a234-b6b0-439b-85c3-b1e2e5ca57a8 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:53:31 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-efe6a234-b6b0-439b-85c3-b1e2e5ca57a8 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Flow 'volume_create_manager' (d94b6338-006e-4460-be9e-9a5a81dd2796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:53:31 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-efe6a234-b6b0-439b-85c3-b1e2e5ca57a8 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbb6e679-c11c-43eb-8b71-85e963ecedad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:31 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-efe6a234-b6b0-439b-85c3-b1e2e5ca57a8 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbb6e679-c11c-43eb-8b71-85e963ecedad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:53:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1744392822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a60e7fac-b3af-415e-925b-7c75677b4d9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fb06e9d002d47088d210f9f53c135ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:53:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:53:31Z,use_quota=True,user_id='888a05a2888f4e1b840303fe62e8a14c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:31 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-efe6a234-b6b0-439b-85c3-b1e2e5ca57a8 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ae6bf93-11b9-4d67-a1ac-8a718f919ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:31 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-efe6a234-b6b0-439b-85c3-b1e2e5ca57a8 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ae6bf93-11b9-4d67-a1ac-8a718f919ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:31 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-efe6a234-b6b0-439b-85c3-b1e2e5ca57a8 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1125e1d3-e0a8-4921-b989-b0bb59c3e893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:31 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-efe6a234-b6b0-439b-85c3-b1e2e5ca57a8 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1125e1d3-e0a8-4921-b989-b0bb59c3e893) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a60e7fac-b3af-415e-925b-7c75677b4d9b', 'volume_name': 'volume-a60e7fac-b3af-415e-925b-7c75677b4d9b', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:31 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-efe6a234-b6b0-439b-85c3-b1e2e5ca57a8 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d2db84b-f472-4e54-9041-c9329384e4dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:31 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-efe6a234-b6b0-439b-85c3-b1e2e5ca57a8 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d2db84b-f472-4e54-9041-c9329384e4dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:31 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-efe6a234-b6b0-439b-85c3-b1e2e5ca57a8 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb3f3d35-1ac5-4d55-8c35-962adff8542a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:31 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-efe6a234-b6b0-439b-85c3-b1e2e5ca57a8 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Volume a60e7fac-b3af-415e-925b-7c75677b4d9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a60e7fac-b3af-415e-925b-7c75677b4d9b', 'volume_size': 1} Sep 25 11:53:31 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-efe6a234-b6b0-439b-85c3-b1e2e5ca57a8 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:53:31 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-b43aeab7-de4b-4c00-a23e-2389defb7402 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-41dec876-2389-48ac-9944-6d694cff8adb {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:31 devstack sudo[100520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-41dec876-2389-48ac-9944-6d694cff8adb Sep 25 11:53:31 devstack sudo[100520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:31 devstack sudo[100520]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:31 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-b43aeab7-de4b-4c00-a23e-2389defb7402 tempest-CreateVolumesFromSnapshotTest-2139566359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-41dec876-2389-48ac-9944-6d694cff8adb" returned: 0 in 0.398s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:31 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-b43aeab7-de4b-4c00-a23e-2389defb7402 tempest-CreateVolumesFromSnapshotTest-2139566359 None] <== create_volume: return (1657ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:53:31 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-b43aeab7-de4b-4c00-a23e-2389defb7402 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.661s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:53:31 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-62aa3b85-611d-4cf2-8883-407723215838 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.153s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:53:31 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-62aa3b85-611d-4cf2-8883-407723215838 tempest-CreateVolumesFromSnapshotTest-2139566359 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:53:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1561169434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd7a2a5b-929c-43e6-ae93-5b8a21748b08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fb06e9d002d47088d210f9f53c135ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:53:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:53:30Z,use_quota=True,user_id='888a05a2888f4e1b840303fe62e8a14c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:53:31 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-62aa3b85-611d-4cf2-8883-407723215838 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Creating volume bd7a2a5b-929c-43e6-ae93-5b8a21748b08 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:53:31 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-62aa3b85-611d-4cf2-8883-407723215838 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:53:31 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-62aa3b85-611d-4cf2-8883-407723215838 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:53:31 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-62aa3b85-611d-4cf2-8883-407723215838 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:53:31 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-62aa3b85-611d-4cf2-8883-407723215838 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:53:31 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-62aa3b85-611d-4cf2-8883-407723215838 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:53:31 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-62aa3b85-611d-4cf2-8883-407723215838 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:53:31 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-62aa3b85-611d-4cf2-8883-407723215838 tempest-CreateVolumesFromSnapshotTest-2139566359 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:53:31 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-62aa3b85-611d-4cf2-8883-407723215838 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bd7a2a5b-929c-43e6-ae93-5b8a21748b08 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:31 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b43aeab7-de4b-4c00-a23e-2389defb7402 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dda666a-6311-4fa8-aa7f-ada6b9750d51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41dec876-2389-48ac-9944-6d694cff8adb', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:31 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b43aeab7-de4b-4c00-a23e-2389defb7402 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9918b26-c9ff-415c-b34c-038924a56c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:31 devstack sudo[100523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bd7a2a5b-929c-43e6-ae93-5b8a21748b08 1073741824 Sep 25 11:53:31 devstack sudo[100523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:31 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-b43aeab7-de4b-4c00-a23e-2389defb7402 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Volume volume-41dec876-2389-48ac-9944-6d694cff8adb (41dec876-2389-48ac-9944-6d694cff8adb): created successfully Sep 25 11:53:31 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b43aeab7-de4b-4c00-a23e-2389defb7402 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9918b26-c9ff-415c-b34c-038924a56c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:31 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b43aeab7-de4b-4c00-a23e-2389defb7402 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Flow 'volume_create_manager' (dc4210cb-30c8-4f72-b540-dcb35e18b625) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:53:32 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea9c7acd-184c-4e31-8321-04d6c4e6b679 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:53:32 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ea9c7acd-184c-4e31-8321-04d6c4e6b679 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Flow 'volume_create_manager' (8cabb3eb-803d-4a57-8671-8b643233a01c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:53:32 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ea9c7acd-184c-4e31-8321-04d6c4e6b679 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8eb9f212-f43c-41bd-9656-c11bd200e491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:32 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-b43aeab7-de4b-4c00-a23e-2389defb7402 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Created volume successfully. Sep 25 11:53:32 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ea9c7acd-184c-4e31-8321-04d6c4e6b679 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8eb9f212-f43c-41bd-9656-c11bd200e491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:53:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1480504849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=658576ee-0152-4bb6-8db4-5e93d3da644c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fb06e9d002d47088d210f9f53c135ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:53:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:53:32Z,use_quota=True,user_id='888a05a2888f4e1b840303fe62e8a14c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:32 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ea9c7acd-184c-4e31-8321-04d6c4e6b679 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8a35b0d-db76-4f88-8445-c03d61fa1fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:32 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ea9c7acd-184c-4e31-8321-04d6c4e6b679 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8a35b0d-db76-4f88-8445-c03d61fa1fb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:32 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ea9c7acd-184c-4e31-8321-04d6c4e6b679 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2af8ec9f-48bb-40da-ada4-7636e4505f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:32 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ea9c7acd-184c-4e31-8321-04d6c4e6b679 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2af8ec9f-48bb-40da-ada4-7636e4505f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '658576ee-0152-4bb6-8db4-5e93d3da644c', 'volume_name': 'volume-658576ee-0152-4bb6-8db4-5e93d3da644c', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:32 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ea9c7acd-184c-4e31-8321-04d6c4e6b679 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (240cf832-6651-4ffa-94e3-44bdd6aaa85b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:32 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ea9c7acd-184c-4e31-8321-04d6c4e6b679 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (240cf832-6651-4ffa-94e3-44bdd6aaa85b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:32 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ea9c7acd-184c-4e31-8321-04d6c4e6b679 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58462d36-9db0-4cc9-bffa-1425a596de7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:32 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-ea9c7acd-184c-4e31-8321-04d6c4e6b679 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Volume 658576ee-0152-4bb6-8db4-5e93d3da644c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-658576ee-0152-4bb6-8db4-5e93d3da644c', 'volume_size': 1} Sep 25 11:53:32 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-ea9c7acd-184c-4e31-8321-04d6c4e6b679 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:53:32 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3e313a2-973b-457e-b89d-5013fc632745 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:53:32 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d3e313a2-973b-457e-b89d-5013fc632745 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Flow 'volume_create_manager' (c8b04e5a-5bd6-4dda-aa28-de8e61ac4cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:53:32 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d3e313a2-973b-457e-b89d-5013fc632745 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d97bac9f-c754-44bb-8f1e-e1367fc5d43a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:32 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d3e313a2-973b-457e-b89d-5013fc632745 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d97bac9f-c754-44bb-8f1e-e1367fc5d43a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:53:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-117833558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af1f6321-bc2d-476f-859e-7f9bbda5327c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fb06e9d002d47088d210f9f53c135ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:53:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:53:33Z,use_quota=True,user_id='888a05a2888f4e1b840303fe62e8a14c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:32 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d3e313a2-973b-457e-b89d-5013fc632745 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1224b96a-1bd2-46fa-8316-bc7ac61bb908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:32 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d3e313a2-973b-457e-b89d-5013fc632745 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1224b96a-1bd2-46fa-8316-bc7ac61bb908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:32 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d3e313a2-973b-457e-b89d-5013fc632745 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f4c2a18-82c0-469c-9bb2-381b9b50641d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:32 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d3e313a2-973b-457e-b89d-5013fc632745 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f4c2a18-82c0-469c-9bb2-381b9b50641d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af1f6321-bc2d-476f-859e-7f9bbda5327c', 'volume_name': 'volume-af1f6321-bc2d-476f-859e-7f9bbda5327c', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:32 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d3e313a2-973b-457e-b89d-5013fc632745 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ae8512a-edc2-4d15-ab0d-4b64f1f2b97e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:32 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d3e313a2-973b-457e-b89d-5013fc632745 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ae8512a-edc2-4d15-ab0d-4b64f1f2b97e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:32 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d3e313a2-973b-457e-b89d-5013fc632745 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2dbd4df-ba36-4420-afea-0ddd2f746aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:32 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-d3e313a2-973b-457e-b89d-5013fc632745 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Volume af1f6321-bc2d-476f-859e-7f9bbda5327c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af1f6321-bc2d-476f-859e-7f9bbda5327c', 'volume_size': 1} Sep 25 11:53:32 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d3e313a2-973b-457e-b89d-5013fc632745 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:53:32 devstack sudo[100523]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:32 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-62aa3b85-611d-4cf2-8883-407723215838 tempest-CreateVolumesFromSnapshotTest-2139566359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bd7a2a5b-929c-43e6-ae93-5b8a21748b08 1073741824" returned: 0 in 1.005s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:32 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-62aa3b85-611d-4cf2-8883-407723215838 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bd7a2a5b-929c-43e6-ae93-5b8a21748b08 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:33 devstack sudo[100530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bd7a2a5b-929c-43e6-ae93-5b8a21748b08 Sep 25 11:53:33 devstack sudo[100530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:33 devstack sudo[100530]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:33 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-62aa3b85-611d-4cf2-8883-407723215838 tempest-CreateVolumesFromSnapshotTest-2139566359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bd7a2a5b-929c-43e6-ae93-5b8a21748b08" returned: 0 in 0.349s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:33 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-62aa3b85-611d-4cf2-8883-407723215838 tempest-CreateVolumesFromSnapshotTest-2139566359 None] <== create_volume: return (1447ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:53:33 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-62aa3b85-611d-4cf2-8883-407723215838 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.451s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:53:33 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-efe6a234-b6b0-439b-85c3-b1e2e5ca57a8 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.878s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:53:33 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-efe6a234-b6b0-439b-85c3-b1e2e5ca57a8 tempest-CreateVolumesFromSnapshotTest-2139566359 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:53:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1744392822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a60e7fac-b3af-415e-925b-7c75677b4d9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fb06e9d002d47088d210f9f53c135ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:53:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:53:31Z,use_quota=True,user_id='888a05a2888f4e1b840303fe62e8a14c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:53:33 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-efe6a234-b6b0-439b-85c3-b1e2e5ca57a8 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Creating volume a60e7fac-b3af-415e-925b-7c75677b4d9b {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:53:33 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-efe6a234-b6b0-439b-85c3-b1e2e5ca57a8 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:53:33 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-efe6a234-b6b0-439b-85c3-b1e2e5ca57a8 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:53:33 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-efe6a234-b6b0-439b-85c3-b1e2e5ca57a8 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:53:33 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-efe6a234-b6b0-439b-85c3-b1e2e5ca57a8 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:53:33 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-efe6a234-b6b0-439b-85c3-b1e2e5ca57a8 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:53:33 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-efe6a234-b6b0-439b-85c3-b1e2e5ca57a8 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:53:33 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-efe6a234-b6b0-439b-85c3-b1e2e5ca57a8 tempest-CreateVolumesFromSnapshotTest-2139566359 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:53:33 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-efe6a234-b6b0-439b-85c3-b1e2e5ca57a8 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a60e7fac-b3af-415e-925b-7c75677b4d9b 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:33 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-62aa3b85-611d-4cf2-8883-407723215838 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67bc1ab0-c558-41e7-851c-bd5361cac47c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd7a2a5b-929c-43e6-ae93-5b8a21748b08', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:33 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-62aa3b85-611d-4cf2-8883-407723215838 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6ed8357-b146-49cd-b2b9-2e90f80850f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:33 devstack sudo[100533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a60e7fac-b3af-415e-925b-7c75677b4d9b 1073741824 Sep 25 11:53:33 devstack sudo[100533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:33 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-62aa3b85-611d-4cf2-8883-407723215838 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Volume volume-bd7a2a5b-929c-43e6-ae93-5b8a21748b08 (bd7a2a5b-929c-43e6-ae93-5b8a21748b08): created successfully Sep 25 11:53:33 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-62aa3b85-611d-4cf2-8883-407723215838 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6ed8357-b146-49cd-b2b9-2e90f80850f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:33 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-62aa3b85-611d-4cf2-8883-407723215838 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Flow 'volume_create_manager' (0e3cfd1e-3d0a-4af1-b3cc-7192e9fc6c34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:53:33 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-62aa3b85-611d-4cf2-8883-407723215838 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Created volume successfully. Sep 25 11:53:34 devstack sudo[100533]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:34 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-efe6a234-b6b0-439b-85c3-b1e2e5ca57a8 tempest-CreateVolumesFromSnapshotTest-2139566359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a60e7fac-b3af-415e-925b-7c75677b4d9b 1073741824" returned: 0 in 0.773s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:34 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-efe6a234-b6b0-439b-85c3-b1e2e5ca57a8 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a60e7fac-b3af-415e-925b-7c75677b4d9b {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:34 devstack sudo[100539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a60e7fac-b3af-415e-925b-7c75677b4d9b Sep 25 11:53:34 devstack sudo[100539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:34 devstack sudo[100539]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:34 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-efe6a234-b6b0-439b-85c3-b1e2e5ca57a8 tempest-CreateVolumesFromSnapshotTest-2139566359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a60e7fac-b3af-415e-925b-7c75677b4d9b" returned: 0 in 0.413s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:34 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-efe6a234-b6b0-439b-85c3-b1e2e5ca57a8 tempest-CreateVolumesFromSnapshotTest-2139566359 None] <== create_volume: return (1262ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:53:34 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-efe6a234-b6b0-439b-85c3-b1e2e5ca57a8 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.268s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:53:34 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-ea9c7acd-184c-4e31-8321-04d6c4e6b679 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.446s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:53:34 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-ea9c7acd-184c-4e31-8321-04d6c4e6b679 tempest-CreateVolumesFromSnapshotTest-2139566359 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:53:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1480504849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=658576ee-0152-4bb6-8db4-5e93d3da644c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fb06e9d002d47088d210f9f53c135ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:53:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:53:32Z,use_quota=True,user_id='888a05a2888f4e1b840303fe62e8a14c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:53:34 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-ea9c7acd-184c-4e31-8321-04d6c4e6b679 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Creating volume 658576ee-0152-4bb6-8db4-5e93d3da644c {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:53:34 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-ea9c7acd-184c-4e31-8321-04d6c4e6b679 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:53:34 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-ea9c7acd-184c-4e31-8321-04d6c4e6b679 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:53:34 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-ea9c7acd-184c-4e31-8321-04d6c4e6b679 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:53:34 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-ea9c7acd-184c-4e31-8321-04d6c4e6b679 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:53:34 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-ea9c7acd-184c-4e31-8321-04d6c4e6b679 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:53:34 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-ea9c7acd-184c-4e31-8321-04d6c4e6b679 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:53:34 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-ea9c7acd-184c-4e31-8321-04d6c4e6b679 tempest-CreateVolumesFromSnapshotTest-2139566359 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:53:34 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ea9c7acd-184c-4e31-8321-04d6c4e6b679 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-658576ee-0152-4bb6-8db4-5e93d3da644c 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:34 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-efe6a234-b6b0-439b-85c3-b1e2e5ca57a8 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb3f3d35-1ac5-4d55-8c35-962adff8542a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a60e7fac-b3af-415e-925b-7c75677b4d9b', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:34 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-efe6a234-b6b0-439b-85c3-b1e2e5ca57a8 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (743e8fd7-e166-4b3d-a169-6fbd2ec1f2ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:34 devstack sudo[100542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-658576ee-0152-4bb6-8db4-5e93d3da644c 1073741824 Sep 25 11:53:34 devstack sudo[100542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:34 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-efe6a234-b6b0-439b-85c3-b1e2e5ca57a8 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Volume volume-a60e7fac-b3af-415e-925b-7c75677b4d9b (a60e7fac-b3af-415e-925b-7c75677b4d9b): created successfully Sep 25 11:53:34 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-efe6a234-b6b0-439b-85c3-b1e2e5ca57a8 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (743e8fd7-e166-4b3d-a169-6fbd2ec1f2ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:34 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-efe6a234-b6b0-439b-85c3-b1e2e5ca57a8 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Flow 'volume_create_manager' (d94b6338-006e-4460-be9e-9a5a81dd2796) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:53:34 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-efe6a234-b6b0-439b-85c3-b1e2e5ca57a8 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Created volume successfully. Sep 25 11:53:35 devstack sudo[100542]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:35 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ea9c7acd-184c-4e31-8321-04d6c4e6b679 tempest-CreateVolumesFromSnapshotTest-2139566359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-658576ee-0152-4bb6-8db4-5e93d3da644c 1073741824" returned: 0 in 0.757s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:35 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ea9c7acd-184c-4e31-8321-04d6c4e6b679 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-658576ee-0152-4bb6-8db4-5e93d3da644c {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:35 devstack sudo[100548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-658576ee-0152-4bb6-8db4-5e93d3da644c Sep 25 11:53:35 devstack sudo[100548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:35 devstack sudo[100548]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:35 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ea9c7acd-184c-4e31-8321-04d6c4e6b679 tempest-CreateVolumesFromSnapshotTest-2139566359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-658576ee-0152-4bb6-8db4-5e93d3da644c" returned: 0 in 0.348s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:35 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-ea9c7acd-184c-4e31-8321-04d6c4e6b679 tempest-CreateVolumesFromSnapshotTest-2139566359 None] <== create_volume: return (1168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:53:35 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-ea9c7acd-184c-4e31-8321-04d6c4e6b679 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.173s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:53:35 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d3e313a2-973b-457e-b89d-5013fc632745 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.981s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:53:35 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-d3e313a2-973b-457e-b89d-5013fc632745 tempest-CreateVolumesFromSnapshotTest-2139566359 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:53:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-117833558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af1f6321-bc2d-476f-859e-7f9bbda5327c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fb06e9d002d47088d210f9f53c135ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:53:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:53:33Z,use_quota=True,user_id='888a05a2888f4e1b840303fe62e8a14c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:53:35 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-d3e313a2-973b-457e-b89d-5013fc632745 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Creating volume af1f6321-bc2d-476f-859e-7f9bbda5327c {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:53:35 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d3e313a2-973b-457e-b89d-5013fc632745 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:53:35 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d3e313a2-973b-457e-b89d-5013fc632745 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:53:35 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-d3e313a2-973b-457e-b89d-5013fc632745 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:53:35 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-d3e313a2-973b-457e-b89d-5013fc632745 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:53:35 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d3e313a2-973b-457e-b89d-5013fc632745 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:53:35 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-d3e313a2-973b-457e-b89d-5013fc632745 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:53:35 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-d3e313a2-973b-457e-b89d-5013fc632745 tempest-CreateVolumesFromSnapshotTest-2139566359 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:53:35 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d3e313a2-973b-457e-b89d-5013fc632745 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-af1f6321-bc2d-476f-859e-7f9bbda5327c 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:35 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ea9c7acd-184c-4e31-8321-04d6c4e6b679 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58462d36-9db0-4cc9-bffa-1425a596de7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-658576ee-0152-4bb6-8db4-5e93d3da644c', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:35 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ea9c7acd-184c-4e31-8321-04d6c4e6b679 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb32aff4-5b58-40e2-b5c9-9189e2105fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:35 devstack sudo[100551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-af1f6321-bc2d-476f-859e-7f9bbda5327c 1073741824 Sep 25 11:53:35 devstack sudo[100551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:35 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-ea9c7acd-184c-4e31-8321-04d6c4e6b679 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Volume volume-658576ee-0152-4bb6-8db4-5e93d3da644c (658576ee-0152-4bb6-8db4-5e93d3da644c): created successfully Sep 25 11:53:35 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ea9c7acd-184c-4e31-8321-04d6c4e6b679 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb32aff4-5b58-40e2-b5c9-9189e2105fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:35 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ea9c7acd-184c-4e31-8321-04d6c4e6b679 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Flow 'volume_create_manager' (8cabb3eb-803d-4a57-8671-8b643233a01c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:53:35 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-ea9c7acd-184c-4e31-8321-04d6c4e6b679 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Created volume successfully. Sep 25 11:53:36 devstack sudo[100551]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:36 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d3e313a2-973b-457e-b89d-5013fc632745 tempest-CreateVolumesFromSnapshotTest-2139566359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-af1f6321-bc2d-476f-859e-7f9bbda5327c 1073741824" returned: 0 in 0.768s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:36 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d3e313a2-973b-457e-b89d-5013fc632745 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-af1f6321-bc2d-476f-859e-7f9bbda5327c {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:36 devstack sudo[100558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-af1f6321-bc2d-476f-859e-7f9bbda5327c Sep 25 11:53:36 devstack sudo[100558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:36 devstack sudo[100558]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:36 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d3e313a2-973b-457e-b89d-5013fc632745 tempest-CreateVolumesFromSnapshotTest-2139566359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-af1f6321-bc2d-476f-859e-7f9bbda5327c" returned: 0 in 0.308s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:36 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-d3e313a2-973b-457e-b89d-5013fc632745 tempest-CreateVolumesFromSnapshotTest-2139566359 None] <== create_volume: return (1151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:53:36 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d3e313a2-973b-457e-b89d-5013fc632745 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.155s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:53:36 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d3e313a2-973b-457e-b89d-5013fc632745 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2dbd4df-ba36-4420-afea-0ddd2f746aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af1f6321-bc2d-476f-859e-7f9bbda5327c', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:36 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d3e313a2-973b-457e-b89d-5013fc632745 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9b334ac-5263-4622-b8b7-a6b74c2c94ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:37 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-d3e313a2-973b-457e-b89d-5013fc632745 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Volume volume-af1f6321-bc2d-476f-859e-7f9bbda5327c (af1f6321-bc2d-476f-859e-7f9bbda5327c): created successfully Sep 25 11:53:37 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d3e313a2-973b-457e-b89d-5013fc632745 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9b334ac-5263-4622-b8b7-a6b74c2c94ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:37 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d3e313a2-973b-457e-b89d-5013fc632745 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Flow 'volume_create_manager' (c8b04e5a-5bd6-4dda-aa28-de8e61ac4cb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:53:37 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-d3e313a2-973b-457e-b89d-5013fc632745 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Created volume successfully. Sep 25 11:53:37 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-70482b04-9d40-4847-9a8b-708b59bdf114 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Acquiring lock "cinder-af1f6321-bc2d-476f-859e-7f9bbda5327c-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:53:37 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-70482b04-9d40-4847-9a8b-708b59bdf114 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Lock "cinder-af1f6321-bc2d-476f-859e-7f9bbda5327c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:53:37 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-70482b04-9d40-4847-9a8b-708b59bdf114 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Acquiring lock "cinder-quobyte-af1f6321-bc2d-476f-859e-7f9bbda5327c" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:53:37 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-70482b04-9d40-4847-9a8b-708b59bdf114 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Lock "cinder-quobyte-af1f6321-bc2d-476f-859e-7f9bbda5327c" acquired by "delete_volume" :: waited 0.042s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:53:37 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdac234a-3d59-4227-aa3e-eb3349222faf]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:53:37 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-70482b04-9d40-4847-9a8b-708b59bdf114 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-af1f6321-bc2d-476f-859e-7f9bbda5327c {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:37 devstack sudo[100562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-af1f6321-bc2d-476f-859e-7f9bbda5327c Sep 25 11:53:37 devstack sudo[100562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:38 devstack sudo[100562]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-70482b04-9d40-4847-9a8b-708b59bdf114 tempest-CreateVolumesFromSnapshotTest-2139566359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-af1f6321-bc2d-476f-859e-7f9bbda5327c" returned: 0 in 0.475s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-70482b04-9d40-4847-9a8b-708b59bdf114 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-af1f6321-bc2d-476f-859e-7f9bbda5327c {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:38 devstack sudo[100567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-af1f6321-bc2d-476f-859e-7f9bbda5327c Sep 25 11:53:38 devstack sudo[100567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:38 devstack sudo[100567]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-70482b04-9d40-4847-9a8b-708b59bdf114 tempest-CreateVolumesFromSnapshotTest-2139566359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-af1f6321-bc2d-476f-859e-7f9bbda5327c" returned: 0 in 0.343s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:38 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-70482b04-9d40-4847-9a8b-708b59bdf114 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Lock "cinder-quobyte-af1f6321-bc2d-476f-859e-7f9bbda5327c" released by "delete_volume" :: held 0.889s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:53:38 devstack cinder-volume[86984]: DEBUG oslo_service.periodic_task [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:53:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:53:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:53:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:53:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:53:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:53:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:38 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-70482b04-9d40-4847-9a8b-708b59bdf114 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Created reservations ['fe9eba14-fc2d-417a-bac9-61c4087c63e9', 'e17b4c76-0bc2-4648-b6f7-c4003612e43e', '0fcab899-d15f-4e7b-9332-b4dd7c1b2867', '9863a147-7d85-4841-a12d-96ea6ee8f216'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:53:38 devstack sudo[100570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:53:38 devstack sudo[100570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-70482b04-9d40-4847-9a8b-708b59bdf114 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:53:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-70482b04-9d40-4847-9a8b-708b59bdf114 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:53:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-70482b04-9d40-4847-9a8b-708b59bdf114 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:53:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-70482b04-9d40-4847-9a8b-708b59bdf114 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:53:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-70482b04-9d40-4847-9a8b-708b59bdf114 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:53:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-70482b04-9d40-4847-9a8b-708b59bdf114 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:38 devstack sudo[100572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:53:38 devstack sudo[100572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:39 devstack sudo[100570]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.469s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:39 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:53:39 devstack cinder-volume[86984]: DEBUG oslo_service.periodic_task [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running periodic task VolumeManager._thread_info {{(pid=86984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:53:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] thread count: 28 {{(pid=86984) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 11:53:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] thread info: [<_MainThread(MainThread, started 132046492332160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86984) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 11:53:39 devstack sudo[100572]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-70482b04-9d40-4847-9a8b-708b59bdf114 tempest-CreateVolumesFromSnapshotTest-2139566359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.370s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:39 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-70482b04-9d40-4847-9a8b-708b59bdf114 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:53:39 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-70482b04-9d40-4847-9a8b-708b59bdf114 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Deleted volume successfully. Sep 25 11:53:39 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-70482b04-9d40-4847-9a8b-708b59bdf114 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Lock "cinder-af1f6321-bc2d-476f-859e-7f9bbda5327c-delete_volume" released by "delete_volume" :: held 1.756s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:53:39 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-5f6ad8bf-268b-457f-966a-b0d216d9cbd6 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Acquiring lock "cinder-658576ee-0152-4bb6-8db4-5e93d3da644c-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:53:39 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-5f6ad8bf-268b-457f-966a-b0d216d9cbd6 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Lock "cinder-658576ee-0152-4bb6-8db4-5e93d3da644c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:53:39 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-5f6ad8bf-268b-457f-966a-b0d216d9cbd6 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Acquiring lock "cinder-quobyte-658576ee-0152-4bb6-8db4-5e93d3da644c" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:53:40 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-5f6ad8bf-268b-457f-966a-b0d216d9cbd6 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Lock "cinder-quobyte-658576ee-0152-4bb6-8db4-5e93d3da644c" acquired by "delete_volume" :: waited 0.026s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:53:40 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad980694-287c-4c97-91a8-0cfdb70b89a3]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:53:40 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-5f6ad8bf-268b-457f-966a-b0d216d9cbd6 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-658576ee-0152-4bb6-8db4-5e93d3da644c {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:40 devstack sudo[100583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-658576ee-0152-4bb6-8db4-5e93d3da644c Sep 25 11:53:40 devstack sudo[100583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:40 devstack sudo[100583]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:40 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-5f6ad8bf-268b-457f-966a-b0d216d9cbd6 tempest-CreateVolumesFromSnapshotTest-2139566359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-658576ee-0152-4bb6-8db4-5e93d3da644c" returned: 0 in 0.540s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:40 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-5f6ad8bf-268b-457f-966a-b0d216d9cbd6 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-658576ee-0152-4bb6-8db4-5e93d3da644c {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:40 devstack sudo[100588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-658576ee-0152-4bb6-8db4-5e93d3da644c Sep 25 11:53:40 devstack sudo[100588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:41 devstack sudo[100588]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-5f6ad8bf-268b-457f-966a-b0d216d9cbd6 tempest-CreateVolumesFromSnapshotTest-2139566359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-658576ee-0152-4bb6-8db4-5e93d3da644c" returned: 0 in 0.419s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:41 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-5f6ad8bf-268b-457f-966a-b0d216d9cbd6 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Lock "cinder-quobyte-658576ee-0152-4bb6-8db4-5e93d3da644c" released by "delete_volume" :: held 1.041s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:53:41 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-5f6ad8bf-268b-457f-966a-b0d216d9cbd6 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Created reservations ['087d4f62-cd28-455c-8878-e410d987db51', '59bd9eb2-a109-4a4b-8136-6d89d7de8f38', '989fdba6-ba42-47aa-950b-5816874c6de8', 'a7d2b8b1-e034-47b3-a9f6-3827ecfdbddb'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:53:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-5f6ad8bf-268b-457f-966a-b0d216d9cbd6 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:53:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-5f6ad8bf-268b-457f-966a-b0d216d9cbd6 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:53:41 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-5f6ad8bf-268b-457f-966a-b0d216d9cbd6 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:53:41 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-5f6ad8bf-268b-457f-966a-b0d216d9cbd6 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:53:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-5f6ad8bf-268b-457f-966a-b0d216d9cbd6 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:53:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-5f6ad8bf-268b-457f-966a-b0d216d9cbd6 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:41 devstack sudo[100592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:53:41 devstack sudo[100592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:41 devstack sudo[100592]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-5f6ad8bf-268b-457f-966a-b0d216d9cbd6 tempest-CreateVolumesFromSnapshotTest-2139566359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.427s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:41 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-5f6ad8bf-268b-457f-966a-b0d216d9cbd6 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:53:41 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-5f6ad8bf-268b-457f-966a-b0d216d9cbd6 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Deleted volume successfully. Sep 25 11:53:41 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-5f6ad8bf-268b-457f-966a-b0d216d9cbd6 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Lock "cinder-658576ee-0152-4bb6-8db4-5e93d3da644c-delete_volume" released by "delete_volume" :: held 1.807s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:53:42 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-9aea924e-a4a7-43d8-9e10-e6477936676b tempest-CreateVolumesFromSnapshotTest-2139566359 None] Acquiring lock "cinder-a60e7fac-b3af-415e-925b-7c75677b4d9b-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:53:42 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-9aea924e-a4a7-43d8-9e10-e6477936676b tempest-CreateVolumesFromSnapshotTest-2139566359 None] Lock "cinder-a60e7fac-b3af-415e-925b-7c75677b4d9b-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:53:42 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-9aea924e-a4a7-43d8-9e10-e6477936676b tempest-CreateVolumesFromSnapshotTest-2139566359 None] Acquiring lock "cinder-quobyte-a60e7fac-b3af-415e-925b-7c75677b4d9b" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:53:42 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-9aea924e-a4a7-43d8-9e10-e6477936676b tempest-CreateVolumesFromSnapshotTest-2139566359 None] Lock "cinder-quobyte-a60e7fac-b3af-415e-925b-7c75677b4d9b" acquired by "delete_volume" :: waited 0.028s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:53:42 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7684a60-7783-4380-bfbb-9592ade252e8]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:53:42 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-9aea924e-a4a7-43d8-9e10-e6477936676b tempest-CreateVolumesFromSnapshotTest-2139566359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a60e7fac-b3af-415e-925b-7c75677b4d9b {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:42 devstack sudo[100595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a60e7fac-b3af-415e-925b-7c75677b4d9b Sep 25 11:53:42 devstack sudo[100595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:43 devstack sudo[100595]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-9aea924e-a4a7-43d8-9e10-e6477936676b tempest-CreateVolumesFromSnapshotTest-2139566359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a60e7fac-b3af-415e-925b-7c75677b4d9b" returned: 0 in 0.676s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-9aea924e-a4a7-43d8-9e10-e6477936676b tempest-CreateVolumesFromSnapshotTest-2139566359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a60e7fac-b3af-415e-925b-7c75677b4d9b {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:43 devstack sudo[100600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a60e7fac-b3af-415e-925b-7c75677b4d9b Sep 25 11:53:43 devstack sudo[100600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:43 devstack sudo[100600]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-9aea924e-a4a7-43d8-9e10-e6477936676b tempest-CreateVolumesFromSnapshotTest-2139566359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a60e7fac-b3af-415e-925b-7c75677b4d9b" returned: 0 in 0.452s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:43 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-9aea924e-a4a7-43d8-9e10-e6477936676b tempest-CreateVolumesFromSnapshotTest-2139566359 None] Lock "cinder-quobyte-a60e7fac-b3af-415e-925b-7c75677b4d9b" released by "delete_volume" :: held 1.224s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:53:43 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-9aea924e-a4a7-43d8-9e10-e6477936676b tempest-CreateVolumesFromSnapshotTest-2139566359 None] Created reservations ['2318ca7f-4d6f-4986-820b-508df91759a9', 'a6088dcc-ab55-4cc0-9795-253d3c76dbf9', '7733a3e8-8058-4503-a2cd-bc6a0a5b5f24', '7c7bb86b-dd0a-43bd-a308-05e81655b7c6'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:53:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-9aea924e-a4a7-43d8-9e10-e6477936676b tempest-CreateVolumesFromSnapshotTest-2139566359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:53:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-9aea924e-a4a7-43d8-9e10-e6477936676b tempest-CreateVolumesFromSnapshotTest-2139566359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:53:43 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-9aea924e-a4a7-43d8-9e10-e6477936676b tempest-CreateVolumesFromSnapshotTest-2139566359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:53:43 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-9aea924e-a4a7-43d8-9e10-e6477936676b tempest-CreateVolumesFromSnapshotTest-2139566359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:53:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-9aea924e-a4a7-43d8-9e10-e6477936676b tempest-CreateVolumesFromSnapshotTest-2139566359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:53:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-9aea924e-a4a7-43d8-9e10-e6477936676b tempest-CreateVolumesFromSnapshotTest-2139566359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:44 devstack sudo[100604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:53:44 devstack sudo[100604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:44 devstack sudo[100604]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-9aea924e-a4a7-43d8-9e10-e6477936676b tempest-CreateVolumesFromSnapshotTest-2139566359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.361s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:44 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-9aea924e-a4a7-43d8-9e10-e6477936676b tempest-CreateVolumesFromSnapshotTest-2139566359 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:53:44 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-9aea924e-a4a7-43d8-9e10-e6477936676b tempest-CreateVolumesFromSnapshotTest-2139566359 None] Deleted volume successfully. Sep 25 11:53:44 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-9aea924e-a4a7-43d8-9e10-e6477936676b tempest-CreateVolumesFromSnapshotTest-2139566359 None] Lock "cinder-a60e7fac-b3af-415e-925b-7c75677b4d9b-delete_volume" released by "delete_volume" :: held 2.046s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:53:44 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-05753892-c51c-4c6d-804c-ed2f210f4830 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Acquiring lock "cinder-bd7a2a5b-929c-43e6-ae93-5b8a21748b08-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:53:44 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-05753892-c51c-4c6d-804c-ed2f210f4830 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Lock "cinder-bd7a2a5b-929c-43e6-ae93-5b8a21748b08-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:53:44 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-05753892-c51c-4c6d-804c-ed2f210f4830 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Acquiring lock "cinder-quobyte-bd7a2a5b-929c-43e6-ae93-5b8a21748b08" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:53:44 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-05753892-c51c-4c6d-804c-ed2f210f4830 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Lock "cinder-quobyte-bd7a2a5b-929c-43e6-ae93-5b8a21748b08" acquired by "delete_volume" :: waited 0.025s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:53:44 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4eb9a4f-442e-457a-98b9-7db9d4a04871]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:53:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-05753892-c51c-4c6d-804c-ed2f210f4830 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bd7a2a5b-929c-43e6-ae93-5b8a21748b08 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:45 devstack sudo[100607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bd7a2a5b-929c-43e6-ae93-5b8a21748b08 Sep 25 11:53:45 devstack sudo[100607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:45 devstack sudo[100607]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-05753892-c51c-4c6d-804c-ed2f210f4830 tempest-CreateVolumesFromSnapshotTest-2139566359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bd7a2a5b-929c-43e6-ae93-5b8a21748b08" returned: 0 in 0.555s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-05753892-c51c-4c6d-804c-ed2f210f4830 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bd7a2a5b-929c-43e6-ae93-5b8a21748b08 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:45 devstack sudo[100613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bd7a2a5b-929c-43e6-ae93-5b8a21748b08 Sep 25 11:53:45 devstack sudo[100613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:45 devstack sudo[100613]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-05753892-c51c-4c6d-804c-ed2f210f4830 tempest-CreateVolumesFromSnapshotTest-2139566359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bd7a2a5b-929c-43e6-ae93-5b8a21748b08" returned: 0 in 0.409s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:45 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-05753892-c51c-4c6d-804c-ed2f210f4830 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Lock "cinder-quobyte-bd7a2a5b-929c-43e6-ae93-5b8a21748b08" released by "delete_volume" :: held 1.034s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:53:45 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-05753892-c51c-4c6d-804c-ed2f210f4830 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Created reservations ['06a92329-ffc7-4161-9f9b-9e8b659f2f49', '5f1730c6-3a73-4ea1-a5c7-10393c4cf245', '95fd77d4-2a67-408f-a41f-414f996b5866', '6d9c346f-a2b2-4911-a787-40e54e029bcc'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:53:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-05753892-c51c-4c6d-804c-ed2f210f4830 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:53:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-05753892-c51c-4c6d-804c-ed2f210f4830 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:53:46 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-05753892-c51c-4c6d-804c-ed2f210f4830 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:53:46 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-05753892-c51c-4c6d-804c-ed2f210f4830 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:53:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-05753892-c51c-4c6d-804c-ed2f210f4830 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:53:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-05753892-c51c-4c6d-804c-ed2f210f4830 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:46 devstack sudo[100616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:53:46 devstack sudo[100616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:46 devstack sudo[100616]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-05753892-c51c-4c6d-804c-ed2f210f4830 tempest-CreateVolumesFromSnapshotTest-2139566359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.470s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:46 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-05753892-c51c-4c6d-804c-ed2f210f4830 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:53:46 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-05753892-c51c-4c6d-804c-ed2f210f4830 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Deleted volume successfully. Sep 25 11:53:46 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-05753892-c51c-4c6d-804c-ed2f210f4830 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Lock "cinder-bd7a2a5b-929c-43e6-ae93-5b8a21748b08-delete_volume" released by "delete_volume" :: held 1.855s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:53:47 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f9b7f65c-5870-4fe0-a5bf-6418b7a0e67f tempest-CreateVolumesFromSnapshotTest-2139566359 None] Acquiring lock "cinder-41dec876-2389-48ac-9944-6d694cff8adb-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:53:47 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f9b7f65c-5870-4fe0-a5bf-6418b7a0e67f tempest-CreateVolumesFromSnapshotTest-2139566359 None] Lock "cinder-41dec876-2389-48ac-9944-6d694cff8adb-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:53:47 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f9b7f65c-5870-4fe0-a5bf-6418b7a0e67f tempest-CreateVolumesFromSnapshotTest-2139566359 None] Acquiring lock "cinder-quobyte-41dec876-2389-48ac-9944-6d694cff8adb" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:53:47 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f9b7f65c-5870-4fe0-a5bf-6418b7a0e67f tempest-CreateVolumesFromSnapshotTest-2139566359 None] Lock "cinder-quobyte-41dec876-2389-48ac-9944-6d694cff8adb" acquired by "delete_volume" :: waited 0.030s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:53:47 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede5ff2d-c8fe-4c73-a026-214d6a3a5461]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:53:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f9b7f65c-5870-4fe0-a5bf-6418b7a0e67f tempest-CreateVolumesFromSnapshotTest-2139566359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-41dec876-2389-48ac-9944-6d694cff8adb {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:47 devstack sudo[100619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-41dec876-2389-48ac-9944-6d694cff8adb Sep 25 11:53:47 devstack sudo[100619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:47 devstack sudo[100619]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f9b7f65c-5870-4fe0-a5bf-6418b7a0e67f tempest-CreateVolumesFromSnapshotTest-2139566359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-41dec876-2389-48ac-9944-6d694cff8adb" returned: 0 in 0.662s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f9b7f65c-5870-4fe0-a5bf-6418b7a0e67f tempest-CreateVolumesFromSnapshotTest-2139566359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-41dec876-2389-48ac-9944-6d694cff8adb {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:47 devstack sudo[100624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-41dec876-2389-48ac-9944-6d694cff8adb Sep 25 11:53:47 devstack sudo[100624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:48 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-f996f6ea-328a-4cc5-a7e7-c24baf40b58e tempest-VolumesSnapshotNegativeTestJSON-577238856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:53:48 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f996f6ea-328a-4cc5-a7e7-c24baf40b58e tempest-VolumesSnapshotNegativeTestJSON-577238856 None] Flow 'volume_create_manager' (42c879b2-e73e-442f-a989-6c1983206c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:53:48 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f996f6ea-328a-4cc5-a7e7-c24baf40b58e tempest-VolumesSnapshotNegativeTestJSON-577238856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ff22e2c-8695-44e0-a61d-bc0857dcb85d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:48 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f996f6ea-328a-4cc5-a7e7-c24baf40b58e tempest-VolumesSnapshotNegativeTestJSON-577238856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ff22e2c-8695-44e0-a61d-bc0857dcb85d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:53:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-436927852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd8dabdb-a75d-4736-8e93-2590f60737ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74d3f001422a46c996b0b23d3ff8c367',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:53:48Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:53:48Z,use_quota=True,user_id='3431fcbeadca4949972e7d5fe3834967',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:48 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f996f6ea-328a-4cc5-a7e7-c24baf40b58e tempest-VolumesSnapshotNegativeTestJSON-577238856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b10e8181-7d81-4b0e-9488-0f5cfb6a1d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:48 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f996f6ea-328a-4cc5-a7e7-c24baf40b58e tempest-VolumesSnapshotNegativeTestJSON-577238856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b10e8181-7d81-4b0e-9488-0f5cfb6a1d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:48 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f996f6ea-328a-4cc5-a7e7-c24baf40b58e tempest-VolumesSnapshotNegativeTestJSON-577238856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c30e8e87-80a3-41fe-9b4c-8b83c49e77b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:48 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f996f6ea-328a-4cc5-a7e7-c24baf40b58e tempest-VolumesSnapshotNegativeTestJSON-577238856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c30e8e87-80a3-41fe-9b4c-8b83c49e77b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd8dabdb-a75d-4736-8e93-2590f60737ce', 'volume_name': 'volume-fd8dabdb-a75d-4736-8e93-2590f60737ce', 'volume_size': 2}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:48 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f996f6ea-328a-4cc5-a7e7-c24baf40b58e tempest-VolumesSnapshotNegativeTestJSON-577238856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0da98673-3585-49a7-9e04-aa3bc7f216e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:48 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f996f6ea-328a-4cc5-a7e7-c24baf40b58e tempest-VolumesSnapshotNegativeTestJSON-577238856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0da98673-3585-49a7-9e04-aa3bc7f216e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:48 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f996f6ea-328a-4cc5-a7e7-c24baf40b58e tempest-VolumesSnapshotNegativeTestJSON-577238856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9b0a38b-47e1-435e-89d7-728b438142ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:48 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-f996f6ea-328a-4cc5-a7e7-c24baf40b58e tempest-VolumesSnapshotNegativeTestJSON-577238856 None] Volume fd8dabdb-a75d-4736-8e93-2590f60737ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd8dabdb-a75d-4736-8e93-2590f60737ce', 'volume_size': 2} Sep 25 11:53:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f996f6ea-328a-4cc5-a7e7-c24baf40b58e tempest-VolumesSnapshotNegativeTestJSON-577238856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:53:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f996f6ea-328a-4cc5-a7e7-c24baf40b58e tempest-VolumesSnapshotNegativeTestJSON-577238856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:53:48 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-f996f6ea-328a-4cc5-a7e7-c24baf40b58e tempest-VolumesSnapshotNegativeTestJSON-577238856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:53:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-436927852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd8dabdb-a75d-4736-8e93-2590f60737ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74d3f001422a46c996b0b23d3ff8c367',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:53:48Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:53:48Z,use_quota=True,user_id='3431fcbeadca4949972e7d5fe3834967',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:53:48 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-f996f6ea-328a-4cc5-a7e7-c24baf40b58e tempest-VolumesSnapshotNegativeTestJSON-577238856 None] Creating volume fd8dabdb-a75d-4736-8e93-2590f60737ce {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:53:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f996f6ea-328a-4cc5-a7e7-c24baf40b58e tempest-VolumesSnapshotNegativeTestJSON-577238856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:53:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f996f6ea-328a-4cc5-a7e7-c24baf40b58e tempest-VolumesSnapshotNegativeTestJSON-577238856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:53:48 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-f996f6ea-328a-4cc5-a7e7-c24baf40b58e tempest-VolumesSnapshotNegativeTestJSON-577238856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:53:48 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-f996f6ea-328a-4cc5-a7e7-c24baf40b58e tempest-VolumesSnapshotNegativeTestJSON-577238856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:53:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f996f6ea-328a-4cc5-a7e7-c24baf40b58e tempest-VolumesSnapshotNegativeTestJSON-577238856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:53:48 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-f996f6ea-328a-4cc5-a7e7-c24baf40b58e tempest-VolumesSnapshotNegativeTestJSON-577238856 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:53:48 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-f996f6ea-328a-4cc5-a7e7-c24baf40b58e tempest-VolumesSnapshotNegativeTestJSON-577238856 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:53:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f996f6ea-328a-4cc5-a7e7-c24baf40b58e tempest-VolumesSnapshotNegativeTestJSON-577238856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fd8dabdb-a75d-4736-8e93-2590f60737ce 2147483648 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:48 devstack sudo[100626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fd8dabdb-a75d-4736-8e93-2590f60737ce 2147483648 Sep 25 11:53:48 devstack sudo[100626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:48 devstack sudo[100624]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f9b7f65c-5870-4fe0-a5bf-6418b7a0e67f tempest-CreateVolumesFromSnapshotTest-2139566359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-41dec876-2389-48ac-9944-6d694cff8adb" returned: 0 in 0.474s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:48 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f9b7f65c-5870-4fe0-a5bf-6418b7a0e67f tempest-CreateVolumesFromSnapshotTest-2139566359 None] Lock "cinder-quobyte-41dec876-2389-48ac-9944-6d694cff8adb" released by "delete_volume" :: held 1.209s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:53:48 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-f9b7f65c-5870-4fe0-a5bf-6418b7a0e67f tempest-CreateVolumesFromSnapshotTest-2139566359 None] Created reservations ['7255e021-0bcb-4165-93d1-85aba684069a', '436ff842-8735-41e9-b9dd-14e7b5bf9d23', '872584f3-f218-4d10-bde1-5dfd47d2963f', 'f64414f9-801b-41ca-8428-6ff4b26b59f0'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:53:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f9b7f65c-5870-4fe0-a5bf-6418b7a0e67f tempest-CreateVolumesFromSnapshotTest-2139566359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:53:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f9b7f65c-5870-4fe0-a5bf-6418b7a0e67f tempest-CreateVolumesFromSnapshotTest-2139566359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:53:48 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-f9b7f65c-5870-4fe0-a5bf-6418b7a0e67f tempest-CreateVolumesFromSnapshotTest-2139566359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:53:48 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-f9b7f65c-5870-4fe0-a5bf-6418b7a0e67f tempest-CreateVolumesFromSnapshotTest-2139566359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:53:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f9b7f65c-5870-4fe0-a5bf-6418b7a0e67f tempest-CreateVolumesFromSnapshotTest-2139566359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:53:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f9b7f65c-5870-4fe0-a5bf-6418b7a0e67f tempest-CreateVolumesFromSnapshotTest-2139566359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:48 devstack sudo[100633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:53:48 devstack sudo[100633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:48 devstack sudo[100626]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f996f6ea-328a-4cc5-a7e7-c24baf40b58e tempest-VolumesSnapshotNegativeTestJSON-577238856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fd8dabdb-a75d-4736-8e93-2590f60737ce 2147483648" returned: 0 in 0.755s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:48 devstack cinder-volume[86984]: DEBUG dbcounter [-] [86984] Writing DB stats cinder:SELECT=104,cinder:UPDATE=152,cinder:INSERT=42,cinder:DELETE=17 {{(pid=86984) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:53:48 devstack cinder-volume[86984]: DEBUG dbcounter [-] [86984] Writing DB stats cinder:UPDATE=148,cinder:SELECT=110,cinder:INSERT=37,cinder:DELETE=9 {{(pid=86984) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:53:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f996f6ea-328a-4cc5-a7e7-c24baf40b58e tempest-VolumesSnapshotNegativeTestJSON-577238856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fd8dabdb-a75d-4736-8e93-2590f60737ce {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:49 devstack sudo[100633]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:49 devstack sudo[100636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fd8dabdb-a75d-4736-8e93-2590f60737ce Sep 25 11:53:49 devstack sudo[100636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f9b7f65c-5870-4fe0-a5bf-6418b7a0e67f tempest-CreateVolumesFromSnapshotTest-2139566359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.415s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:49 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-f9b7f65c-5870-4fe0-a5bf-6418b7a0e67f tempest-CreateVolumesFromSnapshotTest-2139566359 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:53:49 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-f9b7f65c-5870-4fe0-a5bf-6418b7a0e67f tempest-CreateVolumesFromSnapshotTest-2139566359 None] Deleted volume successfully. Sep 25 11:53:49 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f9b7f65c-5870-4fe0-a5bf-6418b7a0e67f tempest-CreateVolumesFromSnapshotTest-2139566359 None] Lock "cinder-41dec876-2389-48ac-9944-6d694cff8adb-delete_volume" released by "delete_volume" :: held 1.964s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:53:49 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f0b352a-4f88-4d42-a5d5-462d34a65e60 tempest-VolumesListAdminTestJSON-1654262711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:53:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2f0b352a-4f88-4d42-a5d5-462d34a65e60 tempest-VolumesListAdminTestJSON-1654262711 None] Flow 'volume_create_manager' (25a32812-d2b7-4728-8690-f0bea7254e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:53:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2f0b352a-4f88-4d42-a5d5-462d34a65e60 tempest-VolumesListAdminTestJSON-1654262711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da9e6e19-2c42-41a1-92ed-cbd73bb68a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2f0b352a-4f88-4d42-a5d5-462d34a65e60 tempest-VolumesListAdminTestJSON-1654262711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da9e6e19-2c42-41a1-92ed-cbd73bb68a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:53:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-342385614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50abbae5-4578-4c02-9d49-eec4883faae9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64c8f877ebd74d03be8bd5196170ce85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:53:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:53:49Z,use_quota=True,user_id='6b9436e99eba4a679a28818a3aa0996f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2f0b352a-4f88-4d42-a5d5-462d34a65e60 tempest-VolumesListAdminTestJSON-1654262711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1a3d8d9-6fde-4fe1-8f97-8f14583e8da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2f0b352a-4f88-4d42-a5d5-462d34a65e60 tempest-VolumesListAdminTestJSON-1654262711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1a3d8d9-6fde-4fe1-8f97-8f14583e8da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2f0b352a-4f88-4d42-a5d5-462d34a65e60 tempest-VolumesListAdminTestJSON-1654262711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aceecba7-4d6a-4cc2-9332-bac6c39598ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2f0b352a-4f88-4d42-a5d5-462d34a65e60 tempest-VolumesListAdminTestJSON-1654262711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aceecba7-4d6a-4cc2-9332-bac6c39598ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50abbae5-4578-4c02-9d49-eec4883faae9', 'volume_name': 'volume-50abbae5-4578-4c02-9d49-eec4883faae9', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2f0b352a-4f88-4d42-a5d5-462d34a65e60 tempest-VolumesListAdminTestJSON-1654262711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff2d96ab-85ee-4773-bc6a-b01767d92437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2f0b352a-4f88-4d42-a5d5-462d34a65e60 tempest-VolumesListAdminTestJSON-1654262711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff2d96ab-85ee-4773-bc6a-b01767d92437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2f0b352a-4f88-4d42-a5d5-462d34a65e60 tempest-VolumesListAdminTestJSON-1654262711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (459e4e92-58dc-4ee7-830a-836c7ff73d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:49 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-2f0b352a-4f88-4d42-a5d5-462d34a65e60 tempest-VolumesListAdminTestJSON-1654262711 None] Volume 50abbae5-4578-4c02-9d49-eec4883faae9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50abbae5-4578-4c02-9d49-eec4883faae9', 'volume_size': 1} Sep 25 11:53:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-2f0b352a-4f88-4d42-a5d5-462d34a65e60 tempest-VolumesListAdminTestJSON-1654262711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:53:49 devstack sudo[100636]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f996f6ea-328a-4cc5-a7e7-c24baf40b58e tempest-VolumesSnapshotNegativeTestJSON-577238856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fd8dabdb-a75d-4736-8e93-2590f60737ce" returned: 0 in 0.297s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:49 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-f996f6ea-328a-4cc5-a7e7-c24baf40b58e tempest-VolumesSnapshotNegativeTestJSON-577238856 None] <== create_volume: return (1173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:53:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f996f6ea-328a-4cc5-a7e7-c24baf40b58e tempest-VolumesSnapshotNegativeTestJSON-577238856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.179s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:53:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-2f0b352a-4f88-4d42-a5d5-462d34a65e60 tempest-VolumesListAdminTestJSON-1654262711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.018s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:53:49 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-2f0b352a-4f88-4d42-a5d5-462d34a65e60 tempest-VolumesListAdminTestJSON-1654262711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:53:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-342385614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50abbae5-4578-4c02-9d49-eec4883faae9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64c8f877ebd74d03be8bd5196170ce85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:53:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:53:49Z,use_quota=True,user_id='6b9436e99eba4a679a28818a3aa0996f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:53:49 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-2f0b352a-4f88-4d42-a5d5-462d34a65e60 tempest-VolumesListAdminTestJSON-1654262711 None] Creating volume 50abbae5-4578-4c02-9d49-eec4883faae9 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:53:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-2f0b352a-4f88-4d42-a5d5-462d34a65e60 tempest-VolumesListAdminTestJSON-1654262711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:53:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-2f0b352a-4f88-4d42-a5d5-462d34a65e60 tempest-VolumesListAdminTestJSON-1654262711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:53:49 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-2f0b352a-4f88-4d42-a5d5-462d34a65e60 tempest-VolumesListAdminTestJSON-1654262711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:53:49 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-2f0b352a-4f88-4d42-a5d5-462d34a65e60 tempest-VolumesListAdminTestJSON-1654262711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:53:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-2f0b352a-4f88-4d42-a5d5-462d34a65e60 tempest-VolumesListAdminTestJSON-1654262711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:53:49 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-2f0b352a-4f88-4d42-a5d5-462d34a65e60 tempest-VolumesListAdminTestJSON-1654262711 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:53:49 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-2f0b352a-4f88-4d42-a5d5-462d34a65e60 tempest-VolumesListAdminTestJSON-1654262711 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:53:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2f0b352a-4f88-4d42-a5d5-462d34a65e60 tempest-VolumesListAdminTestJSON-1654262711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-50abbae5-4578-4c02-9d49-eec4883faae9 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f996f6ea-328a-4cc5-a7e7-c24baf40b58e tempest-VolumesSnapshotNegativeTestJSON-577238856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9b0a38b-47e1-435e-89d7-728b438142ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd8dabdb-a75d-4736-8e93-2590f60737ce', 'volume_size': 2}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f996f6ea-328a-4cc5-a7e7-c24baf40b58e tempest-VolumesSnapshotNegativeTestJSON-577238856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b9b9938-a541-4146-94c2-4015f50eae61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:49 devstack sudo[100639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-50abbae5-4578-4c02-9d49-eec4883faae9 1073741824 Sep 25 11:53:49 devstack sudo[100639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:49 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-f996f6ea-328a-4cc5-a7e7-c24baf40b58e tempest-VolumesSnapshotNegativeTestJSON-577238856 None] Volume volume-fd8dabdb-a75d-4736-8e93-2590f60737ce (fd8dabdb-a75d-4736-8e93-2590f60737ce): created successfully Sep 25 11:53:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f996f6ea-328a-4cc5-a7e7-c24baf40b58e tempest-VolumesSnapshotNegativeTestJSON-577238856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b9b9938-a541-4146-94c2-4015f50eae61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f996f6ea-328a-4cc5-a7e7-c24baf40b58e tempest-VolumesSnapshotNegativeTestJSON-577238856 None] Flow 'volume_create_manager' (42c879b2-e73e-442f-a989-6c1983206c39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:53:49 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-f996f6ea-328a-4cc5-a7e7-c24baf40b58e tempest-VolumesSnapshotNegativeTestJSON-577238856 None] Created volume successfully. Sep 25 11:53:49 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-7011f3d9-88be-4472-b9ba-ce444d5b9478 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Acquiring lock "cinder-fade9ef5-9914-4acb-89c9-2fd959da6ace-delete_snapshot" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:53:49 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-7011f3d9-88be-4472-b9ba-ce444d5b9478 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Lock "cinder-fade9ef5-9914-4acb-89c9-2fd959da6ace-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:53:49 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-7011f3d9-88be-4472-b9ba-ce444d5b9478 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Acquiring lock "cinder-quobyte-0f38f056-1938-4978-9ba6-ee75d0319555" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:53:49 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-7011f3d9-88be-4472-b9ba-ce444d5b9478 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Lock "cinder-quobyte-0f38f056-1938-4978-9ba6-ee75d0319555" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:53:49 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-7011f3d9-88be-4472-b9ba-ce444d5b9478 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Acquiring lock "cinder-quobyte-fade9ef5-9914-4acb-89c9-2fd959da6ace" by "_delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:53:49 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-7011f3d9-88be-4472-b9ba-ce444d5b9478 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Lock "cinder-quobyte-fade9ef5-9914-4acb-89c9-2fd959da6ace" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:53:49 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-7011f3d9-88be-4472-b9ba-ce444d5b9478 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Deleting offline snapshot fade9ef5-9914-4acb-89c9-2fd959da6ace of volume 0f38f056-1938-4978-9ba6-ee75d0319555 {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:53:49 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-7011f3d9-88be-4472-b9ba-ce444d5b9478 tempest-CreateVolumesFromSnapshotTest-2139566359 None] snapshot_file for this snap is: volume-0f38f056-1938-4978-9ba6-ee75d0319555.fade9ef5-9914-4acb-89c9-2fd959da6ace {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:53:49 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1169249-e3f3-4298-b6b4-f603d786de1a]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:53:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7011f3d9-88be-4472-b9ba-ce444d5b9478 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0f38f056-1938-4978-9ba6-ee75d0319555.fade9ef5-9914-4acb-89c9-2fd959da6ace {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:49 devstack sudo[100641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0f38f056-1938-4978-9ba6-ee75d0319555.fade9ef5-9914-4acb-89c9-2fd959da6ace Sep 25 11:53:49 devstack sudo[100641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:49 devstack sudo[100639]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2f0b352a-4f88-4d42-a5d5-462d34a65e60 tempest-VolumesListAdminTestJSON-1654262711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-50abbae5-4578-4c02-9d49-eec4883faae9 1073741824" returned: 0 in 0.651s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2f0b352a-4f88-4d42-a5d5-462d34a65e60 tempest-VolumesListAdminTestJSON-1654262711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-50abbae5-4578-4c02-9d49-eec4883faae9 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:50 devstack sudo[100649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-50abbae5-4578-4c02-9d49-eec4883faae9 Sep 25 11:53:50 devstack sudo[100649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:50 devstack sudo[100641]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7011f3d9-88be-4472-b9ba-ce444d5b9478 tempest-CreateVolumesFromSnapshotTest-2139566359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0f38f056-1938-4978-9ba6-ee75d0319555.fade9ef5-9914-4acb-89c9-2fd959da6ace" returned: 0 in 0.586s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:50 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-7011f3d9-88be-4472-b9ba-ce444d5b9478 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f38f056-1938-4978-9ba6-ee75d0319555(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86984) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:53:50 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[aedf3db9-39c7-4d11-aec6-f57ac10b3be7]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:53:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7011f3d9-88be-4472-b9ba-ce444d5b9478 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0f38f056-1938-4978-9ba6-ee75d0319555 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:50 devstack sudo[100649]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2f0b352a-4f88-4d42-a5d5-462d34a65e60 tempest-VolumesListAdminTestJSON-1654262711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-50abbae5-4578-4c02-9d49-eec4883faae9" returned: 0 in 0.326s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:50 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-2f0b352a-4f88-4d42-a5d5-462d34a65e60 tempest-VolumesListAdminTestJSON-1654262711 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:53:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-2f0b352a-4f88-4d42-a5d5-462d34a65e60 tempest-VolumesListAdminTestJSON-1654262711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:53:50 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2f0b352a-4f88-4d42-a5d5-462d34a65e60 tempest-VolumesListAdminTestJSON-1654262711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (459e4e92-58dc-4ee7-830a-836c7ff73d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50abbae5-4578-4c02-9d49-eec4883faae9', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:50 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2f0b352a-4f88-4d42-a5d5-462d34a65e60 tempest-VolumesListAdminTestJSON-1654262711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8712c97-d54f-4f28-bb8f-e735993fbd17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:50 devstack sudo[100652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0f38f056-1938-4978-9ba6-ee75d0319555 Sep 25 11:53:50 devstack sudo[100652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:50 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-2f0b352a-4f88-4d42-a5d5-462d34a65e60 tempest-VolumesListAdminTestJSON-1654262711 None] Volume volume-50abbae5-4578-4c02-9d49-eec4883faae9 (50abbae5-4578-4c02-9d49-eec4883faae9): created successfully Sep 25 11:53:50 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2f0b352a-4f88-4d42-a5d5-462d34a65e60 tempest-VolumesListAdminTestJSON-1654262711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8712c97-d54f-4f28-bb8f-e735993fbd17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:50 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2f0b352a-4f88-4d42-a5d5-462d34a65e60 tempest-VolumesListAdminTestJSON-1654262711 None] Flow 'volume_create_manager' (25a32812-d2b7-4728-8690-f0bea7254e5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:53:50 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-2f0b352a-4f88-4d42-a5d5-462d34a65e60 tempest-VolumesListAdminTestJSON-1654262711 None] Created volume successfully. Sep 25 11:53:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-5ec0d0f0-6a8f-42c7-8b37-618e08e51100 tempest-VolumesSnapshotNegativeTestJSON-577238856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:53:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-5ec0d0f0-6a8f-42c7-8b37-618e08e51100 tempest-VolumesSnapshotNegativeTestJSON-577238856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:53:50 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-5ec0d0f0-6a8f-42c7-8b37-618e08e51100 tempest-VolumesSnapshotNegativeTestJSON-577238856 None] Creating offline snapshot 60e47279-5d3f-49ea-bcf6-a40252d936ab of volume fd8dabdb-a75d-4736-8e93-2590f60737ce {{(pid=86984) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:53:50 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[98917e46-de99-4bb9-8679-b969a49fcf25]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:53:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-5ec0d0f0-6a8f-42c7-8b37-618e08e51100 tempest-VolumesSnapshotNegativeTestJSON-577238856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fd8dabdb-a75d-4736-8e93-2590f60737ce {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:50 devstack sudo[100655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fd8dabdb-a75d-4736-8e93-2590f60737ce Sep 25 11:53:50 devstack sudo[100655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:50 devstack sudo[100652]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7011f3d9-88be-4472-b9ba-ce444d5b9478 tempest-CreateVolumesFromSnapshotTest-2139566359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0f38f056-1938-4978-9ba6-ee75d0319555" returned: 0 in 0.525s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7011f3d9-88be-4472-b9ba-ce444d5b9478 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0f38f056-1938-4978-9ba6-ee75d0319555.fade9ef5-9914-4acb-89c9-2fd959da6ace {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:50 devstack sudo[100660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0f38f056-1938-4978-9ba6-ee75d0319555.fade9ef5-9914-4acb-89c9-2fd959da6ace Sep 25 11:53:50 devstack sudo[100660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:51 devstack sudo[100655]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-5ec0d0f0-6a8f-42c7-8b37-618e08e51100 tempest-VolumesSnapshotNegativeTestJSON-577238856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fd8dabdb-a75d-4736-8e93-2590f60737ce" returned: 0 in 0.493s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-5ec0d0f0-6a8f-42c7-8b37-618e08e51100 tempest-VolumesSnapshotNegativeTestJSON-577238856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fd8dabdb-a75d-4736-8e93-2590f60737ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fd8dabdb-a75d-4736-8e93-2590f60737ce.60e47279-5d3f-49ea-bcf6-a40252d936ab 2G {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:51 devstack sudo[100699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fd8dabdb-a75d-4736-8e93-2590f60737ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fd8dabdb-a75d-4736-8e93-2590f60737ce.60e47279-5d3f-49ea-bcf6-a40252d936ab 2G Sep 25 11:53:51 devstack sudo[100699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:51 devstack sudo[100660]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7011f3d9-88be-4472-b9ba-ce444d5b9478 tempest-CreateVolumesFromSnapshotTest-2139566359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0f38f056-1938-4978-9ba6-ee75d0319555.fade9ef5-9914-4acb-89c9-2fd959da6ace" returned: 0 in 0.523s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7011f3d9-88be-4472-b9ba-ce444d5b9478 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0f38f056-1938-4978-9ba6-ee75d0319555.fade9ef5-9914-4acb-89c9-2fd959da6ace {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:51 devstack sudo[100706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0f38f056-1938-4978-9ba6-ee75d0319555.fade9ef5-9914-4acb-89c9-2fd959da6ace Sep 25 11:53:51 devstack sudo[100706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:51 devstack sudo[100699]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-5ec0d0f0-6a8f-42c7-8b37-618e08e51100 tempest-VolumesSnapshotNegativeTestJSON-577238856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fd8dabdb-a75d-4736-8e93-2590f60737ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fd8dabdb-a75d-4736-8e93-2590f60737ce.60e47279-5d3f-49ea-bcf6-a40252d936ab 2G" returned: 0 in 0.841s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-5ec0d0f0-6a8f-42c7-8b37-618e08e51100 tempest-VolumesSnapshotNegativeTestJSON-577238856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd8dabdb-a75d-4736-8e93-2590f60737ce -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fd8dabdb-a75d-4736-8e93-2590f60737ce.60e47279-5d3f-49ea-bcf6-a40252d936ab {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:51 devstack sudo[100713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd8dabdb-a75d-4736-8e93-2590f60737ce -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fd8dabdb-a75d-4736-8e93-2590f60737ce.60e47279-5d3f-49ea-bcf6-a40252d936ab Sep 25 11:53:51 devstack sudo[100713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:51 devstack sudo[100706]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7011f3d9-88be-4472-b9ba-ce444d5b9478 tempest-CreateVolumesFromSnapshotTest-2139566359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0f38f056-1938-4978-9ba6-ee75d0319555.fade9ef5-9914-4acb-89c9-2fd959da6ace" returned: 0 in 0.673s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:52 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-7011f3d9-88be-4472-b9ba-ce444d5b9478 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Lock "cinder-quobyte-fade9ef5-9914-4acb-89c9-2fd959da6ace" released by "_delete_snapshot" :: held 2.560s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:53:52 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-7011f3d9-88be-4472-b9ba-ce444d5b9478 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Lock "cinder-quobyte-0f38f056-1938-4978-9ba6-ee75d0319555" released by "delete_snapshot" :: held 2.603s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:53:52 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-7011f3d9-88be-4472-b9ba-ce444d5b9478 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Created reservations ['e38ac705-5103-4d0c-86e2-9df311a1d8b9', 'bbcb6481-8ce4-4797-b5a4-57d11c2069b6', '82e5a8fa-8a18-42a5-be81-601389293e77', '32ee3d41-d057-4eda-adf9-40aa14830191'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:53:52 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-7011f3d9-88be-4472-b9ba-ce444d5b9478 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Delete snapshot completed successfully. Sep 25 11:53:52 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-7011f3d9-88be-4472-b9ba-ce444d5b9478 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Lock "cinder-fade9ef5-9914-4acb-89c9-2fd959da6ace-delete_snapshot" released by "delete_snapshot" :: held 2.965s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:53:52 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae463489-0a1b-48ef-96a7-78ce9a2db9da tempest-VolumesListAdminTestJSON-1654262711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:53:52 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ae463489-0a1b-48ef-96a7-78ce9a2db9da tempest-VolumesListAdminTestJSON-1654262711 None] Flow 'volume_create_manager' (0335e884-5dae-4062-8e0e-2bb2a10a91ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:53:52 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ae463489-0a1b-48ef-96a7-78ce9a2db9da tempest-VolumesListAdminTestJSON-1654262711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c16ff929-5138-4bf8-a49e-6580d7d67e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:52 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ae463489-0a1b-48ef-96a7-78ce9a2db9da tempest-VolumesListAdminTestJSON-1654262711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c16ff929-5138-4bf8-a49e-6580d7d67e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:53:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2108353627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e1bdcf5-b093-4c86-b4ce-349c70f26777,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64c8f877ebd74d03be8bd5196170ce85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:53:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:53:52Z,use_quota=True,user_id='6b9436e99eba4a679a28818a3aa0996f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:52 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ae463489-0a1b-48ef-96a7-78ce9a2db9da tempest-VolumesListAdminTestJSON-1654262711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d574d4b4-565b-4186-ade1-63aceb6a36e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:52 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ae463489-0a1b-48ef-96a7-78ce9a2db9da tempest-VolumesListAdminTestJSON-1654262711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d574d4b4-565b-4186-ade1-63aceb6a36e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:52 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ae463489-0a1b-48ef-96a7-78ce9a2db9da tempest-VolumesListAdminTestJSON-1654262711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f70fa2a5-96ee-478c-a7e0-b10bc12d4b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:52 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ae463489-0a1b-48ef-96a7-78ce9a2db9da tempest-VolumesListAdminTestJSON-1654262711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f70fa2a5-96ee-478c-a7e0-b10bc12d4b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e1bdcf5-b093-4c86-b4ce-349c70f26777', 'volume_name': 'volume-8e1bdcf5-b093-4c86-b4ce-349c70f26777', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:52 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ae463489-0a1b-48ef-96a7-78ce9a2db9da tempest-VolumesListAdminTestJSON-1654262711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b1ec93d-420b-4d3e-ae4e-f233775d6af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:52 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ae463489-0a1b-48ef-96a7-78ce9a2db9da tempest-VolumesListAdminTestJSON-1654262711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b1ec93d-420b-4d3e-ae4e-f233775d6af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:52 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ae463489-0a1b-48ef-96a7-78ce9a2db9da tempest-VolumesListAdminTestJSON-1654262711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af10b194-4378-4f25-b22e-445f92317486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:52 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-ae463489-0a1b-48ef-96a7-78ce9a2db9da tempest-VolumesListAdminTestJSON-1654262711 None] Volume 8e1bdcf5-b093-4c86-b4ce-349c70f26777: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e1bdcf5-b093-4c86-b4ce-349c70f26777', 'volume_size': 1} Sep 25 11:53:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-ae463489-0a1b-48ef-96a7-78ce9a2db9da tempest-VolumesListAdminTestJSON-1654262711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:53:52 devstack sudo[100713]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-5ec0d0f0-6a8f-42c7-8b37-618e08e51100 tempest-VolumesSnapshotNegativeTestJSON-577238856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd8dabdb-a75d-4736-8e93-2590f60737ce -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fd8dabdb-a75d-4736-8e93-2590f60737ce.60e47279-5d3f-49ea-bcf6-a40252d936ab" returned: 0 in 0.722s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:52 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-5ec0d0f0-6a8f-42c7-8b37-618e08e51100 tempest-VolumesSnapshotNegativeTestJSON-577238856 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fd8dabdb-a75d-4736-8e93-2590f60737ce.60e47279-5d3f-49ea-bcf6-a40252d936ab is being set with open permissions: ugo+rw Sep 25 11:53:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-5ec0d0f0-6a8f-42c7-8b37-618e08e51100 tempest-VolumesSnapshotNegativeTestJSON-577238856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fd8dabdb-a75d-4736-8e93-2590f60737ce.60e47279-5d3f-49ea-bcf6-a40252d936ab {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:52 devstack sudo[100719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fd8dabdb-a75d-4736-8e93-2590f60737ce.60e47279-5d3f-49ea-bcf6-a40252d936ab Sep 25 11:53:52 devstack sudo[100719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:52 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-8376c915-304f-4f2c-b73f-e38fe78849c0 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Acquiring lock "cinder-0f38f056-1938-4978-9ba6-ee75d0319555-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:53:52 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-8376c915-304f-4f2c-b73f-e38fe78849c0 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Lock "cinder-0f38f056-1938-4978-9ba6-ee75d0319555-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:53:52 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-8376c915-304f-4f2c-b73f-e38fe78849c0 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Acquiring lock "cinder-quobyte-0f38f056-1938-4978-9ba6-ee75d0319555" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:53:52 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-8376c915-304f-4f2c-b73f-e38fe78849c0 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Lock "cinder-quobyte-0f38f056-1938-4978-9ba6-ee75d0319555" acquired by "delete_volume" :: waited 0.032s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:53:52 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af4b769-9cb1-4286-a04b-f4ecf27f7a30]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:53:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8376c915-304f-4f2c-b73f-e38fe78849c0 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0f38f056-1938-4978-9ba6-ee75d0319555 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:53 devstack sudo[100719]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-5ec0d0f0-6a8f-42c7-8b37-618e08e51100 tempest-VolumesSnapshotNegativeTestJSON-577238856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fd8dabdb-a75d-4736-8e93-2590f60737ce.60e47279-5d3f-49ea-bcf6-a40252d936ab" returned: 0 in 0.440s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:53 devstack sudo[100722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0f38f056-1938-4978-9ba6-ee75d0319555 Sep 25 11:53:53 devstack sudo[100722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-5ec0d0f0-6a8f-42c7-8b37-618e08e51100 tempest-VolumesSnapshotNegativeTestJSON-577238856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fd8dabdb-a75d-4736-8e93-2590f60737ce.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:53 devstack sudo[100724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fd8dabdb-a75d-4736-8e93-2590f60737ce.info Sep 25 11:53:53 devstack sudo[100724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:53 devstack sudo[100724]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-5ec0d0f0-6a8f-42c7-8b37-618e08e51100 tempest-VolumesSnapshotNegativeTestJSON-577238856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fd8dabdb-a75d-4736-8e93-2590f60737ce.info" returned: 0 in 0.402s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:53 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-5ec0d0f0-6a8f-42c7-8b37-618e08e51100 tempest-VolumesSnapshotNegativeTestJSON-577238856 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fd8dabdb-a75d-4736-8e93-2590f60737ce.info is being set with open permissions: ugo+rw Sep 25 11:53:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-5ec0d0f0-6a8f-42c7-8b37-618e08e51100 tempest-VolumesSnapshotNegativeTestJSON-577238856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fd8dabdb-a75d-4736-8e93-2590f60737ce.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:53 devstack sudo[100722]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8376c915-304f-4f2c-b73f-e38fe78849c0 tempest-CreateVolumesFromSnapshotTest-2139566359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0f38f056-1938-4978-9ba6-ee75d0319555" returned: 0 in 0.610s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8376c915-304f-4f2c-b73f-e38fe78849c0 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0f38f056-1938-4978-9ba6-ee75d0319555 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:53 devstack sudo[100732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fd8dabdb-a75d-4736-8e93-2590f60737ce.info Sep 25 11:53:53 devstack sudo[100732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:53 devstack sudo[100733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0f38f056-1938-4978-9ba6-ee75d0319555 Sep 25 11:53:53 devstack sudo[100733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:53 devstack sudo[100732]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-5ec0d0f0-6a8f-42c7-8b37-618e08e51100 tempest-VolumesSnapshotNegativeTestJSON-577238856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fd8dabdb-a75d-4736-8e93-2590f60737ce.info" returned: 0 in 0.329s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-5ec0d0f0-6a8f-42c7-8b37-618e08e51100 tempest-VolumesSnapshotNegativeTestJSON-577238856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.466s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:53:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-ae463489-0a1b-48ef-96a7-78ce9a2db9da tempest-VolumesListAdminTestJSON-1654262711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.378s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:53:53 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-ae463489-0a1b-48ef-96a7-78ce9a2db9da tempest-VolumesListAdminTestJSON-1654262711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:53:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2108353627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e1bdcf5-b093-4c86-b4ce-349c70f26777,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64c8f877ebd74d03be8bd5196170ce85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:53:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:53:52Z,use_quota=True,user_id='6b9436e99eba4a679a28818a3aa0996f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:53:53 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-ae463489-0a1b-48ef-96a7-78ce9a2db9da tempest-VolumesListAdminTestJSON-1654262711 None] Creating volume 8e1bdcf5-b093-4c86-b4ce-349c70f26777 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:53:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-ae463489-0a1b-48ef-96a7-78ce9a2db9da tempest-VolumesListAdminTestJSON-1654262711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:53:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-ae463489-0a1b-48ef-96a7-78ce9a2db9da tempest-VolumesListAdminTestJSON-1654262711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:53:53 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-ae463489-0a1b-48ef-96a7-78ce9a2db9da tempest-VolumesListAdminTestJSON-1654262711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:53:53 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-ae463489-0a1b-48ef-96a7-78ce9a2db9da tempest-VolumesListAdminTestJSON-1654262711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:53:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-ae463489-0a1b-48ef-96a7-78ce9a2db9da tempest-VolumesListAdminTestJSON-1654262711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:53:53 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-ae463489-0a1b-48ef-96a7-78ce9a2db9da tempest-VolumesListAdminTestJSON-1654262711 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:53:53 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-ae463489-0a1b-48ef-96a7-78ce9a2db9da tempest-VolumesListAdminTestJSON-1654262711 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:53:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ae463489-0a1b-48ef-96a7-78ce9a2db9da tempest-VolumesListAdminTestJSON-1654262711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8e1bdcf5-b093-4c86-b4ce-349c70f26777 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:54 devstack sudo[100733]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:54 devstack sudo[100738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8e1bdcf5-b093-4c86-b4ce-349c70f26777 1073741824 Sep 25 11:53:54 devstack sudo[100738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8376c915-304f-4f2c-b73f-e38fe78849c0 tempest-CreateVolumesFromSnapshotTest-2139566359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0f38f056-1938-4978-9ba6-ee75d0319555" returned: 0 in 0.429s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:54 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-8376c915-304f-4f2c-b73f-e38fe78849c0 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Lock "cinder-quobyte-0f38f056-1938-4978-9ba6-ee75d0319555" released by "delete_volume" :: held 1.179s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:53:54 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-5ec0d0f0-6a8f-42c7-8b37-618e08e51100 tempest-VolumesSnapshotNegativeTestJSON-577238856 None] Create snapshot completed successfully Sep 25 11:53:54 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-8376c915-304f-4f2c-b73f-e38fe78849c0 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Created reservations ['7a126736-9b34-4f90-b847-00ef5cdd76b6', '2532f006-c4c2-496e-adb9-5a0be6cd9775', 'f015d385-d459-43bc-8360-cf2478d67f05', 'a3789f93-4631-4e74-ad57-4095e9f3c542'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:53:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-8376c915-304f-4f2c-b73f-e38fe78849c0 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:53:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-8376c915-304f-4f2c-b73f-e38fe78849c0 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:53:54 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-8376c915-304f-4f2c-b73f-e38fe78849c0 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:53:54 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-8376c915-304f-4f2c-b73f-e38fe78849c0 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:53:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-8376c915-304f-4f2c-b73f-e38fe78849c0 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:53:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8376c915-304f-4f2c-b73f-e38fe78849c0 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:54 devstack sudo[100740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:53:54 devstack sudo[100740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:54 devstack sudo[100740]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8376c915-304f-4f2c-b73f-e38fe78849c0 tempest-CreateVolumesFromSnapshotTest-2139566359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.557s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:54 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-8376c915-304f-4f2c-b73f-e38fe78849c0 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:53:54 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-8376c915-304f-4f2c-b73f-e38fe78849c0 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Deleted volume successfully. Sep 25 11:53:54 devstack sudo[100738]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:54 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-8376c915-304f-4f2c-b73f-e38fe78849c0 tempest-CreateVolumesFromSnapshotTest-2139566359 None] Lock "cinder-0f38f056-1938-4978-9ba6-ee75d0319555-delete_volume" released by "delete_volume" :: held 2.177s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:53:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ae463489-0a1b-48ef-96a7-78ce9a2db9da tempest-VolumesListAdminTestJSON-1654262711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8e1bdcf5-b093-4c86-b4ce-349c70f26777 1073741824" returned: 0 in 0.991s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ae463489-0a1b-48ef-96a7-78ce9a2db9da tempest-VolumesListAdminTestJSON-1654262711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8e1bdcf5-b093-4c86-b4ce-349c70f26777 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:55 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-bc7ca5ed-5d45-4c86-a520-1b49cf4f51a0 tempest-VolumesSnapshotNegativeTestJSON-577238856 None] Acquiring lock "cinder-60e47279-5d3f-49ea-bcf6-a40252d936ab-delete_snapshot" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:53:55 devstack sudo[100747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8e1bdcf5-b093-4c86-b4ce-349c70f26777 Sep 25 11:53:55 devstack sudo[100747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:55 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-bc7ca5ed-5d45-4c86-a520-1b49cf4f51a0 tempest-VolumesSnapshotNegativeTestJSON-577238856 None] Lock "cinder-60e47279-5d3f-49ea-bcf6-a40252d936ab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:53:55 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-bc7ca5ed-5d45-4c86-a520-1b49cf4f51a0 tempest-VolumesSnapshotNegativeTestJSON-577238856 None] Acquiring lock "cinder-quobyte-fd8dabdb-a75d-4736-8e93-2590f60737ce" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:53:55 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-bc7ca5ed-5d45-4c86-a520-1b49cf4f51a0 tempest-VolumesSnapshotNegativeTestJSON-577238856 None] Lock "cinder-quobyte-fd8dabdb-a75d-4736-8e93-2590f60737ce" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:53:55 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-bc7ca5ed-5d45-4c86-a520-1b49cf4f51a0 tempest-VolumesSnapshotNegativeTestJSON-577238856 None] Acquiring lock "cinder-quobyte-60e47279-5d3f-49ea-bcf6-a40252d936ab" by "_delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:53:55 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-bc7ca5ed-5d45-4c86-a520-1b49cf4f51a0 tempest-VolumesSnapshotNegativeTestJSON-577238856 None] Lock "cinder-quobyte-60e47279-5d3f-49ea-bcf6-a40252d936ab" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:53:55 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-bc7ca5ed-5d45-4c86-a520-1b49cf4f51a0 tempest-VolumesSnapshotNegativeTestJSON-577238856 None] Deleting offline snapshot 60e47279-5d3f-49ea-bcf6-a40252d936ab of volume fd8dabdb-a75d-4736-8e93-2590f60737ce {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:53:55 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-bc7ca5ed-5d45-4c86-a520-1b49cf4f51a0 tempest-VolumesSnapshotNegativeTestJSON-577238856 None] snapshot_file for this snap is: volume-fd8dabdb-a75d-4736-8e93-2590f60737ce.60e47279-5d3f-49ea-bcf6-a40252d936ab {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:53:55 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[5045eed9-21c1-4d78-bee0-b8baf030b4eb]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:53:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-bc7ca5ed-5d45-4c86-a520-1b49cf4f51a0 tempest-VolumesSnapshotNegativeTestJSON-577238856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fd8dabdb-a75d-4736-8e93-2590f60737ce.60e47279-5d3f-49ea-bcf6-a40252d936ab {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:55 devstack sudo[100749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fd8dabdb-a75d-4736-8e93-2590f60737ce.60e47279-5d3f-49ea-bcf6-a40252d936ab Sep 25 11:53:55 devstack sudo[100749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:55 devstack sudo[100747]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ae463489-0a1b-48ef-96a7-78ce9a2db9da tempest-VolumesListAdminTestJSON-1654262711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8e1bdcf5-b093-4c86-b4ce-349c70f26777" returned: 0 in 0.533s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:55 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-ae463489-0a1b-48ef-96a7-78ce9a2db9da tempest-VolumesListAdminTestJSON-1654262711 None] <== create_volume: return (1625ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:53:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-ae463489-0a1b-48ef-96a7-78ce9a2db9da tempest-VolumesListAdminTestJSON-1654262711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.631s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:53:55 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ae463489-0a1b-48ef-96a7-78ce9a2db9da tempest-VolumesListAdminTestJSON-1654262711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af10b194-4378-4f25-b22e-445f92317486) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e1bdcf5-b093-4c86-b4ce-349c70f26777', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:55 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ae463489-0a1b-48ef-96a7-78ce9a2db9da tempest-VolumesListAdminTestJSON-1654262711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8daad620-d57e-45f6-af84-37594060d900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:55 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-ae463489-0a1b-48ef-96a7-78ce9a2db9da tempest-VolumesListAdminTestJSON-1654262711 None] Volume volume-8e1bdcf5-b093-4c86-b4ce-349c70f26777 (8e1bdcf5-b093-4c86-b4ce-349c70f26777): created successfully Sep 25 11:53:55 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ae463489-0a1b-48ef-96a7-78ce9a2db9da tempest-VolumesListAdminTestJSON-1654262711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8daad620-d57e-45f6-af84-37594060d900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:55 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ae463489-0a1b-48ef-96a7-78ce9a2db9da tempest-VolumesListAdminTestJSON-1654262711 None] Flow 'volume_create_manager' (0335e884-5dae-4062-8e0e-2bb2a10a91ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:53:55 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-ae463489-0a1b-48ef-96a7-78ce9a2db9da tempest-VolumesListAdminTestJSON-1654262711 None] Created volume successfully. Sep 25 11:53:55 devstack sudo[100749]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-bc7ca5ed-5d45-4c86-a520-1b49cf4f51a0 tempest-VolumesSnapshotNegativeTestJSON-577238856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fd8dabdb-a75d-4736-8e93-2590f60737ce.60e47279-5d3f-49ea-bcf6-a40252d936ab" returned: 0 in 0.621s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:55 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-bc7ca5ed-5d45-4c86-a520-1b49cf4f51a0 tempest-VolumesSnapshotNegativeTestJSON-577238856 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd8dabdb-a75d-4736-8e93-2590f60737ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86984) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:53:55 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[280ff32b-125b-48fe-919c-a255ce717006]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:53:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-bc7ca5ed-5d45-4c86-a520-1b49cf4f51a0 tempest-VolumesSnapshotNegativeTestJSON-577238856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fd8dabdb-a75d-4736-8e93-2590f60737ce {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:56 devstack sudo[100755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fd8dabdb-a75d-4736-8e93-2590f60737ce Sep 25 11:53:56 devstack sudo[100755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:56 devstack sudo[100755]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:56 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-bc7ca5ed-5d45-4c86-a520-1b49cf4f51a0 tempest-VolumesSnapshotNegativeTestJSON-577238856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fd8dabdb-a75d-4736-8e93-2590f60737ce" returned: 0 in 0.576s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:56 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-bc7ca5ed-5d45-4c86-a520-1b49cf4f51a0 tempest-VolumesSnapshotNegativeTestJSON-577238856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fd8dabdb-a75d-4736-8e93-2590f60737ce.60e47279-5d3f-49ea-bcf6-a40252d936ab {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:56 devstack sudo[100760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fd8dabdb-a75d-4736-8e93-2590f60737ce.60e47279-5d3f-49ea-bcf6-a40252d936ab Sep 25 11:53:56 devstack sudo[100760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:57 devstack sudo[100760]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:57 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-bc7ca5ed-5d45-4c86-a520-1b49cf4f51a0 tempest-VolumesSnapshotNegativeTestJSON-577238856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fd8dabdb-a75d-4736-8e93-2590f60737ce.60e47279-5d3f-49ea-bcf6-a40252d936ab" returned: 0 in 0.597s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:57 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-bc7ca5ed-5d45-4c86-a520-1b49cf4f51a0 tempest-VolumesSnapshotNegativeTestJSON-577238856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fd8dabdb-a75d-4736-8e93-2590f60737ce.60e47279-5d3f-49ea-bcf6-a40252d936ab {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:57 devstack sudo[100765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fd8dabdb-a75d-4736-8e93-2590f60737ce.60e47279-5d3f-49ea-bcf6-a40252d936ab Sep 25 11:53:57 devstack sudo[100765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:57 devstack sudo[100765]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:57 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-bc7ca5ed-5d45-4c86-a520-1b49cf4f51a0 tempest-VolumesSnapshotNegativeTestJSON-577238856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fd8dabdb-a75d-4736-8e93-2590f60737ce.60e47279-5d3f-49ea-bcf6-a40252d936ab" returned: 0 in 0.539s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:57 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-bc7ca5ed-5d45-4c86-a520-1b49cf4f51a0 tempest-VolumesSnapshotNegativeTestJSON-577238856 None] Lock "cinder-quobyte-60e47279-5d3f-49ea-bcf6-a40252d936ab" released by "_delete_snapshot" :: held 2.594s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:53:57 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-bc7ca5ed-5d45-4c86-a520-1b49cf4f51a0 tempest-VolumesSnapshotNegativeTestJSON-577238856 None] Lock "cinder-quobyte-fd8dabdb-a75d-4736-8e93-2590f60737ce" released by "delete_snapshot" :: held 2.647s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:53:57 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9ebcb5e-9f0b-4eed-964e-ba4dcd1614a7 tempest-VolumesListAdminTestJSON-1654262711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:53:57 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-a9ebcb5e-9f0b-4eed-964e-ba4dcd1614a7 tempest-VolumesListAdminTestJSON-1654262711 None] Flow 'volume_create_manager' (2d5dc049-df64-4c5a-a36e-3d50204d5b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:53:57 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-a9ebcb5e-9f0b-4eed-964e-ba4dcd1614a7 tempest-VolumesListAdminTestJSON-1654262711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4679bad0-5a72-4748-a831-fb85da7432a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:57 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-a9ebcb5e-9f0b-4eed-964e-ba4dcd1614a7 tempest-VolumesListAdminTestJSON-1654262711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4679bad0-5a72-4748-a831-fb85da7432a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:53:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-50496469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a98af175-3327-4b28-9a26-c38a8e7d6608,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64c8f877ebd74d03be8bd5196170ce85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:53:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:53:58Z,use_quota=True,user_id='6b9436e99eba4a679a28818a3aa0996f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:57 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-a9ebcb5e-9f0b-4eed-964e-ba4dcd1614a7 tempest-VolumesListAdminTestJSON-1654262711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (935dc97f-7f1f-48c8-911c-b7954f5ba7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:57 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-a9ebcb5e-9f0b-4eed-964e-ba4dcd1614a7 tempest-VolumesListAdminTestJSON-1654262711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (935dc97f-7f1f-48c8-911c-b7954f5ba7b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:57 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-a9ebcb5e-9f0b-4eed-964e-ba4dcd1614a7 tempest-VolumesListAdminTestJSON-1654262711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be72a841-87c5-4951-84a0-fafdbed5a347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:57 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-a9ebcb5e-9f0b-4eed-964e-ba4dcd1614a7 tempest-VolumesListAdminTestJSON-1654262711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be72a841-87c5-4951-84a0-fafdbed5a347) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a98af175-3327-4b28-9a26-c38a8e7d6608', 'volume_name': 'volume-a98af175-3327-4b28-9a26-c38a8e7d6608', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:57 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-a9ebcb5e-9f0b-4eed-964e-ba4dcd1614a7 tempest-VolumesListAdminTestJSON-1654262711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fe03849-66d7-4024-922a-d870999dbebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:57 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-a9ebcb5e-9f0b-4eed-964e-ba4dcd1614a7 tempest-VolumesListAdminTestJSON-1654262711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fe03849-66d7-4024-922a-d870999dbebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:57 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-a9ebcb5e-9f0b-4eed-964e-ba4dcd1614a7 tempest-VolumesListAdminTestJSON-1654262711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b146f9d6-3014-4b72-9bdc-5935f1032d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:57 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-a9ebcb5e-9f0b-4eed-964e-ba4dcd1614a7 tempest-VolumesListAdminTestJSON-1654262711 None] Volume a98af175-3327-4b28-9a26-c38a8e7d6608: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a98af175-3327-4b28-9a26-c38a8e7d6608', 'volume_size': 1} Sep 25 11:53:57 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-a9ebcb5e-9f0b-4eed-964e-ba4dcd1614a7 tempest-VolumesListAdminTestJSON-1654262711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:53:57 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-a9ebcb5e-9f0b-4eed-964e-ba4dcd1614a7 tempest-VolumesListAdminTestJSON-1654262711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:53:57 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-a9ebcb5e-9f0b-4eed-964e-ba4dcd1614a7 tempest-VolumesListAdminTestJSON-1654262711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:53:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-50496469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a98af175-3327-4b28-9a26-c38a8e7d6608,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64c8f877ebd74d03be8bd5196170ce85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:53:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:53:58Z,use_quota=True,user_id='6b9436e99eba4a679a28818a3aa0996f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:53:57 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-a9ebcb5e-9f0b-4eed-964e-ba4dcd1614a7 tempest-VolumesListAdminTestJSON-1654262711 None] Creating volume a98af175-3327-4b28-9a26-c38a8e7d6608 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:53:57 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-a9ebcb5e-9f0b-4eed-964e-ba4dcd1614a7 tempest-VolumesListAdminTestJSON-1654262711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:53:57 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-a9ebcb5e-9f0b-4eed-964e-ba4dcd1614a7 tempest-VolumesListAdminTestJSON-1654262711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:53:57 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-a9ebcb5e-9f0b-4eed-964e-ba4dcd1614a7 tempest-VolumesListAdminTestJSON-1654262711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:53:57 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-a9ebcb5e-9f0b-4eed-964e-ba4dcd1614a7 tempest-VolumesListAdminTestJSON-1654262711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:53:57 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-a9ebcb5e-9f0b-4eed-964e-ba4dcd1614a7 tempest-VolumesListAdminTestJSON-1654262711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:53:57 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-a9ebcb5e-9f0b-4eed-964e-ba4dcd1614a7 tempest-VolumesListAdminTestJSON-1654262711 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:53:57 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-a9ebcb5e-9f0b-4eed-964e-ba4dcd1614a7 tempest-VolumesListAdminTestJSON-1654262711 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:53:57 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a9ebcb5e-9f0b-4eed-964e-ba4dcd1614a7 tempest-VolumesListAdminTestJSON-1654262711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a98af175-3327-4b28-9a26-c38a8e7d6608 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:58 devstack sudo[100768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a98af175-3327-4b28-9a26-c38a8e7d6608 1073741824 Sep 25 11:53:58 devstack sudo[100768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:58 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-bc7ca5ed-5d45-4c86-a520-1b49cf4f51a0 tempest-VolumesSnapshotNegativeTestJSON-577238856 None] Created reservations ['3f155b13-24df-4e98-9878-810459267d59', '577ab90f-aad4-4cba-a975-079cbc99024a', '204c78a8-8dd6-419c-a6b3-a5746e22df23', '786d873f-194b-4785-a677-5cc5e1857151'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:53:58 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-bc7ca5ed-5d45-4c86-a520-1b49cf4f51a0 tempest-VolumesSnapshotNegativeTestJSON-577238856 None] Delete snapshot completed successfully. Sep 25 11:53:58 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-bc7ca5ed-5d45-4c86-a520-1b49cf4f51a0 tempest-VolumesSnapshotNegativeTestJSON-577238856 None] Lock "cinder-60e47279-5d3f-49ea-bcf6-a40252d936ab-delete_snapshot" released by "delete_snapshot" :: held 3.042s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:53:58 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-eca0d964-b806-47e7-bce8-b79867a7c694 tempest-VolumesSnapshotNegativeTestJSON-577238856 None] Acquiring lock "cinder-fd8dabdb-a75d-4736-8e93-2590f60737ce-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:53:58 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-eca0d964-b806-47e7-bce8-b79867a7c694 tempest-VolumesSnapshotNegativeTestJSON-577238856 None] Lock "cinder-fd8dabdb-a75d-4736-8e93-2590f60737ce-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:53:58 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-eca0d964-b806-47e7-bce8-b79867a7c694 tempest-VolumesSnapshotNegativeTestJSON-577238856 None] Acquiring lock "cinder-quobyte-fd8dabdb-a75d-4736-8e93-2590f60737ce" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:53:58 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-eca0d964-b806-47e7-bce8-b79867a7c694 tempest-VolumesSnapshotNegativeTestJSON-577238856 None] Lock "cinder-quobyte-fd8dabdb-a75d-4736-8e93-2590f60737ce" acquired by "delete_volume" :: waited 0.028s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:53:58 devstack sudo[100768]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:58 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a9ebcb5e-9f0b-4eed-964e-ba4dcd1614a7 tempest-VolumesListAdminTestJSON-1654262711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a98af175-3327-4b28-9a26-c38a8e7d6608 1073741824" returned: 0 in 0.947s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:58 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[b58afd2f-01a4-4383-93f5-892458d8e30d]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:53:58 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-eca0d964-b806-47e7-bce8-b79867a7c694 tempest-VolumesSnapshotNegativeTestJSON-577238856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fd8dabdb-a75d-4736-8e93-2590f60737ce {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:59 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a9ebcb5e-9f0b-4eed-964e-ba4dcd1614a7 tempest-VolumesListAdminTestJSON-1654262711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a98af175-3327-4b28-9a26-c38a8e7d6608 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:59 devstack sudo[100775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a98af175-3327-4b28-9a26-c38a8e7d6608 Sep 25 11:53:59 devstack sudo[100775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:59 devstack sudo[100774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fd8dabdb-a75d-4736-8e93-2590f60737ce Sep 25 11:53:59 devstack sudo[100774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:59 devstack sudo[100775]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:59 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a9ebcb5e-9f0b-4eed-964e-ba4dcd1614a7 tempest-VolumesListAdminTestJSON-1654262711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a98af175-3327-4b28-9a26-c38a8e7d6608" returned: 0 in 0.320s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:59 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-a9ebcb5e-9f0b-4eed-964e-ba4dcd1614a7 tempest-VolumesListAdminTestJSON-1654262711 None] <== create_volume: return (1382ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:53:59 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-a9ebcb5e-9f0b-4eed-964e-ba4dcd1614a7 tempest-VolumesListAdminTestJSON-1654262711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.385s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:53:59 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-a9ebcb5e-9f0b-4eed-964e-ba4dcd1614a7 tempest-VolumesListAdminTestJSON-1654262711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b146f9d6-3014-4b72-9bdc-5935f1032d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a98af175-3327-4b28-9a26-c38a8e7d6608', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:59 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-a9ebcb5e-9f0b-4eed-964e-ba4dcd1614a7 tempest-VolumesListAdminTestJSON-1654262711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93c44c44-94bb-4d45-999a-5fe06519b15a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:53:59 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-a9ebcb5e-9f0b-4eed-964e-ba4dcd1614a7 tempest-VolumesListAdminTestJSON-1654262711 None] Volume volume-a98af175-3327-4b28-9a26-c38a8e7d6608 (a98af175-3327-4b28-9a26-c38a8e7d6608): created successfully Sep 25 11:53:59 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-a9ebcb5e-9f0b-4eed-964e-ba4dcd1614a7 tempest-VolumesListAdminTestJSON-1654262711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93c44c44-94bb-4d45-999a-5fe06519b15a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:53:59 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-a9ebcb5e-9f0b-4eed-964e-ba4dcd1614a7 tempest-VolumesListAdminTestJSON-1654262711 None] Flow 'volume_create_manager' (2d5dc049-df64-4c5a-a36e-3d50204d5b8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:53:59 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-a9ebcb5e-9f0b-4eed-964e-ba4dcd1614a7 tempest-VolumesListAdminTestJSON-1654262711 None] Created volume successfully. Sep 25 11:53:59 devstack sudo[100774]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:59 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-eca0d964-b806-47e7-bce8-b79867a7c694 tempest-VolumesSnapshotNegativeTestJSON-577238856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fd8dabdb-a75d-4736-8e93-2590f60737ce" returned: 0 in 0.601s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:59 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-eca0d964-b806-47e7-bce8-b79867a7c694 tempest-VolumesSnapshotNegativeTestJSON-577238856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fd8dabdb-a75d-4736-8e93-2590f60737ce {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:53:59 devstack sudo[100782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fd8dabdb-a75d-4736-8e93-2590f60737ce Sep 25 11:53:59 devstack sudo[100782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:53:59 devstack sudo[100782]: pam_unix(sudo:session): session closed for user root Sep 25 11:53:59 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-eca0d964-b806-47e7-bce8-b79867a7c694 tempest-VolumesSnapshotNegativeTestJSON-577238856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fd8dabdb-a75d-4736-8e93-2590f60737ce" returned: 0 in 0.431s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:53:59 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-eca0d964-b806-47e7-bce8-b79867a7c694 tempest-VolumesSnapshotNegativeTestJSON-577238856 None] Lock "cinder-quobyte-fd8dabdb-a75d-4736-8e93-2590f60737ce" released by "delete_volume" :: held 1.199s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:00 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-eca0d964-b806-47e7-bce8-b79867a7c694 tempest-VolumesSnapshotNegativeTestJSON-577238856 None] Created reservations ['39159e54-c989-4ff5-9143-335e0ea5d360', '785ae903-538d-4f2b-9814-6e8fdfefc987', '1e55e212-6052-42ac-979c-c8d934ca465e', '9e56b8a5-268d-4e63-80d8-481dae716771'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:54:00 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-eca0d964-b806-47e7-bce8-b79867a7c694 tempest-VolumesSnapshotNegativeTestJSON-577238856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:00 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-eca0d964-b806-47e7-bce8-b79867a7c694 tempest-VolumesSnapshotNegativeTestJSON-577238856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:00 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-eca0d964-b806-47e7-bce8-b79867a7c694 tempest-VolumesSnapshotNegativeTestJSON-577238856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:54:00 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-eca0d964-b806-47e7-bce8-b79867a7c694 tempest-VolumesSnapshotNegativeTestJSON-577238856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:54:00 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-eca0d964-b806-47e7-bce8-b79867a7c694 tempest-VolumesSnapshotNegativeTestJSON-577238856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:00 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-eca0d964-b806-47e7-bce8-b79867a7c694 tempest-VolumesSnapshotNegativeTestJSON-577238856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:00 devstack sudo[100785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:54:00 devstack sudo[100785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:00 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e779c1a-5426-4ac0-891f-5075d5db7b1e tempest-VolumeDependencyTests-1522524806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:54:00 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-0e779c1a-5426-4ac0-891f-5075d5db7b1e tempest-VolumeDependencyTests-1522524806 None] Flow 'volume_create_manager' (b5edf739-52ef-4758-9c52-f75ea3acd1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:54:00 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-0e779c1a-5426-4ac0-891f-5075d5db7b1e tempest-VolumeDependencyTests-1522524806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (002f50b1-bc1c-4891-ae3b-dfec0b0c0f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:00 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-0e779c1a-5426-4ac0-891f-5075d5db7b1e tempest-VolumeDependencyTests-1522524806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (002f50b1-bc1c-4891-ae3b-dfec0b0c0f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:54:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1108068256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80a9b336-e126-4957-99aa-ce4ca23eb87d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9cda76f7db44d7ca2fbed8557de15d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:54:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:54:01Z,use_quota=True,user_id='1326367ee09e4398b7051836aef9de8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:00 devstack sudo[100785]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:00 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-0e779c1a-5426-4ac0-891f-5075d5db7b1e tempest-VolumeDependencyTests-1522524806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bc8d710-dbc7-4368-84ff-8acca18d327e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:00 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-0e779c1a-5426-4ac0-891f-5075d5db7b1e tempest-VolumeDependencyTests-1522524806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bc8d710-dbc7-4368-84ff-8acca18d327e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:00 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-0e779c1a-5426-4ac0-891f-5075d5db7b1e tempest-VolumeDependencyTests-1522524806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5316100-e98e-40f2-a2e7-c9dbf9aee6d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:00 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-0e779c1a-5426-4ac0-891f-5075d5db7b1e tempest-VolumeDependencyTests-1522524806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5316100-e98e-40f2-a2e7-c9dbf9aee6d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80a9b336-e126-4957-99aa-ce4ca23eb87d', 'volume_name': 'volume-80a9b336-e126-4957-99aa-ce4ca23eb87d', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:00 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-0e779c1a-5426-4ac0-891f-5075d5db7b1e tempest-VolumeDependencyTests-1522524806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edc474ab-99fd-45d5-ab15-98b6bc3a1879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:00 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-0e779c1a-5426-4ac0-891f-5075d5db7b1e tempest-VolumeDependencyTests-1522524806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edc474ab-99fd-45d5-ab15-98b6bc3a1879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:00 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-0e779c1a-5426-4ac0-891f-5075d5db7b1e tempest-VolumeDependencyTests-1522524806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a90b7c1-50f3-4342-8508-313d542001ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:00 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-0e779c1a-5426-4ac0-891f-5075d5db7b1e tempest-VolumeDependencyTests-1522524806 None] Volume 80a9b336-e126-4957-99aa-ce4ca23eb87d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80a9b336-e126-4957-99aa-ce4ca23eb87d', 'volume_size': 1} Sep 25 11:54:00 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-0e779c1a-5426-4ac0-891f-5075d5db7b1e tempest-VolumeDependencyTests-1522524806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:00 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-0e779c1a-5426-4ac0-891f-5075d5db7b1e tempest-VolumeDependencyTests-1522524806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:00 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-0e779c1a-5426-4ac0-891f-5075d5db7b1e tempest-VolumeDependencyTests-1522524806 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:54:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1108068256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80a9b336-e126-4957-99aa-ce4ca23eb87d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9cda76f7db44d7ca2fbed8557de15d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:54:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:54:01Z,use_quota=True,user_id='1326367ee09e4398b7051836aef9de8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:54:00 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-0e779c1a-5426-4ac0-891f-5075d5db7b1e tempest-VolumeDependencyTests-1522524806 None] Creating volume 80a9b336-e126-4957-99aa-ce4ca23eb87d {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:54:00 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-0e779c1a-5426-4ac0-891f-5075d5db7b1e tempest-VolumeDependencyTests-1522524806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:00 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-0e779c1a-5426-4ac0-891f-5075d5db7b1e tempest-VolumeDependencyTests-1522524806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:00 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-0e779c1a-5426-4ac0-891f-5075d5db7b1e tempest-VolumeDependencyTests-1522524806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:54:00 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-0e779c1a-5426-4ac0-891f-5075d5db7b1e tempest-VolumeDependencyTests-1522524806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:54:00 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-0e779c1a-5426-4ac0-891f-5075d5db7b1e tempest-VolumeDependencyTests-1522524806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:00 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-0e779c1a-5426-4ac0-891f-5075d5db7b1e tempest-VolumeDependencyTests-1522524806 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:54:00 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-0e779c1a-5426-4ac0-891f-5075d5db7b1e tempest-VolumeDependencyTests-1522524806 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:54:00 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-0e779c1a-5426-4ac0-891f-5075d5db7b1e tempest-VolumeDependencyTests-1522524806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-80a9b336-e126-4957-99aa-ce4ca23eb87d 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:00 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-eca0d964-b806-47e7-bce8-b79867a7c694 tempest-VolumesSnapshotNegativeTestJSON-577238856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.772s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:00 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-eca0d964-b806-47e7-bce8-b79867a7c694 tempest-VolumesSnapshotNegativeTestJSON-577238856 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:54:01 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-eca0d964-b806-47e7-bce8-b79867a7c694 tempest-VolumesSnapshotNegativeTestJSON-577238856 None] Deleted volume successfully. Sep 25 11:54:01 devstack sudo[100788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-80a9b336-e126-4957-99aa-ce4ca23eb87d 1073741824 Sep 25 11:54:01 devstack sudo[100788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:01 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-eca0d964-b806-47e7-bce8-b79867a7c694 tempest-VolumesSnapshotNegativeTestJSON-577238856 None] Lock "cinder-fd8dabdb-a75d-4736-8e93-2590f60737ce-delete_volume" released by "delete_volume" :: held 2.422s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:01 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4fc6c7a-e453-4a70-8243-703968a0d19f tempest-SnapshotDependencyTests-534278840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:54:01 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b4fc6c7a-e453-4a70-8243-703968a0d19f tempest-SnapshotDependencyTests-534278840 None] Flow 'volume_create_manager' (5920aa66-6a6e-4900-a775-aa5b88130307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:54:01 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b4fc6c7a-e453-4a70-8243-703968a0d19f tempest-SnapshotDependencyTests-534278840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eb64213-e634-4c19-bf8b-99126fc86a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:01 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b4fc6c7a-e453-4a70-8243-703968a0d19f tempest-SnapshotDependencyTests-534278840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eb64213-e634-4c19-bf8b-99126fc86a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:54:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-482265897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=839b96d1-eaff-4d05-a0c4-90f85c79926b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a0283ac3db04bce8393b806fb200f11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:54:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:54:01Z,use_quota=True,user_id='3ef606c3131540c9928449f0b8d886fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:01 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b4fc6c7a-e453-4a70-8243-703968a0d19f tempest-SnapshotDependencyTests-534278840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c035c77-6179-49c6-8307-f9a2488ca071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:01 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b4fc6c7a-e453-4a70-8243-703968a0d19f tempest-SnapshotDependencyTests-534278840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c035c77-6179-49c6-8307-f9a2488ca071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:01 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b4fc6c7a-e453-4a70-8243-703968a0d19f tempest-SnapshotDependencyTests-534278840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9c64d07-5f93-4d12-85d5-1c3f8f5b6dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:01 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b4fc6c7a-e453-4a70-8243-703968a0d19f tempest-SnapshotDependencyTests-534278840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9c64d07-5f93-4d12-85d5-1c3f8f5b6dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '839b96d1-eaff-4d05-a0c4-90f85c79926b', 'volume_name': 'volume-839b96d1-eaff-4d05-a0c4-90f85c79926b', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:01 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b4fc6c7a-e453-4a70-8243-703968a0d19f tempest-SnapshotDependencyTests-534278840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd383d54-d6fc-4eab-8495-faf2d921ce6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:01 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b4fc6c7a-e453-4a70-8243-703968a0d19f tempest-SnapshotDependencyTests-534278840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd383d54-d6fc-4eab-8495-faf2d921ce6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:01 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b4fc6c7a-e453-4a70-8243-703968a0d19f tempest-SnapshotDependencyTests-534278840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f80120f-6b7d-4dc5-84fb-3cc3c3297af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:01 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-b4fc6c7a-e453-4a70-8243-703968a0d19f tempest-SnapshotDependencyTests-534278840 None] Volume 839b96d1-eaff-4d05-a0c4-90f85c79926b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-839b96d1-eaff-4d05-a0c4-90f85c79926b', 'volume_size': 1} Sep 25 11:54:01 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-b4fc6c7a-e453-4a70-8243-703968a0d19f tempest-SnapshotDependencyTests-534278840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:01 devstack sudo[100788]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:01 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-0e779c1a-5426-4ac0-891f-5075d5db7b1e tempest-VolumeDependencyTests-1522524806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-80a9b336-e126-4957-99aa-ce4ca23eb87d 1073741824" returned: 0 in 0.698s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:01 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-0e779c1a-5426-4ac0-891f-5075d5db7b1e tempest-VolumeDependencyTests-1522524806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-80a9b336-e126-4957-99aa-ce4ca23eb87d {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:01 devstack sudo[100794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-80a9b336-e126-4957-99aa-ce4ca23eb87d Sep 25 11:54:01 devstack sudo[100794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:02 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-44a10938-53ee-4859-a41f-966a3b4aeaf5 tempest-VolumesListAdminTestJSON-828607610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:54:02 devstack sudo[100794]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:02 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-44a10938-53ee-4859-a41f-966a3b4aeaf5 tempest-VolumesListAdminTestJSON-828607610 None] Flow 'volume_create_manager' (d4bfe5ab-d27e-432f-9536-9947a8a53514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:54:02 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-44a10938-53ee-4859-a41f-966a3b4aeaf5 tempest-VolumesListAdminTestJSON-828607610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dae27da-8d80-43dd-ab04-e353b1848124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:02 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-0e779c1a-5426-4ac0-891f-5075d5db7b1e tempest-VolumeDependencyTests-1522524806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-80a9b336-e126-4957-99aa-ce4ca23eb87d" returned: 0 in 0.502s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:02 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-0e779c1a-5426-4ac0-891f-5075d5db7b1e tempest-VolumeDependencyTests-1522524806 None] <== create_volume: return (1286ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:54:02 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-0e779c1a-5426-4ac0-891f-5075d5db7b1e tempest-VolumeDependencyTests-1522524806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.290s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:02 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-44a10938-53ee-4859-a41f-966a3b4aeaf5 tempest-VolumesListAdminTestJSON-828607610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dae27da-8d80-43dd-ab04-e353b1848124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:54:02Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df4aa186-9058-4203-bb1b-e7d82bc5b86b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='590a261ee6f94bf59d884f7459cce1d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:54:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:54:02Z,use_quota=True,user_id='7afb94f7ecbd436f902ba48f7cc1b0c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:02 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-44a10938-53ee-4859-a41f-966a3b4aeaf5 tempest-VolumesListAdminTestJSON-828607610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ea85154-4c5c-473c-86c1-963d158d15e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:02 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-44a10938-53ee-4859-a41f-966a3b4aeaf5 tempest-VolumesListAdminTestJSON-828607610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ea85154-4c5c-473c-86c1-963d158d15e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:02 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-44a10938-53ee-4859-a41f-966a3b4aeaf5 tempest-VolumesListAdminTestJSON-828607610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d9cf84d-74f9-44f7-92ab-c90fcdba3765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:02 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-44a10938-53ee-4859-a41f-966a3b4aeaf5 tempest-VolumesListAdminTestJSON-828607610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d9cf84d-74f9-44f7-92ab-c90fcdba3765) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df4aa186-9058-4203-bb1b-e7d82bc5b86b', 'volume_name': 'volume-df4aa186-9058-4203-bb1b-e7d82bc5b86b', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:02 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-44a10938-53ee-4859-a41f-966a3b4aeaf5 tempest-VolumesListAdminTestJSON-828607610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f19f9393-973a-44e2-9cfe-02acc4d583f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:02 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-44a10938-53ee-4859-a41f-966a3b4aeaf5 tempest-VolumesListAdminTestJSON-828607610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f19f9393-973a-44e2-9cfe-02acc4d583f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:02 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-44a10938-53ee-4859-a41f-966a3b4aeaf5 tempest-VolumesListAdminTestJSON-828607610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89e7605a-0613-4d61-936b-dea4a75a0166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:02 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-44a10938-53ee-4859-a41f-966a3b4aeaf5 tempest-VolumesListAdminTestJSON-828607610 None] Volume df4aa186-9058-4203-bb1b-e7d82bc5b86b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df4aa186-9058-4203-bb1b-e7d82bc5b86b', 'volume_size': 1} Sep 25 11:54:02 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-44a10938-53ee-4859-a41f-966a3b4aeaf5 tempest-VolumesListAdminTestJSON-828607610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:02 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-44a10938-53ee-4859-a41f-966a3b4aeaf5 tempest-VolumesListAdminTestJSON-828607610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:02 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-44a10938-53ee-4859-a41f-966a3b4aeaf5 tempest-VolumesListAdminTestJSON-828607610 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:54:02Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df4aa186-9058-4203-bb1b-e7d82bc5b86b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='590a261ee6f94bf59d884f7459cce1d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:54:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:54:02Z,use_quota=True,user_id='7afb94f7ecbd436f902ba48f7cc1b0c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:54:02 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-44a10938-53ee-4859-a41f-966a3b4aeaf5 tempest-VolumesListAdminTestJSON-828607610 None] Creating volume df4aa186-9058-4203-bb1b-e7d82bc5b86b {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:54:02 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-44a10938-53ee-4859-a41f-966a3b4aeaf5 tempest-VolumesListAdminTestJSON-828607610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:02 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-44a10938-53ee-4859-a41f-966a3b4aeaf5 tempest-VolumesListAdminTestJSON-828607610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:02 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-44a10938-53ee-4859-a41f-966a3b4aeaf5 tempest-VolumesListAdminTestJSON-828607610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:54:02 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-44a10938-53ee-4859-a41f-966a3b4aeaf5 tempest-VolumesListAdminTestJSON-828607610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:54:02 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-44a10938-53ee-4859-a41f-966a3b4aeaf5 tempest-VolumesListAdminTestJSON-828607610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:02 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-44a10938-53ee-4859-a41f-966a3b4aeaf5 tempest-VolumesListAdminTestJSON-828607610 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:54:02 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-44a10938-53ee-4859-a41f-966a3b4aeaf5 tempest-VolumesListAdminTestJSON-828607610 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:54:02 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-44a10938-53ee-4859-a41f-966a3b4aeaf5 tempest-VolumesListAdminTestJSON-828607610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-df4aa186-9058-4203-bb1b-e7d82bc5b86b 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:02 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-0e779c1a-5426-4ac0-891f-5075d5db7b1e tempest-VolumeDependencyTests-1522524806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a90b7c1-50f3-4342-8508-313d542001ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80a9b336-e126-4957-99aa-ce4ca23eb87d', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:02 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-0e779c1a-5426-4ac0-891f-5075d5db7b1e tempest-VolumeDependencyTests-1522524806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e0ef99b-d9dc-4562-b030-3aff2fa6a367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:02 devstack sudo[100797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-df4aa186-9058-4203-bb1b-e7d82bc5b86b 1073741824 Sep 25 11:54:02 devstack sudo[100797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:02 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-0e779c1a-5426-4ac0-891f-5075d5db7b1e tempest-VolumeDependencyTests-1522524806 None] Volume volume-80a9b336-e126-4957-99aa-ce4ca23eb87d (80a9b336-e126-4957-99aa-ce4ca23eb87d): created successfully Sep 25 11:54:02 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-0e779c1a-5426-4ac0-891f-5075d5db7b1e tempest-VolumeDependencyTests-1522524806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e0ef99b-d9dc-4562-b030-3aff2fa6a367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:02 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-0e779c1a-5426-4ac0-891f-5075d5db7b1e tempest-VolumeDependencyTests-1522524806 None] Flow 'volume_create_manager' (b5edf739-52ef-4758-9c52-f75ea3acd1d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:54:02 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-0e779c1a-5426-4ac0-891f-5075d5db7b1e tempest-VolumeDependencyTests-1522524806 None] Created volume successfully. Sep 25 11:54:03 devstack sudo[100797]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-44a10938-53ee-4859-a41f-966a3b4aeaf5 tempest-VolumesListAdminTestJSON-828607610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-df4aa186-9058-4203-bb1b-e7d82bc5b86b 1073741824" returned: 0 in 0.812s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-44a10938-53ee-4859-a41f-966a3b4aeaf5 tempest-VolumesListAdminTestJSON-828607610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-df4aa186-9058-4203-bb1b-e7d82bc5b86b {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:03 devstack sudo[100804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-df4aa186-9058-4203-bb1b-e7d82bc5b86b Sep 25 11:54:03 devstack sudo[100804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-503b3f43-b253-4858-8509-4cfd87233123 tempest-VolumeDependencyTests-1522524806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:03 devstack sudo[100804]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-44a10938-53ee-4859-a41f-966a3b4aeaf5 tempest-VolumesListAdminTestJSON-828607610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-df4aa186-9058-4203-bb1b-e7d82bc5b86b" returned: 0 in 0.311s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:03 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-44a10938-53ee-4859-a41f-966a3b4aeaf5 tempest-VolumesListAdminTestJSON-828607610 None] <== create_volume: return (1209ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:54:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-44a10938-53ee-4859-a41f-966a3b4aeaf5 tempest-VolumesListAdminTestJSON-828607610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.211s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-b4fc6c7a-e453-4a70-8243-703968a0d19f tempest-SnapshotDependencyTests-534278840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.106s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:03 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-b4fc6c7a-e453-4a70-8243-703968a0d19f tempest-SnapshotDependencyTests-534278840 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:54:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-482265897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=839b96d1-eaff-4d05-a0c4-90f85c79926b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a0283ac3db04bce8393b806fb200f11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:54:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:54:01Z,use_quota=True,user_id='3ef606c3131540c9928449f0b8d886fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:54:03 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-b4fc6c7a-e453-4a70-8243-703968a0d19f tempest-SnapshotDependencyTests-534278840 None] Creating volume 839b96d1-eaff-4d05-a0c4-90f85c79926b {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:54:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-b4fc6c7a-e453-4a70-8243-703968a0d19f tempest-SnapshotDependencyTests-534278840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-b4fc6c7a-e453-4a70-8243-703968a0d19f tempest-SnapshotDependencyTests-534278840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:03 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-b4fc6c7a-e453-4a70-8243-703968a0d19f tempest-SnapshotDependencyTests-534278840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:54:03 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-b4fc6c7a-e453-4a70-8243-703968a0d19f tempest-SnapshotDependencyTests-534278840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:54:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-b4fc6c7a-e453-4a70-8243-703968a0d19f tempest-SnapshotDependencyTests-534278840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:03 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-b4fc6c7a-e453-4a70-8243-703968a0d19f tempest-SnapshotDependencyTests-534278840 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:54:03 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-b4fc6c7a-e453-4a70-8243-703968a0d19f tempest-SnapshotDependencyTests-534278840 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:54:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-b4fc6c7a-e453-4a70-8243-703968a0d19f tempest-SnapshotDependencyTests-534278840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-839b96d1-eaff-4d05-a0c4-90f85c79926b 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:03 devstack sudo[100808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-839b96d1-eaff-4d05-a0c4-90f85c79926b 1073741824 Sep 25 11:54:03 devstack sudo[100808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:03 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-44a10938-53ee-4859-a41f-966a3b4aeaf5 tempest-VolumesListAdminTestJSON-828607610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89e7605a-0613-4d61-936b-dea4a75a0166) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df4aa186-9058-4203-bb1b-e7d82bc5b86b', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:03 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-44a10938-53ee-4859-a41f-966a3b4aeaf5 tempest-VolumesListAdminTestJSON-828607610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15d86907-21f5-4221-80fc-19487ee058d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:03 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-44a10938-53ee-4859-a41f-966a3b4aeaf5 tempest-VolumesListAdminTestJSON-828607610 None] Volume volume-df4aa186-9058-4203-bb1b-e7d82bc5b86b (df4aa186-9058-4203-bb1b-e7d82bc5b86b): created successfully Sep 25 11:54:03 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-44a10938-53ee-4859-a41f-966a3b4aeaf5 tempest-VolumesListAdminTestJSON-828607610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15d86907-21f5-4221-80fc-19487ee058d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:03 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-44a10938-53ee-4859-a41f-966a3b4aeaf5 tempest-VolumesListAdminTestJSON-828607610 None] Flow 'volume_create_manager' (d4bfe5ab-d27e-432f-9536-9947a8a53514) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:54:03 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-44a10938-53ee-4859-a41f-966a3b4aeaf5 tempest-VolumesListAdminTestJSON-828607610 None] Created volume successfully. Sep 25 11:54:04 devstack sudo[100808]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:04 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-b4fc6c7a-e453-4a70-8243-703968a0d19f tempest-SnapshotDependencyTests-534278840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-839b96d1-eaff-4d05-a0c4-90f85c79926b 1073741824" returned: 0 in 0.700s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:04 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-b4fc6c7a-e453-4a70-8243-703968a0d19f tempest-SnapshotDependencyTests-534278840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-839b96d1-eaff-4d05-a0c4-90f85c79926b {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:04 devstack sudo[100814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-839b96d1-eaff-4d05-a0c4-90f85c79926b Sep 25 11:54:04 devstack sudo[100814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:04 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-9454f550-7426-485a-86e4-0bcd2c8e38cb tempest-VolumesListAdminTestJSON-828607610 None] Acquiring lock "cinder-df4aa186-9058-4203-bb1b-e7d82bc5b86b-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:04 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-9454f550-7426-485a-86e4-0bcd2c8e38cb tempest-VolumesListAdminTestJSON-828607610 None] Lock "cinder-df4aa186-9058-4203-bb1b-e7d82bc5b86b-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:04 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-9454f550-7426-485a-86e4-0bcd2c8e38cb tempest-VolumesListAdminTestJSON-828607610 None] Acquiring lock "cinder-quobyte-df4aa186-9058-4203-bb1b-e7d82bc5b86b" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:04 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-9454f550-7426-485a-86e4-0bcd2c8e38cb tempest-VolumesListAdminTestJSON-828607610 None] Lock "cinder-quobyte-df4aa186-9058-4203-bb1b-e7d82bc5b86b" acquired by "delete_volume" :: waited 0.016s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:04 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[d609c1f6-7823-4fc8-a9c3-22ed1641d816]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:54:04 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-9454f550-7426-485a-86e4-0bcd2c8e38cb tempest-VolumesListAdminTestJSON-828607610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-df4aa186-9058-4203-bb1b-e7d82bc5b86b {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:04 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-336b99bc-a152-4046-b7f1-ab1250e019b1 tempest-VolumesListAdminTestJSON-1654262711 None] Acquiring lock "cinder-a98af175-3327-4b28-9a26-c38a8e7d6608-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:04 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-336b99bc-a152-4046-b7f1-ab1250e019b1 tempest-VolumesListAdminTestJSON-1654262711 None] Lock "cinder-a98af175-3327-4b28-9a26-c38a8e7d6608-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:04 devstack sudo[100816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-df4aa186-9058-4203-bb1b-e7d82bc5b86b Sep 25 11:54:04 devstack sudo[100816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:04 devstack sudo[100814]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:04 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-b4fc6c7a-e453-4a70-8243-703968a0d19f tempest-SnapshotDependencyTests-534278840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-839b96d1-eaff-4d05-a0c4-90f85c79926b" returned: 0 in 0.493s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:04 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-b4fc6c7a-e453-4a70-8243-703968a0d19f tempest-SnapshotDependencyTests-534278840 None] <== create_volume: return (1264ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:54:04 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-b4fc6c7a-e453-4a70-8243-703968a0d19f tempest-SnapshotDependencyTests-534278840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.270s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:04 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-503b3f43-b253-4858-8509-4cfd87233123 tempest-VolumeDependencyTests-1522524806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.330s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:04 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-336b99bc-a152-4046-b7f1-ab1250e019b1 tempest-VolumesListAdminTestJSON-1654262711 None] Acquiring lock "cinder-quobyte-a98af175-3327-4b28-9a26-c38a8e7d6608" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:04 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-503b3f43-b253-4858-8509-4cfd87233123 tempest-VolumeDependencyTests-1522524806 None] Creating offline snapshot 02268ee5-b4cf-4c0c-9b39-15656bbeff8c of volume 80a9b336-e126-4957-99aa-ce4ca23eb87d {{(pid=86984) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:54:04 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b4fc6c7a-e453-4a70-8243-703968a0d19f tempest-SnapshotDependencyTests-534278840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f80120f-6b7d-4dc5-84fb-3cc3c3297af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-839b96d1-eaff-4d05-a0c4-90f85c79926b', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:04 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b4fc6c7a-e453-4a70-8243-703968a0d19f tempest-SnapshotDependencyTests-534278840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af28a2f0-9243-4ebf-9f7b-14bf92ed0fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:04 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-336b99bc-a152-4046-b7f1-ab1250e019b1 tempest-VolumesListAdminTestJSON-1654262711 None] Lock "cinder-quobyte-a98af175-3327-4b28-9a26-c38a8e7d6608" acquired by "delete_volume" :: waited 0.061s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:04 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8fd912a-51f5-4346-84cf-dd78743a744c]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:54:04 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-503b3f43-b253-4858-8509-4cfd87233123 tempest-VolumeDependencyTests-1522524806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-80a9b336-e126-4957-99aa-ce4ca23eb87d {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:04 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2d76c2-d6e5-4bd8-bf75-c9a7f100690e]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:54:04 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-336b99bc-a152-4046-b7f1-ab1250e019b1 tempest-VolumesListAdminTestJSON-1654262711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a98af175-3327-4b28-9a26-c38a8e7d6608 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:04 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-b4fc6c7a-e453-4a70-8243-703968a0d19f tempest-SnapshotDependencyTests-534278840 None] Volume volume-839b96d1-eaff-4d05-a0c4-90f85c79926b (839b96d1-eaff-4d05-a0c4-90f85c79926b): created successfully Sep 25 11:54:04 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b4fc6c7a-e453-4a70-8243-703968a0d19f tempest-SnapshotDependencyTests-534278840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af28a2f0-9243-4ebf-9f7b-14bf92ed0fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:04 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b4fc6c7a-e453-4a70-8243-703968a0d19f tempest-SnapshotDependencyTests-534278840 None] Flow 'volume_create_manager' (5920aa66-6a6e-4900-a775-aa5b88130307) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:54:04 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-b4fc6c7a-e453-4a70-8243-703968a0d19f tempest-SnapshotDependencyTests-534278840 None] Created volume successfully. Sep 25 11:54:05 devstack sudo[100819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-80a9b336-e126-4957-99aa-ce4ca23eb87d Sep 25 11:54:05 devstack sudo[100819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:05 devstack sudo[100820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a98af175-3327-4b28-9a26-c38a8e7d6608 Sep 25 11:54:05 devstack sudo[100820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:05 devstack sudo[100816]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-9454f550-7426-485a-86e4-0bcd2c8e38cb tempest-VolumesListAdminTestJSON-828607610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-df4aa186-9058-4203-bb1b-e7d82bc5b86b" returned: 0 in 0.577s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-9454f550-7426-485a-86e4-0bcd2c8e38cb tempest-VolumesListAdminTestJSON-828607610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-df4aa186-9058-4203-bb1b-e7d82bc5b86b {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:05 devstack sudo[100827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-df4aa186-9058-4203-bb1b-e7d82bc5b86b Sep 25 11:54:05 devstack sudo[100827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:05 devstack sudo[100820]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-336b99bc-a152-4046-b7f1-ab1250e019b1 tempest-VolumesListAdminTestJSON-1654262711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a98af175-3327-4b28-9a26-c38a8e7d6608" returned: 0 in 0.610s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-336b99bc-a152-4046-b7f1-ab1250e019b1 tempest-VolumesListAdminTestJSON-1654262711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a98af175-3327-4b28-9a26-c38a8e7d6608 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:05 devstack sudo[100819]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-503b3f43-b253-4858-8509-4cfd87233123 tempest-VolumeDependencyTests-1522524806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-80a9b336-e126-4957-99aa-ce4ca23eb87d" returned: 0 in 0.687s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-503b3f43-b253-4858-8509-4cfd87233123 tempest-VolumeDependencyTests-1522524806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-80a9b336-e126-4957-99aa-ce4ca23eb87d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-80a9b336-e126-4957-99aa-ce4ca23eb87d.02268ee5-b4cf-4c0c-9b39-15656bbeff8c 1G {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:05 devstack sudo[100837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a98af175-3327-4b28-9a26-c38a8e7d6608 Sep 25 11:54:05 devstack sudo[100837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:05 devstack sudo[100839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-80a9b336-e126-4957-99aa-ce4ca23eb87d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-80a9b336-e126-4957-99aa-ce4ca23eb87d.02268ee5-b4cf-4c0c-9b39-15656bbeff8c 1G Sep 25 11:54:05 devstack sudo[100839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:05 devstack sudo[100827]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-9454f550-7426-485a-86e4-0bcd2c8e38cb tempest-VolumesListAdminTestJSON-828607610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-df4aa186-9058-4203-bb1b-e7d82bc5b86b" returned: 0 in 0.600s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:05 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-9454f550-7426-485a-86e4-0bcd2c8e38cb tempest-VolumesListAdminTestJSON-828607610 None] Lock "cinder-quobyte-df4aa186-9058-4203-bb1b-e7d82bc5b86b" released by "delete_volume" :: held 1.274s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:05 devstack sudo[100837]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-336b99bc-a152-4046-b7f1-ab1250e019b1 tempest-VolumesListAdminTestJSON-1654262711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a98af175-3327-4b28-9a26-c38a8e7d6608" returned: 0 in 0.399s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:05 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-336b99bc-a152-4046-b7f1-ab1250e019b1 tempest-VolumesListAdminTestJSON-1654262711 None] Lock "cinder-quobyte-a98af175-3327-4b28-9a26-c38a8e7d6608" released by "delete_volume" :: held 1.119s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:05 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-9454f550-7426-485a-86e4-0bcd2c8e38cb tempest-VolumesListAdminTestJSON-828607610 None] Created reservations ['324e107d-c297-4f3f-836f-0cd9a64d1450', '83aefe63-23a6-4e23-bab6-59e6edb20742', '9bcc4444-b286-48ac-bb5b-7aa862a323e9', '1df222ff-dd13-4b88-8562-f8f9ada0c495'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:54:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-b4026e44-eaa2-4971-a286-0937286cac7a tempest-SnapshotDependencyTests-534278840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:06 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-336b99bc-a152-4046-b7f1-ab1250e019b1 tempest-VolumesListAdminTestJSON-1654262711 None] Created reservations ['2715e924-3738-4ac3-a7a9-008c62696bfb', '2c903dfa-ee8d-4a85-83ad-e2b89614c8ee', '190e71f9-947c-4547-80f1-24fa8e8dd2db', '8b1266b2-f58b-4d14-b4c1-8c17eb93e465'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:54:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-9454f550-7426-485a-86e4-0bcd2c8e38cb tempest-VolumesListAdminTestJSON-828607610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-9454f550-7426-485a-86e4-0bcd2c8e38cb tempest-VolumesListAdminTestJSON-828607610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:06 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-9454f550-7426-485a-86e4-0bcd2c8e38cb tempest-VolumesListAdminTestJSON-828607610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:54:06 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-9454f550-7426-485a-86e4-0bcd2c8e38cb tempest-VolumesListAdminTestJSON-828607610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:54:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-9454f550-7426-485a-86e4-0bcd2c8e38cb tempest-VolumesListAdminTestJSON-828607610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-9454f550-7426-485a-86e4-0bcd2c8e38cb tempest-VolumesListAdminTestJSON-828607610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:06 devstack sudo[100846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:54:06 devstack sudo[100846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-336b99bc-a152-4046-b7f1-ab1250e019b1 tempest-VolumesListAdminTestJSON-1654262711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-336b99bc-a152-4046-b7f1-ab1250e019b1 tempest-VolumesListAdminTestJSON-1654262711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:06 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-336b99bc-a152-4046-b7f1-ab1250e019b1 tempest-VolumesListAdminTestJSON-1654262711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:54:06 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-336b99bc-a152-4046-b7f1-ab1250e019b1 tempest-VolumesListAdminTestJSON-1654262711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:54:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-336b99bc-a152-4046-b7f1-ab1250e019b1 tempest-VolumesListAdminTestJSON-1654262711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-336b99bc-a152-4046-b7f1-ab1250e019b1 tempest-VolumesListAdminTestJSON-1654262711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:06 devstack sudo[100849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:54:06 devstack sudo[100849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:06 devstack sudo[100839]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-503b3f43-b253-4858-8509-4cfd87233123 tempest-VolumeDependencyTests-1522524806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-80a9b336-e126-4957-99aa-ce4ca23eb87d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-80a9b336-e126-4957-99aa-ce4ca23eb87d.02268ee5-b4cf-4c0c-9b39-15656bbeff8c 1G" returned: 0 in 0.806s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-503b3f43-b253-4858-8509-4cfd87233123 tempest-VolumeDependencyTests-1522524806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80a9b336-e126-4957-99aa-ce4ca23eb87d -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-80a9b336-e126-4957-99aa-ce4ca23eb87d.02268ee5-b4cf-4c0c-9b39-15656bbeff8c {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:06 devstack sudo[100851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80a9b336-e126-4957-99aa-ce4ca23eb87d -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-80a9b336-e126-4957-99aa-ce4ca23eb87d.02268ee5-b4cf-4c0c-9b39-15656bbeff8c Sep 25 11:54:06 devstack sudo[100851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:06 devstack sudo[100846]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-9454f550-7426-485a-86e4-0bcd2c8e38cb tempest-VolumesListAdminTestJSON-828607610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.400s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:06 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-9454f550-7426-485a-86e4-0bcd2c8e38cb tempest-VolumesListAdminTestJSON-828607610 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:54:06 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-9454f550-7426-485a-86e4-0bcd2c8e38cb tempest-VolumesListAdminTestJSON-828607610 None] Deleted volume successfully. Sep 25 11:54:06 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-9454f550-7426-485a-86e4-0bcd2c8e38cb tempest-VolumesListAdminTestJSON-828607610 None] Lock "cinder-df4aa186-9058-4203-bb1b-e7d82bc5b86b-delete_volume" released by "delete_volume" :: held 2.164s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:06 devstack sudo[100849]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-336b99bc-a152-4046-b7f1-ab1250e019b1 tempest-VolumesListAdminTestJSON-1654262711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.508s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:06 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-336b99bc-a152-4046-b7f1-ab1250e019b1 tempest-VolumesListAdminTestJSON-1654262711 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:54:06 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-336b99bc-a152-4046-b7f1-ab1250e019b1 tempest-VolumesListAdminTestJSON-1654262711 None] Deleted volume successfully. Sep 25 11:54:06 devstack sudo[100851]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-503b3f43-b253-4858-8509-4cfd87233123 tempest-VolumeDependencyTests-1522524806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80a9b336-e126-4957-99aa-ce4ca23eb87d -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-80a9b336-e126-4957-99aa-ce4ca23eb87d.02268ee5-b4cf-4c0c-9b39-15656bbeff8c" returned: 0 in 0.471s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:06 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-503b3f43-b253-4858-8509-4cfd87233123 tempest-VolumeDependencyTests-1522524806 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-80a9b336-e126-4957-99aa-ce4ca23eb87d.02268ee5-b4cf-4c0c-9b39-15656bbeff8c is being set with open permissions: ugo+rw Sep 25 11:54:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-503b3f43-b253-4858-8509-4cfd87233123 tempest-VolumeDependencyTests-1522524806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-80a9b336-e126-4957-99aa-ce4ca23eb87d.02268ee5-b4cf-4c0c-9b39-15656bbeff8c {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:06 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-336b99bc-a152-4046-b7f1-ab1250e019b1 tempest-VolumesListAdminTestJSON-1654262711 None] Lock "cinder-a98af175-3327-4b28-9a26-c38a8e7d6608-delete_volume" released by "delete_volume" :: held 2.165s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:06 devstack sudo[100858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-80a9b336-e126-4957-99aa-ce4ca23eb87d.02268ee5-b4cf-4c0c-9b39-15656bbeff8c Sep 25 11:54:06 devstack sudo[100858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:07 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-3855ffc4-316f-4a92-9307-d26946ed9ed0 tempest-VolumesListAdminTestJSON-1654262711 None] Acquiring lock "cinder-8e1bdcf5-b093-4c86-b4ce-349c70f26777-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:07 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-3855ffc4-316f-4a92-9307-d26946ed9ed0 tempest-VolumesListAdminTestJSON-1654262711 None] Lock "cinder-8e1bdcf5-b093-4c86-b4ce-349c70f26777-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:07 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-3855ffc4-316f-4a92-9307-d26946ed9ed0 tempest-VolumesListAdminTestJSON-1654262711 None] Acquiring lock "cinder-quobyte-8e1bdcf5-b093-4c86-b4ce-349c70f26777" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:07 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-3855ffc4-316f-4a92-9307-d26946ed9ed0 tempest-VolumesListAdminTestJSON-1654262711 None] Lock "cinder-quobyte-8e1bdcf5-b093-4c86-b4ce-349c70f26777" acquired by "delete_volume" :: waited 0.027s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:07 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[c59a0cdb-e05d-4426-94b8-0a037e816059]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:54:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3855ffc4-316f-4a92-9307-d26946ed9ed0 tempest-VolumesListAdminTestJSON-1654262711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8e1bdcf5-b093-4c86-b4ce-349c70f26777 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:07 devstack sudo[100858]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-503b3f43-b253-4858-8509-4cfd87233123 tempest-VolumeDependencyTests-1522524806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-80a9b336-e126-4957-99aa-ce4ca23eb87d.02268ee5-b4cf-4c0c-9b39-15656bbeff8c" returned: 0 in 0.463s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-503b3f43-b253-4858-8509-4cfd87233123 tempest-VolumeDependencyTests-1522524806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-80a9b336-e126-4957-99aa-ce4ca23eb87d.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:07 devstack sudo[100862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-80a9b336-e126-4957-99aa-ce4ca23eb87d.info Sep 25 11:54:07 devstack sudo[100862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:07 devstack sudo[100861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8e1bdcf5-b093-4c86-b4ce-349c70f26777 Sep 25 11:54:07 devstack sudo[100861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:07 devstack sudo[100862]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-503b3f43-b253-4858-8509-4cfd87233123 tempest-VolumeDependencyTests-1522524806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-80a9b336-e126-4957-99aa-ce4ca23eb87d.info" returned: 0 in 0.332s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:07 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-503b3f43-b253-4858-8509-4cfd87233123 tempest-VolumeDependencyTests-1522524806 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-80a9b336-e126-4957-99aa-ce4ca23eb87d.info is being set with open permissions: ugo+rw Sep 25 11:54:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-503b3f43-b253-4858-8509-4cfd87233123 tempest-VolumeDependencyTests-1522524806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-80a9b336-e126-4957-99aa-ce4ca23eb87d.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:07 devstack sudo[100869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-80a9b336-e126-4957-99aa-ce4ca23eb87d.info Sep 25 11:54:07 devstack sudo[100869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:07 devstack sudo[100861]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3855ffc4-316f-4a92-9307-d26946ed9ed0 tempest-VolumesListAdminTestJSON-1654262711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8e1bdcf5-b093-4c86-b4ce-349c70f26777" returned: 0 in 0.464s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3855ffc4-316f-4a92-9307-d26946ed9ed0 tempest-VolumesListAdminTestJSON-1654262711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8e1bdcf5-b093-4c86-b4ce-349c70f26777 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:07 devstack sudo[100871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8e1bdcf5-b093-4c86-b4ce-349c70f26777 Sep 25 11:54:07 devstack sudo[100871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:07 devstack sudo[100869]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-503b3f43-b253-4858-8509-4cfd87233123 tempest-VolumeDependencyTests-1522524806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-80a9b336-e126-4957-99aa-ce4ca23eb87d.info" returned: 0 in 0.288s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-503b3f43-b253-4858-8509-4cfd87233123 tempest-VolumeDependencyTests-1522524806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.215s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-b4026e44-eaa2-4971-a286-0937286cac7a tempest-SnapshotDependencyTests-534278840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.954s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:08 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-b4026e44-eaa2-4971-a286-0937286cac7a tempest-SnapshotDependencyTests-534278840 None] Creating offline snapshot 080ce69e-aa83-4668-ad32-b20472f65f4a of volume 839b96d1-eaff-4d05-a0c4-90f85c79926b {{(pid=86984) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:54:08 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[c258a279-7915-4914-a023-bb8bb71ca6b9]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:54:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-b4026e44-eaa2-4971-a286-0937286cac7a tempest-SnapshotDependencyTests-534278840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-839b96d1-eaff-4d05-a0c4-90f85c79926b {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:08 devstack sudo[100871]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3855ffc4-316f-4a92-9307-d26946ed9ed0 tempest-VolumesListAdminTestJSON-1654262711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-8e1bdcf5-b093-4c86-b4ce-349c70f26777" returned: 0 in 0.340s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:08 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-503b3f43-b253-4858-8509-4cfd87233123 tempest-VolumeDependencyTests-1522524806 None] Create snapshot completed successfully Sep 25 11:54:08 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-3855ffc4-316f-4a92-9307-d26946ed9ed0 tempest-VolumesListAdminTestJSON-1654262711 None] Lock "cinder-quobyte-8e1bdcf5-b093-4c86-b4ce-349c70f26777" released by "delete_volume" :: held 0.881s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:08 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-3855ffc4-316f-4a92-9307-d26946ed9ed0 tempest-VolumesListAdminTestJSON-1654262711 None] Created reservations ['c459d78f-ba5a-4635-8e58-d0fcc38a723f', 'cff355aa-c942-40d2-8e34-6398dde07a8c', '2019e378-f322-413e-be80-df2d39168253', '486a5491-ecb9-4f63-97c0-f48eabacf700'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:54:08 devstack sudo[100875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-839b96d1-eaff-4d05-a0c4-90f85c79926b Sep 25 11:54:08 devstack sudo[100875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3855ffc4-316f-4a92-9307-d26946ed9ed0 tempest-VolumesListAdminTestJSON-1654262711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3855ffc4-316f-4a92-9307-d26946ed9ed0 tempest-VolumesListAdminTestJSON-1654262711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:08 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3855ffc4-316f-4a92-9307-d26946ed9ed0 tempest-VolumesListAdminTestJSON-1654262711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:54:08 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3855ffc4-316f-4a92-9307-d26946ed9ed0 tempest-VolumesListAdminTestJSON-1654262711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:54:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3855ffc4-316f-4a92-9307-d26946ed9ed0 tempest-VolumesListAdminTestJSON-1654262711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3855ffc4-316f-4a92-9307-d26946ed9ed0 tempest-VolumesListAdminTestJSON-1654262711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:08 devstack sudo[100877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:54:08 devstack sudo[100877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:08 devstack sudo[100875]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-b4026e44-eaa2-4971-a286-0937286cac7a tempest-SnapshotDependencyTests-534278840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-839b96d1-eaff-4d05-a0c4-90f85c79926b" returned: 0 in 0.462s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-b4026e44-eaa2-4971-a286-0937286cac7a tempest-SnapshotDependencyTests-534278840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-839b96d1-eaff-4d05-a0c4-90f85c79926b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-839b96d1-eaff-4d05-a0c4-90f85c79926b.080ce69e-aa83-4668-ad32-b20472f65f4a 1G {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:08 devstack sudo[100877]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:08 devstack sudo[100883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-839b96d1-eaff-4d05-a0c4-90f85c79926b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-839b96d1-eaff-4d05-a0c4-90f85c79926b.080ce69e-aa83-4668-ad32-b20472f65f4a 1G Sep 25 11:54:08 devstack sudo[100883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3855ffc4-316f-4a92-9307-d26946ed9ed0 tempest-VolumesListAdminTestJSON-1654262711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.294s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:08 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-3855ffc4-316f-4a92-9307-d26946ed9ed0 tempest-VolumesListAdminTestJSON-1654262711 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:54:08 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-3855ffc4-316f-4a92-9307-d26946ed9ed0 tempest-VolumesListAdminTestJSON-1654262711 None] Deleted volume successfully. Sep 25 11:54:08 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-3855ffc4-316f-4a92-9307-d26946ed9ed0 tempest-VolumesListAdminTestJSON-1654262711 None] Lock "cinder-8e1bdcf5-b093-4c86-b4ce-349c70f26777-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:09 devstack sudo[100883]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-b4026e44-eaa2-4971-a286-0937286cac7a tempest-SnapshotDependencyTests-534278840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-839b96d1-eaff-4d05-a0c4-90f85c79926b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-839b96d1-eaff-4d05-a0c4-90f85c79926b.080ce69e-aa83-4668-ad32-b20472f65f4a 1G" returned: 0 in 0.568s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-b4026e44-eaa2-4971-a286-0937286cac7a tempest-SnapshotDependencyTests-534278840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-839b96d1-eaff-4d05-a0c4-90f85c79926b -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-839b96d1-eaff-4d05-a0c4-90f85c79926b.080ce69e-aa83-4668-ad32-b20472f65f4a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:09 devstack sudo[100889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-839b96d1-eaff-4d05-a0c4-90f85c79926b -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-839b96d1-eaff-4d05-a0c4-90f85c79926b.080ce69e-aa83-4668-ad32-b20472f65f4a Sep 25 11:54:09 devstack sudo[100889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:09 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-bf9aaca0-58a6-448f-bbfc-8395174e7d42 tempest-VolumesListAdminTestJSON-1654262711 None] Acquiring lock "cinder-50abbae5-4578-4c02-9d49-eec4883faae9-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:09 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-bf9aaca0-58a6-448f-bbfc-8395174e7d42 tempest-VolumesListAdminTestJSON-1654262711 None] Lock "cinder-50abbae5-4578-4c02-9d49-eec4883faae9-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:09 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d77a644-a19f-4776-b539-387ba157061e tempest-VolumeDependencyTests-1522524806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:54:09 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8d77a644-a19f-4776-b539-387ba157061e tempest-VolumeDependencyTests-1522524806 None] Flow 'volume_create_manager' (9c3c72d6-4103-496b-a2ff-b74e90c89bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:54:09 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8d77a644-a19f-4776-b539-387ba157061e tempest-VolumeDependencyTests-1522524806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb329ca2-28ff-4ff0-934a-a8f3a4cdd9a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:09 devstack sudo[100889]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-b4026e44-eaa2-4971-a286-0937286cac7a tempest-SnapshotDependencyTests-534278840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-839b96d1-eaff-4d05-a0c4-90f85c79926b -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-839b96d1-eaff-4d05-a0c4-90f85c79926b.080ce69e-aa83-4668-ad32-b20472f65f4a" returned: 0 in 0.552s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:09 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8d77a644-a19f-4776-b539-387ba157061e tempest-VolumeDependencyTests-1522524806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb329ca2-28ff-4ff0-934a-a8f3a4cdd9a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:54:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1207041678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c101433-4f9c-4584-a75b-6ee9b40b229c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9cda76f7db44d7ca2fbed8557de15d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:54:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=02268ee5-b4cf-4c0c-9b39-15656bbeff8c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:54:09Z,use_quota=True,user_id='1326367ee09e4398b7051836aef9de8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:09 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8d77a644-a19f-4776-b539-387ba157061e tempest-VolumeDependencyTests-1522524806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e5825d4-e3e1-4cc7-b710-e60f698468dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:09 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8d77a644-a19f-4776-b539-387ba157061e tempest-VolumeDependencyTests-1522524806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e5825d4-e3e1-4cc7-b710-e60f698468dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:09 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8d77a644-a19f-4776-b539-387ba157061e tempest-VolumeDependencyTests-1522524806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34d7a441-3210-4ae0-8758-be74ed3a8ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:09 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8d77a644-a19f-4776-b539-387ba157061e tempest-VolumeDependencyTests-1522524806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34d7a441-3210-4ae0-8758-be74ed3a8ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1c101433-4f9c-4584-a75b-6ee9b40b229c', 'volume_name': 'volume-1c101433-4f9c-4584-a75b-6ee9b40b229c', 'volume_size': 1, 'snapshot_id': '02268ee5-b4cf-4c0c-9b39-15656bbeff8c'}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:09 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8d77a644-a19f-4776-b539-387ba157061e tempest-VolumeDependencyTests-1522524806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a93c08e0-9ad8-4860-83f6-6151303cf609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:09 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8d77a644-a19f-4776-b539-387ba157061e tempest-VolumeDependencyTests-1522524806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a93c08e0-9ad8-4860-83f6-6151303cf609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:09 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8d77a644-a19f-4776-b539-387ba157061e tempest-VolumeDependencyTests-1522524806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c350ec8c-6947-4b50-9674-990381e0270f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:09 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-8d77a644-a19f-4776-b539-387ba157061e tempest-VolumeDependencyTests-1522524806 None] Volume 1c101433-4f9c-4584-a75b-6ee9b40b229c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1c101433-4f9c-4584-a75b-6ee9b40b229c', 'volume_size': 1, 'snapshot_id': '02268ee5-b4cf-4c0c-9b39-15656bbeff8c'} Sep 25 11:54:09 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-b4026e44-eaa2-4971-a286-0937286cac7a tempest-SnapshotDependencyTests-534278840 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-839b96d1-eaff-4d05-a0c4-90f85c79926b.080ce69e-aa83-4668-ad32-b20472f65f4a is being set with open permissions: ugo+rw Sep 25 11:54:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-b4026e44-eaa2-4971-a286-0937286cac7a tempest-SnapshotDependencyTests-534278840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-839b96d1-eaff-4d05-a0c4-90f85c79926b.080ce69e-aa83-4668-ad32-b20472f65f4a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:09 devstack sudo[100894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-839b96d1-eaff-4d05-a0c4-90f85c79926b.080ce69e-aa83-4668-ad32-b20472f65f4a Sep 25 11:54:09 devstack sudo[100894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:09 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-bf9aaca0-58a6-448f-bbfc-8395174e7d42 tempest-VolumesListAdminTestJSON-1654262711 None] Acquiring lock "cinder-quobyte-50abbae5-4578-4c02-9d49-eec4883faae9" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-8d77a644-a19f-4776-b539-387ba157061e tempest-VolumeDependencyTests-1522524806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:09 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-bf9aaca0-58a6-448f-bbfc-8395174e7d42 tempest-VolumesListAdminTestJSON-1654262711 None] Lock "cinder-quobyte-50abbae5-4578-4c02-9d49-eec4883faae9" acquired by "delete_volume" :: waited 0.024s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:09 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[1846fe08-0369-4664-a304-3612f2d7f1be]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:54:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-bf9aaca0-58a6-448f-bbfc-8395174e7d42 tempest-VolumesListAdminTestJSON-1654262711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-50abbae5-4578-4c02-9d49-eec4883faae9 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:09 devstack sudo[100896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-50abbae5-4578-4c02-9d49-eec4883faae9 Sep 25 11:54:09 devstack sudo[100896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:09 devstack sudo[100894]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-b4026e44-eaa2-4971-a286-0937286cac7a tempest-SnapshotDependencyTests-534278840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-839b96d1-eaff-4d05-a0c4-90f85c79926b.080ce69e-aa83-4668-ad32-b20472f65f4a" returned: 0 in 0.293s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-b4026e44-eaa2-4971-a286-0937286cac7a tempest-SnapshotDependencyTests-534278840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-839b96d1-eaff-4d05-a0c4-90f85c79926b.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:10 devstack sudo[100899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-839b96d1-eaff-4d05-a0c4-90f85c79926b.info Sep 25 11:54:10 devstack sudo[100899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:10 devstack sudo[100896]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-bf9aaca0-58a6-448f-bbfc-8395174e7d42 tempest-VolumesListAdminTestJSON-1654262711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-50abbae5-4578-4c02-9d49-eec4883faae9" returned: 0 in 0.455s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-bf9aaca0-58a6-448f-bbfc-8395174e7d42 tempest-VolumesListAdminTestJSON-1654262711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-50abbae5-4578-4c02-9d49-eec4883faae9 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:10 devstack sudo[100905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-50abbae5-4578-4c02-9d49-eec4883faae9 Sep 25 11:54:10 devstack sudo[100905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:10 devstack sudo[100899]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-b4026e44-eaa2-4971-a286-0937286cac7a tempest-SnapshotDependencyTests-534278840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-839b96d1-eaff-4d05-a0c4-90f85c79926b.info" returned: 0 in 0.416s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:10 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-b4026e44-eaa2-4971-a286-0937286cac7a tempest-SnapshotDependencyTests-534278840 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-839b96d1-eaff-4d05-a0c4-90f85c79926b.info is being set with open permissions: ugo+rw Sep 25 11:54:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-b4026e44-eaa2-4971-a286-0937286cac7a tempest-SnapshotDependencyTests-534278840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-839b96d1-eaff-4d05-a0c4-90f85c79926b.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:10 devstack sudo[100908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-839b96d1-eaff-4d05-a0c4-90f85c79926b.info Sep 25 11:54:10 devstack sudo[100908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:10 devstack sudo[100905]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-bf9aaca0-58a6-448f-bbfc-8395174e7d42 tempest-VolumesListAdminTestJSON-1654262711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-50abbae5-4578-4c02-9d49-eec4883faae9" returned: 0 in 0.345s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:10 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-bf9aaca0-58a6-448f-bbfc-8395174e7d42 tempest-VolumesListAdminTestJSON-1654262711 None] Lock "cinder-quobyte-50abbae5-4578-4c02-9d49-eec4883faae9" released by "delete_volume" :: held 0.879s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:10 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-bf9aaca0-58a6-448f-bbfc-8395174e7d42 tempest-VolumesListAdminTestJSON-1654262711 None] Created reservations ['8f03f882-31a5-4af6-b9d1-7d127cb96425', '4030c331-6bcc-4a66-82a2-d4d23c79dc80', 'c4dc5325-e911-4f40-8641-932a573e314f', '5fa3d9bd-62ae-488b-9413-448daaf7ca5b'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:54:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-bf9aaca0-58a6-448f-bbfc-8395174e7d42 tempest-VolumesListAdminTestJSON-1654262711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-bf9aaca0-58a6-448f-bbfc-8395174e7d42 tempest-VolumesListAdminTestJSON-1654262711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:10 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-bf9aaca0-58a6-448f-bbfc-8395174e7d42 tempest-VolumesListAdminTestJSON-1654262711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:54:10 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-bf9aaca0-58a6-448f-bbfc-8395174e7d42 tempest-VolumesListAdminTestJSON-1654262711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:54:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-bf9aaca0-58a6-448f-bbfc-8395174e7d42 tempest-VolumesListAdminTestJSON-1654262711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-bf9aaca0-58a6-448f-bbfc-8395174e7d42 tempest-VolumesListAdminTestJSON-1654262711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:10 devstack sudo[100908]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-b4026e44-eaa2-4971-a286-0937286cac7a tempest-SnapshotDependencyTests-534278840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-839b96d1-eaff-4d05-a0c4-90f85c79926b.info" returned: 0 in 0.432s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:10 devstack sudo[100912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:54:10 devstack sudo[100912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-b4026e44-eaa2-4971-a286-0937286cac7a tempest-SnapshotDependencyTests-534278840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.921s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-8d77a644-a19f-4776-b539-387ba157061e tempest-VolumeDependencyTests-1522524806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.185s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:10 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-8d77a644-a19f-4776-b539-387ba157061e tempest-VolumeDependencyTests-1522524806 None] Acquiring lock "cinder-quobyte-02268ee5-b4cf-4c0c-9b39-15656bbeff8c-1c101433-4f9c-4584-a75b-6ee9b40b229c" by "_create_volume_from_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:10 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-8d77a644-a19f-4776-b539-387ba157061e tempest-VolumeDependencyTests-1522524806 None] Lock "cinder-quobyte-02268ee5-b4cf-4c0c-9b39-15656bbeff8c-1c101433-4f9c-4584-a75b-6ee9b40b229c" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:10 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-8d77a644-a19f-4776-b539-387ba157061e tempest-VolumeDependencyTests-1522524806 None] Creating volume 1c101433-4f9c-4584-a75b-6ee9b40b229c from snapshot 02268ee5-b4cf-4c0c-9b39-15656bbeff8c {{(pid=86984) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 11:54:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-8d77a644-a19f-4776-b539-387ba157061e tempest-VolumeDependencyTests-1522524806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-8d77a644-a19f-4776-b539-387ba157061e tempest-VolumeDependencyTests-1522524806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:10 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-8d77a644-a19f-4776-b539-387ba157061e tempest-VolumeDependencyTests-1522524806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:54:10 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-8d77a644-a19f-4776-b539-387ba157061e tempest-VolumeDependencyTests-1522524806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:54:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-8d77a644-a19f-4776-b539-387ba157061e tempest-VolumeDependencyTests-1522524806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:10 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-8d77a644-a19f-4776-b539-387ba157061e tempest-VolumeDependencyTests-1522524806 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:54:10 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-8d77a644-a19f-4776-b539-387ba157061e tempest-VolumeDependencyTests-1522524806 None] Acquiring lock "cinder-quobyte-1c101433-4f9c-4584-a75b-6ee9b40b229c" by "_copy_volume_from_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:10 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-b4026e44-eaa2-4971-a286-0937286cac7a tempest-SnapshotDependencyTests-534278840 None] Create snapshot completed successfully Sep 25 11:54:10 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-8d77a644-a19f-4776-b539-387ba157061e tempest-VolumeDependencyTests-1522524806 None] Lock "cinder-quobyte-1c101433-4f9c-4584-a75b-6ee9b40b229c" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:10 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-8d77a644-a19f-4776-b539-387ba157061e tempest-VolumeDependencyTests-1522524806 None] snapshot: 02268ee5-b4cf-4c0c-9b39-15656bbeff8c, volume: 1c101433-4f9c-4584-a75b-6ee9b40b229c, {{(pid=86984) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 11:54:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-8d77a644-a19f-4776-b539-387ba157061e tempest-VolumeDependencyTests-1522524806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-8d77a644-a19f-4776-b539-387ba157061e tempest-VolumeDependencyTests-1522524806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:11 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-8d77a644-a19f-4776-b539-387ba157061e tempest-VolumeDependencyTests-1522524806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:54:11 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-8d77a644-a19f-4776-b539-387ba157061e tempest-VolumeDependencyTests-1522524806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:54:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-8d77a644-a19f-4776-b539-387ba157061e tempest-VolumeDependencyTests-1522524806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:11 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14a39d7-b6f5-4a71-a411-040d61e9256b]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:54:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8d77a644-a19f-4776-b539-387ba157061e tempest-VolumeDependencyTests-1522524806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-80a9b336-e126-4957-99aa-ce4ca23eb87d.02268ee5-b4cf-4c0c-9b39-15656bbeff8c {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:11 devstack sudo[100912]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-bf9aaca0-58a6-448f-bbfc-8395174e7d42 tempest-VolumesListAdminTestJSON-1654262711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.320s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:11 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-bf9aaca0-58a6-448f-bbfc-8395174e7d42 tempest-VolumesListAdminTestJSON-1654262711 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:54:11 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-bf9aaca0-58a6-448f-bbfc-8395174e7d42 tempest-VolumesListAdminTestJSON-1654262711 None] Deleted volume successfully. Sep 25 11:54:11 devstack sudo[100914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-80a9b336-e126-4957-99aa-ce4ca23eb87d.02268ee5-b4cf-4c0c-9b39-15656bbeff8c Sep 25 11:54:11 devstack sudo[100914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:11 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-bf9aaca0-58a6-448f-bbfc-8395174e7d42 tempest-VolumesListAdminTestJSON-1654262711 None] Lock "cinder-50abbae5-4578-4c02-9d49-eec4883faae9-delete_volume" released by "delete_volume" :: held 1.755s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:11 devstack sudo[100914]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8d77a644-a19f-4776-b539-387ba157061e tempest-VolumeDependencyTests-1522524806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-80a9b336-e126-4957-99aa-ce4ca23eb87d.02268ee5-b4cf-4c0c-9b39-15656bbeff8c" returned: 0 in 0.518s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:11 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-8d77a644-a19f-4776-b539-387ba157061e tempest-VolumeDependencyTests-1522524806 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80a9b336-e126-4957-99aa-ce4ca23eb87d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86984) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:54:11 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d93e66-8424-442e-a63c-22cd69fe6608]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:54:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8d77a644-a19f-4776-b539-387ba157061e tempest-VolumeDependencyTests-1522524806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-80a9b336-e126-4957-99aa-ce4ca23eb87d {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:11 devstack sudo[100920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-80a9b336-e126-4957-99aa-ce4ca23eb87d Sep 25 11:54:11 devstack sudo[100920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:12 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1424704-8c19-47f6-a2f5-954645581d0b tempest-SnapshotDependencyTests-534278840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:54:12 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e1424704-8c19-47f6-a2f5-954645581d0b tempest-SnapshotDependencyTests-534278840 None] Flow 'volume_create_manager' (211d6945-217e-49c3-acca-3aede65cf658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:54:12 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e1424704-8c19-47f6-a2f5-954645581d0b tempest-SnapshotDependencyTests-534278840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2acaf9ac-f2f1-4c70-b214-4d6b402ac04b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:12 devstack sudo[100920]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:12 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8d77a644-a19f-4776-b539-387ba157061e tempest-VolumeDependencyTests-1522524806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-80a9b336-e126-4957-99aa-ce4ca23eb87d" returned: 0 in 0.526s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:12 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-8d77a644-a19f-4776-b539-387ba157061e tempest-VolumeDependencyTests-1522524806 None] will copy from snapshot at /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-80a9b336-e126-4957-99aa-ce4ca23eb87d {{(pid=86984) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 11:54:12 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-8d77a644-a19f-4776-b539-387ba157061e tempest-VolumeDependencyTests-1522524806 None] Creating direct copy from snapshot {{(pid=86984) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 11:54:12 devstack cinder-volume[86984]: DEBUG cinder.utils [None req-8d77a644-a19f-4776-b539-387ba157061e tempest-VolumeDependencyTests-1522524806 None] Path /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1c101433-4f9c-4584-a75b-6ee9b40b229c not found in is_blk_device check {{(pid=86984) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 11:54:12 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8d77a644-a19f-4776-b539-387ba157061e tempest-VolumeDependencyTests-1522524806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-80a9b336-e126-4957-99aa-ce4ca23eb87d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1c101433-4f9c-4584-a75b-6ee9b40b229c {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:12 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e1424704-8c19-47f6-a2f5-954645581d0b tempest-SnapshotDependencyTests-534278840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2acaf9ac-f2f1-4c70-b214-4d6b402ac04b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:54:12Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc658165-e975-46dc-b36b-23fd34d09e91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a0283ac3db04bce8393b806fb200f11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:54:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=080ce69e-aa83-4668-ad32-b20472f65f4a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:54:12Z,use_quota=True,user_id='3ef606c3131540c9928449f0b8d886fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:12 devstack sudo[100925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-80a9b336-e126-4957-99aa-ce4ca23eb87d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1c101433-4f9c-4584-a75b-6ee9b40b229c Sep 25 11:54:12 devstack sudo[100925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:12 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e1424704-8c19-47f6-a2f5-954645581d0b tempest-SnapshotDependencyTests-534278840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (173d3131-d435-4a77-9a9a-7714433c6dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:12 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e1424704-8c19-47f6-a2f5-954645581d0b tempest-SnapshotDependencyTests-534278840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (173d3131-d435-4a77-9a9a-7714433c6dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:12 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e1424704-8c19-47f6-a2f5-954645581d0b tempest-SnapshotDependencyTests-534278840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ebbd955-bfdf-4362-a6cd-e5958a6abc12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:12 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e1424704-8c19-47f6-a2f5-954645581d0b tempest-SnapshotDependencyTests-534278840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ebbd955-bfdf-4362-a6cd-e5958a6abc12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bc658165-e975-46dc-b36b-23fd34d09e91', 'volume_name': 'volume-bc658165-e975-46dc-b36b-23fd34d09e91', 'volume_size': 1, 'snapshot_id': '080ce69e-aa83-4668-ad32-b20472f65f4a'}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:12 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e1424704-8c19-47f6-a2f5-954645581d0b tempest-SnapshotDependencyTests-534278840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (631b0192-25be-4b53-a061-3556005cfaf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:12 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e1424704-8c19-47f6-a2f5-954645581d0b tempest-SnapshotDependencyTests-534278840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (631b0192-25be-4b53-a061-3556005cfaf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:12 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e1424704-8c19-47f6-a2f5-954645581d0b tempest-SnapshotDependencyTests-534278840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78c6239c-9d40-41c7-92c7-4f17d92ce98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:12 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-e1424704-8c19-47f6-a2f5-954645581d0b tempest-SnapshotDependencyTests-534278840 None] Volume bc658165-e975-46dc-b36b-23fd34d09e91: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bc658165-e975-46dc-b36b-23fd34d09e91', 'volume_size': 1, 'snapshot_id': '080ce69e-aa83-4668-ad32-b20472f65f4a'} Sep 25 11:54:12 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-e1424704-8c19-47f6-a2f5-954645581d0b tempest-SnapshotDependencyTests-534278840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:22 devstack cinder-volume[86984]: DEBUG dbcounter [-] [86984] Writing DB stats cinder:SELECT=78,cinder:INSERT=19,cinder:UPDATE=80,cinder:DELETE=5 {{(pid=86984) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:54:22 devstack cinder-volume[86984]: DEBUG dbcounter [-] [86984] Writing DB stats cinder:DELETE=12,cinder:UPDATE=90,cinder:SELECT=58,cinder:INSERT=23 {{(pid=86984) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:54:23 devstack sudo[100925]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8d77a644-a19f-4776-b539-387ba157061e tempest-VolumeDependencyTests-1522524806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-80a9b336-e126-4957-99aa-ce4ca23eb87d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1c101433-4f9c-4584-a75b-6ee9b40b229c" returned: 0 in 11.039s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:23 devstack cinder-volume[86984]: DEBUG cinder.image.image_utils [None req-8d77a644-a19f-4776-b539-387ba157061e tempest-VolumeDependencyTests-1522524806 None] Image conversion details: src /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-80a9b336-e126-4957-99aa-ce4ca23eb87d, size 1024.00 MB, duration 11.04 sec, destination /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1c101433-4f9c-4584-a75b-6ee9b40b229c {{(pid=86984) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 11:54:23 devstack cinder-volume[86984]: INFO cinder.image.image_utils [None req-8d77a644-a19f-4776-b539-387ba157061e tempest-VolumeDependencyTests-1522524806 None] Converted 1024.00 MB image at 92.75 MB/s Sep 25 11:54:23 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-8d77a644-a19f-4776-b539-387ba157061e tempest-VolumeDependencyTests-1522524806 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1c101433-4f9c-4584-a75b-6ee9b40b229c is being set with open permissions: ugo+rw Sep 25 11:54:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8d77a644-a19f-4776-b539-387ba157061e tempest-VolumeDependencyTests-1522524806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1c101433-4f9c-4584-a75b-6ee9b40b229c {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:23 devstack sudo[100939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1c101433-4f9c-4584-a75b-6ee9b40b229c Sep 25 11:54:23 devstack sudo[100939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:23 devstack sudo[100939]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8d77a644-a19f-4776-b539-387ba157061e tempest-VolumeDependencyTests-1522524806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1c101433-4f9c-4584-a75b-6ee9b40b229c" returned: 0 in 0.458s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:23 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-8d77a644-a19f-4776-b539-387ba157061e tempest-VolumeDependencyTests-1522524806 None] Lock "cinder-quobyte-1c101433-4f9c-4584-a75b-6ee9b40b229c" released by "_copy_volume_from_snapshot" :: held 12.677s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:23 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-8d77a644-a19f-4776-b539-387ba157061e tempest-VolumeDependencyTests-1522524806 None] Lock "cinder-quobyte-02268ee5-b4cf-4c0c-9b39-15656bbeff8c-1c101433-4f9c-4584-a75b-6ee9b40b229c" released by "_create_volume_from_snapshot" :: held 12.788s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-8d77a644-a19f-4776-b539-387ba157061e tempest-VolumeDependencyTests-1522524806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.824s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-e1424704-8c19-47f6-a2f5-954645581d0b tempest-SnapshotDependencyTests-534278840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 11.513s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:23 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e1424704-8c19-47f6-a2f5-954645581d0b tempest-SnapshotDependencyTests-534278840 None] Acquiring lock "cinder-quobyte-080ce69e-aa83-4668-ad32-b20472f65f4a-bc658165-e975-46dc-b36b-23fd34d09e91" by "_create_volume_from_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:23 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e1424704-8c19-47f6-a2f5-954645581d0b tempest-SnapshotDependencyTests-534278840 None] Lock "cinder-quobyte-080ce69e-aa83-4668-ad32-b20472f65f4a-bc658165-e975-46dc-b36b-23fd34d09e91" acquired by "_create_volume_from_snapshot" :: waited 0.106s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:23 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-e1424704-8c19-47f6-a2f5-954645581d0b tempest-SnapshotDependencyTests-534278840 None] Creating volume bc658165-e975-46dc-b36b-23fd34d09e91 from snapshot 080ce69e-aa83-4668-ad32-b20472f65f4a {{(pid=86984) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 11:54:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-e1424704-8c19-47f6-a2f5-954645581d0b tempest-SnapshotDependencyTests-534278840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-e1424704-8c19-47f6-a2f5-954645581d0b tempest-SnapshotDependencyTests-534278840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:23 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-e1424704-8c19-47f6-a2f5-954645581d0b tempest-SnapshotDependencyTests-534278840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:54:23 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-e1424704-8c19-47f6-a2f5-954645581d0b tempest-SnapshotDependencyTests-534278840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:54:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-e1424704-8c19-47f6-a2f5-954645581d0b tempest-SnapshotDependencyTests-534278840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:23 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-e1424704-8c19-47f6-a2f5-954645581d0b tempest-SnapshotDependencyTests-534278840 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:54:23 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e1424704-8c19-47f6-a2f5-954645581d0b tempest-SnapshotDependencyTests-534278840 None] Acquiring lock "cinder-quobyte-bc658165-e975-46dc-b36b-23fd34d09e91" by "_copy_volume_from_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:23 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8d77a644-a19f-4776-b539-387ba157061e tempest-VolumeDependencyTests-1522524806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c350ec8c-6947-4b50-9674-990381e0270f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c101433-4f9c-4584-a75b-6ee9b40b229c', 'volume_size': 1, 'snapshot_id': '02268ee5-b4cf-4c0c-9b39-15656bbeff8c'}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:23 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8d77a644-a19f-4776-b539-387ba157061e tempest-VolumeDependencyTests-1522524806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e933ce76-ff50-417f-83aa-5efd52357197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:23 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e1424704-8c19-47f6-a2f5-954645581d0b tempest-SnapshotDependencyTests-534278840 None] Lock "cinder-quobyte-bc658165-e975-46dc-b36b-23fd34d09e91" acquired by "_copy_volume_from_snapshot" :: waited 0.063s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:23 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-e1424704-8c19-47f6-a2f5-954645581d0b tempest-SnapshotDependencyTests-534278840 None] snapshot: 080ce69e-aa83-4668-ad32-b20472f65f4a, volume: bc658165-e975-46dc-b36b-23fd34d09e91, {{(pid=86984) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 11:54:24 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-e1424704-8c19-47f6-a2f5-954645581d0b tempest-SnapshotDependencyTests-534278840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:24 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-e1424704-8c19-47f6-a2f5-954645581d0b tempest-SnapshotDependencyTests-534278840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:24 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-e1424704-8c19-47f6-a2f5-954645581d0b tempest-SnapshotDependencyTests-534278840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:54:24 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-e1424704-8c19-47f6-a2f5-954645581d0b tempest-SnapshotDependencyTests-534278840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:54:24 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-e1424704-8c19-47f6-a2f5-954645581d0b tempest-SnapshotDependencyTests-534278840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:24 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-8d77a644-a19f-4776-b539-387ba157061e tempest-VolumeDependencyTests-1522524806 None] Volume volume-1c101433-4f9c-4584-a75b-6ee9b40b229c (1c101433-4f9c-4584-a75b-6ee9b40b229c): created successfully Sep 25 11:54:24 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8d77a644-a19f-4776-b539-387ba157061e tempest-VolumeDependencyTests-1522524806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e933ce76-ff50-417f-83aa-5efd52357197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:24 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8d77a644-a19f-4776-b539-387ba157061e tempest-VolumeDependencyTests-1522524806 None] Flow 'volume_create_manager' (9c3c72d6-4103-496b-a2ff-b74e90c89bb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:54:24 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa31f84-d5a3-4167-94cd-2d29e5d807c0]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:54:24 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e1424704-8c19-47f6-a2f5-954645581d0b tempest-SnapshotDependencyTests-534278840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-839b96d1-eaff-4d05-a0c4-90f85c79926b.080ce69e-aa83-4668-ad32-b20472f65f4a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:24 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-8d77a644-a19f-4776-b539-387ba157061e tempest-VolumeDependencyTests-1522524806 None] Created volume successfully. Sep 25 11:54:24 devstack sudo[100943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-839b96d1-eaff-4d05-a0c4-90f85c79926b.080ce69e-aa83-4668-ad32-b20472f65f4a Sep 25 11:54:24 devstack sudo[100943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:24 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-58cf0e34-65be-4484-b01e-cfa585aebdbf tempest-VolumeDependencyTests-1522524806 None] Acquiring lock "cinder-02268ee5-b4cf-4c0c-9b39-15656bbeff8c-delete_snapshot" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:24 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-58cf0e34-65be-4484-b01e-cfa585aebdbf tempest-VolumeDependencyTests-1522524806 None] Lock "cinder-02268ee5-b4cf-4c0c-9b39-15656bbeff8c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:24 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-58cf0e34-65be-4484-b01e-cfa585aebdbf tempest-VolumeDependencyTests-1522524806 None] Acquiring lock "cinder-quobyte-80a9b336-e126-4957-99aa-ce4ca23eb87d" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:24 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-58cf0e34-65be-4484-b01e-cfa585aebdbf tempest-VolumeDependencyTests-1522524806 None] Lock "cinder-quobyte-80a9b336-e126-4957-99aa-ce4ca23eb87d" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:24 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-58cf0e34-65be-4484-b01e-cfa585aebdbf tempest-VolumeDependencyTests-1522524806 None] Acquiring lock "cinder-quobyte-02268ee5-b4cf-4c0c-9b39-15656bbeff8c" by "_delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:24 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-58cf0e34-65be-4484-b01e-cfa585aebdbf tempest-VolumeDependencyTests-1522524806 None] Lock "cinder-quobyte-02268ee5-b4cf-4c0c-9b39-15656bbeff8c" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:24 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-58cf0e34-65be-4484-b01e-cfa585aebdbf tempest-VolumeDependencyTests-1522524806 None] Deleting offline snapshot 02268ee5-b4cf-4c0c-9b39-15656bbeff8c of volume 80a9b336-e126-4957-99aa-ce4ca23eb87d {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:54:24 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-58cf0e34-65be-4484-b01e-cfa585aebdbf tempest-VolumeDependencyTests-1522524806 None] snapshot_file for this snap is: volume-80a9b336-e126-4957-99aa-ce4ca23eb87d.02268ee5-b4cf-4c0c-9b39-15656bbeff8c {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:54:24 devstack sudo[100943]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:24 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e1424704-8c19-47f6-a2f5-954645581d0b tempest-SnapshotDependencyTests-534278840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-839b96d1-eaff-4d05-a0c4-90f85c79926b.080ce69e-aa83-4668-ad32-b20472f65f4a" returned: 0 in 0.736s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:24 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-e1424704-8c19-47f6-a2f5-954645581d0b tempest-SnapshotDependencyTests-534278840 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-839b96d1-eaff-4d05-a0c4-90f85c79926b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86984) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:54:24 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[0500fad9-d362-4a1a-bf5f-a4cb972388a6]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:54:24 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-58cf0e34-65be-4484-b01e-cfa585aebdbf tempest-VolumeDependencyTests-1522524806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-80a9b336-e126-4957-99aa-ce4ca23eb87d.02268ee5-b4cf-4c0c-9b39-15656bbeff8c {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:24 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ebb71a-c4aa-44f1-8b95-9881d7c13d72]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:54:24 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e1424704-8c19-47f6-a2f5-954645581d0b tempest-SnapshotDependencyTests-534278840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-839b96d1-eaff-4d05-a0c4-90f85c79926b {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:24 devstack sudo[100950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-839b96d1-eaff-4d05-a0c4-90f85c79926b Sep 25 11:54:24 devstack sudo[100950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:24 devstack sudo[100949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-80a9b336-e126-4957-99aa-ce4ca23eb87d.02268ee5-b4cf-4c0c-9b39-15656bbeff8c Sep 25 11:54:24 devstack sudo[100949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:25 devstack sudo[100950]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:25 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e1424704-8c19-47f6-a2f5-954645581d0b tempest-SnapshotDependencyTests-534278840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-839b96d1-eaff-4d05-a0c4-90f85c79926b" returned: 0 in 0.593s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:25 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-e1424704-8c19-47f6-a2f5-954645581d0b tempest-SnapshotDependencyTests-534278840 None] will copy from snapshot at /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-839b96d1-eaff-4d05-a0c4-90f85c79926b {{(pid=86984) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 11:54:25 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-e1424704-8c19-47f6-a2f5-954645581d0b tempest-SnapshotDependencyTests-534278840 None] Creating direct copy from snapshot {{(pid=86984) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 11:54:25 devstack cinder-volume[86984]: DEBUG cinder.utils [None req-e1424704-8c19-47f6-a2f5-954645581d0b tempest-SnapshotDependencyTests-534278840 None] Path /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bc658165-e975-46dc-b36b-23fd34d09e91 not found in is_blk_device check {{(pid=86984) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 11:54:25 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e1424704-8c19-47f6-a2f5-954645581d0b tempest-SnapshotDependencyTests-534278840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-839b96d1-eaff-4d05-a0c4-90f85c79926b /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bc658165-e975-46dc-b36b-23fd34d09e91 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:25 devstack sudo[100949]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:25 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-58cf0e34-65be-4484-b01e-cfa585aebdbf tempest-VolumeDependencyTests-1522524806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-80a9b336-e126-4957-99aa-ce4ca23eb87d.02268ee5-b4cf-4c0c-9b39-15656bbeff8c" returned: 0 in 0.649s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:25 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-58cf0e34-65be-4484-b01e-cfa585aebdbf tempest-VolumeDependencyTests-1522524806 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80a9b336-e126-4957-99aa-ce4ca23eb87d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86984) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:54:25 devstack sudo[100960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-839b96d1-eaff-4d05-a0c4-90f85c79926b /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bc658165-e975-46dc-b36b-23fd34d09e91 Sep 25 11:54:25 devstack sudo[100960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:25 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[305b99b0-7f43-4f44-8198-0e5cd234203e]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:54:25 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-58cf0e34-65be-4484-b01e-cfa585aebdbf tempest-VolumeDependencyTests-1522524806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-80a9b336-e126-4957-99aa-ce4ca23eb87d {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:25 devstack sudo[100962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-80a9b336-e126-4957-99aa-ce4ca23eb87d Sep 25 11:54:25 devstack sudo[100962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:26 devstack sudo[100962]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:26 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-58cf0e34-65be-4484-b01e-cfa585aebdbf tempest-VolumeDependencyTests-1522524806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-80a9b336-e126-4957-99aa-ce4ca23eb87d" returned: 0 in 0.728s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:26 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-58cf0e34-65be-4484-b01e-cfa585aebdbf tempest-VolumeDependencyTests-1522524806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-80a9b336-e126-4957-99aa-ce4ca23eb87d.02268ee5-b4cf-4c0c-9b39-15656bbeff8c {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:26 devstack sudo[100971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-80a9b336-e126-4957-99aa-ce4ca23eb87d.02268ee5-b4cf-4c0c-9b39-15656bbeff8c Sep 25 11:54:26 devstack sudo[100971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:27 devstack sudo[100971]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:27 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-58cf0e34-65be-4484-b01e-cfa585aebdbf tempest-VolumeDependencyTests-1522524806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-80a9b336-e126-4957-99aa-ce4ca23eb87d.02268ee5-b4cf-4c0c-9b39-15656bbeff8c" returned: 0 in 0.921s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:27 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-58cf0e34-65be-4484-b01e-cfa585aebdbf tempest-VolumeDependencyTests-1522524806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-80a9b336-e126-4957-99aa-ce4ca23eb87d.02268ee5-b4cf-4c0c-9b39-15656bbeff8c {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:27 devstack sudo[100984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-80a9b336-e126-4957-99aa-ce4ca23eb87d.02268ee5-b4cf-4c0c-9b39-15656bbeff8c Sep 25 11:54:27 devstack sudo[100984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:27 devstack sudo[100984]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:27 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-58cf0e34-65be-4484-b01e-cfa585aebdbf tempest-VolumeDependencyTests-1522524806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-80a9b336-e126-4957-99aa-ce4ca23eb87d.02268ee5-b4cf-4c0c-9b39-15656bbeff8c" returned: 0 in 0.800s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:28 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-58cf0e34-65be-4484-b01e-cfa585aebdbf tempest-VolumeDependencyTests-1522524806 None] Lock "cinder-quobyte-02268ee5-b4cf-4c0c-9b39-15656bbeff8c" released by "_delete_snapshot" :: held 3.380s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:28 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-58cf0e34-65be-4484-b01e-cfa585aebdbf tempest-VolumeDependencyTests-1522524806 None] Lock "cinder-quobyte-80a9b336-e126-4957-99aa-ce4ca23eb87d" released by "delete_snapshot" :: held 3.436s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:28 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-58cf0e34-65be-4484-b01e-cfa585aebdbf tempest-VolumeDependencyTests-1522524806 None] Created reservations ['53698433-7cde-4e31-8569-551aadeccbde', '91e30b76-4f0f-4576-bed8-e7cd3499158c', '821a68b8-5af3-4a80-9c48-55ef50611d3c', '413f520c-3a02-4b4d-8778-e56a0d2f4cfd'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:54:28 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-58cf0e34-65be-4484-b01e-cfa585aebdbf tempest-VolumeDependencyTests-1522524806 None] Delete snapshot completed successfully. Sep 25 11:54:28 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-58cf0e34-65be-4484-b01e-cfa585aebdbf tempest-VolumeDependencyTests-1522524806 None] Lock "cinder-02268ee5-b4cf-4c0c-9b39-15656bbeff8c-delete_snapshot" released by "delete_snapshot" :: held 3.921s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:29 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-56314418-832d-4b72-b58c-955ef392a9ee tempest-VolumeDependencyTests-1522524806 None] Acquiring lock "cinder-80a9b336-e126-4957-99aa-ce4ca23eb87d-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:29 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-56314418-832d-4b72-b58c-955ef392a9ee tempest-VolumeDependencyTests-1522524806 None] Lock "cinder-80a9b336-e126-4957-99aa-ce4ca23eb87d-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:29 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-56314418-832d-4b72-b58c-955ef392a9ee tempest-VolumeDependencyTests-1522524806 None] Acquiring lock "cinder-quobyte-80a9b336-e126-4957-99aa-ce4ca23eb87d" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:29 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-56314418-832d-4b72-b58c-955ef392a9ee tempest-VolumeDependencyTests-1522524806 None] Lock "cinder-quobyte-80a9b336-e126-4957-99aa-ce4ca23eb87d" acquired by "delete_volume" :: waited 0.063s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:29 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[2adcea1e-f813-4df0-bb6f-742ed775fd5d]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:54:29 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-56314418-832d-4b72-b58c-955ef392a9ee tempest-VolumeDependencyTests-1522524806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-80a9b336-e126-4957-99aa-ce4ca23eb87d {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:29 devstack sudo[100988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-80a9b336-e126-4957-99aa-ce4ca23eb87d Sep 25 11:54:29 devstack sudo[100988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:30 devstack sudo[100988]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:30 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-56314418-832d-4b72-b58c-955ef392a9ee tempest-VolumeDependencyTests-1522524806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-80a9b336-e126-4957-99aa-ce4ca23eb87d" returned: 0 in 1.307s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:30 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-56314418-832d-4b72-b58c-955ef392a9ee tempest-VolumeDependencyTests-1522524806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-80a9b336-e126-4957-99aa-ce4ca23eb87d {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:30 devstack sudo[100995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-80a9b336-e126-4957-99aa-ce4ca23eb87d Sep 25 11:54:30 devstack sudo[100995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:31 devstack sudo[100995]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:31 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-56314418-832d-4b72-b58c-955ef392a9ee tempest-VolumeDependencyTests-1522524806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-80a9b336-e126-4957-99aa-ce4ca23eb87d" returned: 0 in 0.643s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:31 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-56314418-832d-4b72-b58c-955ef392a9ee tempest-VolumeDependencyTests-1522524806 None] Lock "cinder-quobyte-80a9b336-e126-4957-99aa-ce4ca23eb87d" released by "delete_volume" :: held 2.210s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:31 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-56314418-832d-4b72-b58c-955ef392a9ee tempest-VolumeDependencyTests-1522524806 None] Created reservations ['116ef733-6c22-424d-b847-2545563b6d58', '3deffc37-daec-40b9-8c1b-3d830a6c8781', 'e8e35b6c-8e96-41cd-8d63-3a3b29d13ecb', '081c54ba-49aa-4a1f-8fda-865b74d5f6c2'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:54:31 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-56314418-832d-4b72-b58c-955ef392a9ee tempest-VolumeDependencyTests-1522524806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:31 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-56314418-832d-4b72-b58c-955ef392a9ee tempest-VolumeDependencyTests-1522524806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:31 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-56314418-832d-4b72-b58c-955ef392a9ee tempest-VolumeDependencyTests-1522524806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:54:31 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-56314418-832d-4b72-b58c-955ef392a9ee tempest-VolumeDependencyTests-1522524806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:54:31 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-56314418-832d-4b72-b58c-955ef392a9ee tempest-VolumeDependencyTests-1522524806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:31 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-56314418-832d-4b72-b58c-955ef392a9ee tempest-VolumeDependencyTests-1522524806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:32 devstack sudo[100998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:54:32 devstack sudo[100998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:32 devstack sudo[100998]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:32 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-56314418-832d-4b72-b58c-955ef392a9ee tempest-VolumeDependencyTests-1522524806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.701s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:32 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-56314418-832d-4b72-b58c-955ef392a9ee tempest-VolumeDependencyTests-1522524806 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:54:32 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-56314418-832d-4b72-b58c-955ef392a9ee tempest-VolumeDependencyTests-1522524806 None] Deleted volume successfully. Sep 25 11:54:32 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-56314418-832d-4b72-b58c-955ef392a9ee tempest-VolumeDependencyTests-1522524806 None] Lock "cinder-80a9b336-e126-4957-99aa-ce4ca23eb87d-delete_volume" released by "delete_volume" :: held 3.558s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:33 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-c201c2ed-c866-461e-9db4-84ef65644c42 tempest-VolumeDependencyTests-1522524806 None] Acquiring lock "cinder-1c101433-4f9c-4584-a75b-6ee9b40b229c-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:33 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-c201c2ed-c866-461e-9db4-84ef65644c42 tempest-VolumeDependencyTests-1522524806 None] Lock "cinder-1c101433-4f9c-4584-a75b-6ee9b40b229c-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:33 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-c201c2ed-c866-461e-9db4-84ef65644c42 tempest-VolumeDependencyTests-1522524806 None] Acquiring lock "cinder-quobyte-1c101433-4f9c-4584-a75b-6ee9b40b229c" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:33 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-c201c2ed-c866-461e-9db4-84ef65644c42 tempest-VolumeDependencyTests-1522524806 None] Lock "cinder-quobyte-1c101433-4f9c-4584-a75b-6ee9b40b229c" acquired by "delete_volume" :: waited 0.039s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:33 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb71a22c-a5c9-480d-909e-a896362069f1]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:54:33 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-c201c2ed-c866-461e-9db4-84ef65644c42 tempest-VolumeDependencyTests-1522524806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1c101433-4f9c-4584-a75b-6ee9b40b229c {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:33 devstack sudo[101001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1c101433-4f9c-4584-a75b-6ee9b40b229c Sep 25 11:54:33 devstack sudo[101001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:34 devstack sudo[101001]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:34 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-c201c2ed-c866-461e-9db4-84ef65644c42 tempest-VolumeDependencyTests-1522524806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1c101433-4f9c-4584-a75b-6ee9b40b229c" returned: 0 in 0.967s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:34 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-c201c2ed-c866-461e-9db4-84ef65644c42 tempest-VolumeDependencyTests-1522524806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1c101433-4f9c-4584-a75b-6ee9b40b229c {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:34 devstack sudo[101007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1c101433-4f9c-4584-a75b-6ee9b40b229c Sep 25 11:54:34 devstack sudo[101007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:35 devstack sudo[101007]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:35 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-c201c2ed-c866-461e-9db4-84ef65644c42 tempest-VolumeDependencyTests-1522524806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1c101433-4f9c-4584-a75b-6ee9b40b229c" returned: 0 in 0.745s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:35 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-c201c2ed-c866-461e-9db4-84ef65644c42 tempest-VolumeDependencyTests-1522524806 None] Lock "cinder-quobyte-1c101433-4f9c-4584-a75b-6ee9b40b229c" released by "delete_volume" :: held 1.831s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:35 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-c201c2ed-c866-461e-9db4-84ef65644c42 tempest-VolumeDependencyTests-1522524806 None] Created reservations ['ffa1905c-790f-4737-93ff-48fb71a2ff0e', 'bb8d397f-7621-41b8-83f0-134edda2a826', '40e17f78-2de1-4253-a045-3393a4555cbc', 'c7e9bafd-a86d-4962-a0bd-10932374265b'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:54:35 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-c201c2ed-c866-461e-9db4-84ef65644c42 tempest-VolumeDependencyTests-1522524806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:35 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-c201c2ed-c866-461e-9db4-84ef65644c42 tempest-VolumeDependencyTests-1522524806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:35 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-c201c2ed-c866-461e-9db4-84ef65644c42 tempest-VolumeDependencyTests-1522524806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:54:35 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-c201c2ed-c866-461e-9db4-84ef65644c42 tempest-VolumeDependencyTests-1522524806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:54:35 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-c201c2ed-c866-461e-9db4-84ef65644c42 tempest-VolumeDependencyTests-1522524806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:35 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-c201c2ed-c866-461e-9db4-84ef65644c42 tempest-VolumeDependencyTests-1522524806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:35 devstack sudo[101010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:54:35 devstack sudo[101010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:36 devstack sudo[101010]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:36 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-c201c2ed-c866-461e-9db4-84ef65644c42 tempest-VolumeDependencyTests-1522524806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.767s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:36 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-c201c2ed-c866-461e-9db4-84ef65644c42 tempest-VolumeDependencyTests-1522524806 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:54:36 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-c201c2ed-c866-461e-9db4-84ef65644c42 tempest-VolumeDependencyTests-1522524806 None] Deleted volume successfully. Sep 25 11:54:36 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-c201c2ed-c866-461e-9db4-84ef65644c42 tempest-VolumeDependencyTests-1522524806 None] Lock "cinder-1c101433-4f9c-4584-a75b-6ee9b40b229c-delete_volume" released by "delete_volume" :: held 3.318s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:36 devstack sudo[100960]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:36 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e1424704-8c19-47f6-a2f5-954645581d0b tempest-SnapshotDependencyTests-534278840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-839b96d1-eaff-4d05-a0c4-90f85c79926b /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bc658165-e975-46dc-b36b-23fd34d09e91" returned: 0 in 11.406s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:36 devstack cinder-volume[86984]: DEBUG cinder.image.image_utils [None req-e1424704-8c19-47f6-a2f5-954645581d0b tempest-SnapshotDependencyTests-534278840 None] Image conversion details: src /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-839b96d1-eaff-4d05-a0c4-90f85c79926b, size 1024.00 MB, duration 11.41 sec, destination /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bc658165-e975-46dc-b36b-23fd34d09e91 {{(pid=86984) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 11:54:36 devstack cinder-volume[86984]: INFO cinder.image.image_utils [None req-e1424704-8c19-47f6-a2f5-954645581d0b tempest-SnapshotDependencyTests-534278840 None] Converted 1024.00 MB image at 89.76 MB/s Sep 25 11:54:36 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-e1424704-8c19-47f6-a2f5-954645581d0b tempest-SnapshotDependencyTests-534278840 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bc658165-e975-46dc-b36b-23fd34d09e91 is being set with open permissions: ugo+rw Sep 25 11:54:36 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e1424704-8c19-47f6-a2f5-954645581d0b tempest-SnapshotDependencyTests-534278840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bc658165-e975-46dc-b36b-23fd34d09e91 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:36 devstack sudo[101013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bc658165-e975-46dc-b36b-23fd34d09e91 Sep 25 11:54:36 devstack sudo[101013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:37 devstack sudo[101013]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:37 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e1424704-8c19-47f6-a2f5-954645581d0b tempest-SnapshotDependencyTests-534278840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bc658165-e975-46dc-b36b-23fd34d09e91" returned: 0 in 0.452s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:37 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e1424704-8c19-47f6-a2f5-954645581d0b tempest-SnapshotDependencyTests-534278840 None] Lock "cinder-quobyte-bc658165-e975-46dc-b36b-23fd34d09e91" released by "_copy_volume_from_snapshot" :: held 13.343s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:37 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e1424704-8c19-47f6-a2f5-954645581d0b tempest-SnapshotDependencyTests-534278840 None] Lock "cinder-quobyte-080ce69e-aa83-4668-ad32-b20472f65f4a-bc658165-e975-46dc-b36b-23fd34d09e91" released by "_create_volume_from_snapshot" :: held 13.532s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:37 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-e1424704-8c19-47f6-a2f5-954645581d0b tempest-SnapshotDependencyTests-534278840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.646s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:37 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e1424704-8c19-47f6-a2f5-954645581d0b tempest-SnapshotDependencyTests-534278840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78c6239c-9d40-41c7-92c7-4f17d92ce98c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc658165-e975-46dc-b36b-23fd34d09e91', 'volume_size': 1, 'snapshot_id': '080ce69e-aa83-4668-ad32-b20472f65f4a'}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:37 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e1424704-8c19-47f6-a2f5-954645581d0b tempest-SnapshotDependencyTests-534278840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d207921-8c9d-441e-8c95-660994407992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:37 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-e1424704-8c19-47f6-a2f5-954645581d0b tempest-SnapshotDependencyTests-534278840 None] Volume volume-bc658165-e975-46dc-b36b-23fd34d09e91 (bc658165-e975-46dc-b36b-23fd34d09e91): created successfully Sep 25 11:54:37 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e1424704-8c19-47f6-a2f5-954645581d0b tempest-SnapshotDependencyTests-534278840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d207921-8c9d-441e-8c95-660994407992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:37 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e1424704-8c19-47f6-a2f5-954645581d0b tempest-SnapshotDependencyTests-534278840 None] Flow 'volume_create_manager' (211d6945-217e-49c3-acca-3aede65cf658) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:54:37 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-e1424704-8c19-47f6-a2f5-954645581d0b tempest-SnapshotDependencyTests-534278840 None] Created volume successfully. Sep 25 11:54:37 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-cff9b534-f5f8-4585-ba13-4d3a9e82f245 tempest-VolumesDeleteCascade-1448271507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:54:37 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cff9b534-f5f8-4585-ba13-4d3a9e82f245 tempest-VolumesDeleteCascade-1448271507 None] Flow 'volume_create_manager' (14597fcb-06f1-40cc-a249-f873091403a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:54:37 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cff9b534-f5f8-4585-ba13-4d3a9e82f245 tempest-VolumesDeleteCascade-1448271507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a23f963c-a8cd-44f8-b673-264e2dde8077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:37 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cff9b534-f5f8-4585-ba13-4d3a9e82f245 tempest-VolumesDeleteCascade-1448271507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a23f963c-a8cd-44f8-b673-264e2dde8077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:54:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-309741391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a8ff2e4-3674-4ef2-8c80-40fa7748e34d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b041d48844854458800f13297c9facdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:54:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:54:38Z,use_quota=True,user_id='f42a3eec66a945cca809837b82cda048',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:37 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cff9b534-f5f8-4585-ba13-4d3a9e82f245 tempest-VolumesDeleteCascade-1448271507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (318ffd70-42ee-476a-97bf-c1020d07d983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:37 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cff9b534-f5f8-4585-ba13-4d3a9e82f245 tempest-VolumesDeleteCascade-1448271507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (318ffd70-42ee-476a-97bf-c1020d07d983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:37 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cff9b534-f5f8-4585-ba13-4d3a9e82f245 tempest-VolumesDeleteCascade-1448271507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (578086b2-97c3-4190-aa2a-eae8268784d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:37 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cff9b534-f5f8-4585-ba13-4d3a9e82f245 tempest-VolumesDeleteCascade-1448271507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (578086b2-97c3-4190-aa2a-eae8268784d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a8ff2e4-3674-4ef2-8c80-40fa7748e34d', 'volume_name': 'volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:37 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cff9b534-f5f8-4585-ba13-4d3a9e82f245 tempest-VolumesDeleteCascade-1448271507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b69275e-26f5-4fb6-907c-cc1c2dff702c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:37 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cff9b534-f5f8-4585-ba13-4d3a9e82f245 tempest-VolumesDeleteCascade-1448271507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b69275e-26f5-4fb6-907c-cc1c2dff702c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:38 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cff9b534-f5f8-4585-ba13-4d3a9e82f245 tempest-VolumesDeleteCascade-1448271507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9e571cd-036b-471a-a4c1-6c1f5aa7e6e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:38 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-cff9b534-f5f8-4585-ba13-4d3a9e82f245 tempest-VolumesDeleteCascade-1448271507 None] Volume 1a8ff2e4-3674-4ef2-8c80-40fa7748e34d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d', 'volume_size': 1} Sep 25 11:54:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-cff9b534-f5f8-4585-ba13-4d3a9e82f245 tempest-VolumesDeleteCascade-1448271507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-cff9b534-f5f8-4585-ba13-4d3a9e82f245 tempest-VolumesDeleteCascade-1448271507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-cff9b534-f5f8-4585-ba13-4d3a9e82f245 tempest-VolumesDeleteCascade-1448271507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:54:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-309741391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a8ff2e4-3674-4ef2-8c80-40fa7748e34d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b041d48844854458800f13297c9facdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:54:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:54:38Z,use_quota=True,user_id='f42a3eec66a945cca809837b82cda048',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:54:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-cff9b534-f5f8-4585-ba13-4d3a9e82f245 tempest-VolumesDeleteCascade-1448271507 None] Creating volume 1a8ff2e4-3674-4ef2-8c80-40fa7748e34d {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:54:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-cff9b534-f5f8-4585-ba13-4d3a9e82f245 tempest-VolumesDeleteCascade-1448271507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-cff9b534-f5f8-4585-ba13-4d3a9e82f245 tempest-VolumesDeleteCascade-1448271507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-cff9b534-f5f8-4585-ba13-4d3a9e82f245 tempest-VolumesDeleteCascade-1448271507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:54:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-cff9b534-f5f8-4585-ba13-4d3a9e82f245 tempest-VolumesDeleteCascade-1448271507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:54:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-cff9b534-f5f8-4585-ba13-4d3a9e82f245 tempest-VolumesDeleteCascade-1448271507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-cff9b534-f5f8-4585-ba13-4d3a9e82f245 tempest-VolumesDeleteCascade-1448271507 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:54:38 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-cff9b534-f5f8-4585-ba13-4d3a9e82f245 tempest-VolumesDeleteCascade-1448271507 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:54:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cff9b534-f5f8-4585-ba13-4d3a9e82f245 tempest-VolumesDeleteCascade-1448271507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:38 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f0dad139-3b14-40a4-a6ec-8378b085787c tempest-SnapshotDependencyTests-534278840 None] Acquiring lock "cinder-080ce69e-aa83-4668-ad32-b20472f65f4a-delete_snapshot" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:38 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f0dad139-3b14-40a4-a6ec-8378b085787c tempest-SnapshotDependencyTests-534278840 None] Lock "cinder-080ce69e-aa83-4668-ad32-b20472f65f4a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:38 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f0dad139-3b14-40a4-a6ec-8378b085787c tempest-SnapshotDependencyTests-534278840 None] Acquiring lock "cinder-quobyte-839b96d1-eaff-4d05-a0c4-90f85c79926b" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:38 devstack sudo[101017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d 1073741824 Sep 25 11:54:38 devstack sudo[101017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:38 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f0dad139-3b14-40a4-a6ec-8378b085787c tempest-SnapshotDependencyTests-534278840 None] Lock "cinder-quobyte-839b96d1-eaff-4d05-a0c4-90f85c79926b" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:38 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f0dad139-3b14-40a4-a6ec-8378b085787c tempest-SnapshotDependencyTests-534278840 None] Acquiring lock "cinder-quobyte-080ce69e-aa83-4668-ad32-b20472f65f4a" by "_delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:38 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f0dad139-3b14-40a4-a6ec-8378b085787c tempest-SnapshotDependencyTests-534278840 None] Lock "cinder-quobyte-080ce69e-aa83-4668-ad32-b20472f65f4a" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-f0dad139-3b14-40a4-a6ec-8378b085787c tempest-SnapshotDependencyTests-534278840 None] Deleting offline snapshot 080ce69e-aa83-4668-ad32-b20472f65f4a of volume 839b96d1-eaff-4d05-a0c4-90f85c79926b {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:54:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-f0dad139-3b14-40a4-a6ec-8378b085787c tempest-SnapshotDependencyTests-534278840 None] snapshot_file for this snap is: volume-839b96d1-eaff-4d05-a0c4-90f85c79926b.080ce69e-aa83-4668-ad32-b20472f65f4a {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:54:38 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[2016f93c-740c-4b0e-817a-64b9f14f6b3e]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:54:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f0dad139-3b14-40a4-a6ec-8378b085787c tempest-SnapshotDependencyTests-534278840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-839b96d1-eaff-4d05-a0c4-90f85c79926b.080ce69e-aa83-4668-ad32-b20472f65f4a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:38 devstack sudo[101019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-839b96d1-eaff-4d05-a0c4-90f85c79926b.080ce69e-aa83-4668-ad32-b20472f65f4a Sep 25 11:54:38 devstack sudo[101019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:38 devstack cinder-volume[86984]: DEBUG oslo_service.periodic_task [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:54:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:54:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:54:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:38 devstack sudo[101025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:54:38 devstack sudo[101025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:38 devstack sudo[101017]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cff9b534-f5f8-4585-ba13-4d3a9e82f245 tempest-VolumesDeleteCascade-1448271507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d 1073741824" returned: 0 in 0.911s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cff9b534-f5f8-4585-ba13-4d3a9e82f245 tempest-VolumesDeleteCascade-1448271507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:39 devstack sudo[101030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d Sep 25 11:54:39 devstack sudo[101030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:39 devstack sudo[101019]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f0dad139-3b14-40a4-a6ec-8378b085787c tempest-SnapshotDependencyTests-534278840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-839b96d1-eaff-4d05-a0c4-90f85c79926b.080ce69e-aa83-4668-ad32-b20472f65f4a" returned: 0 in 0.875s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:39 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-f0dad139-3b14-40a4-a6ec-8378b085787c tempest-SnapshotDependencyTests-534278840 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-839b96d1-eaff-4d05-a0c4-90f85c79926b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86984) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:54:39 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d2dd7f-1a2f-4639-88ff-107bca4c9075]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:54:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f0dad139-3b14-40a4-a6ec-8378b085787c tempest-SnapshotDependencyTests-534278840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-839b96d1-eaff-4d05-a0c4-90f85c79926b {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:39 devstack sudo[101025]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.792s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:39 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:54:39 devstack sudo[101035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-839b96d1-eaff-4d05-a0c4-90f85c79926b Sep 25 11:54:39 devstack sudo[101035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:39 devstack cinder-volume[86984]: DEBUG oslo_service.periodic_task [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running periodic task VolumeManager._thread_info {{(pid=86984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:54:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] thread count: 28 {{(pid=86984) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 11:54:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] thread info: [<_MainThread(MainThread, started 132046492332160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86984) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 11:54:39 devstack sudo[101030]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cff9b534-f5f8-4585-ba13-4d3a9e82f245 tempest-VolumesDeleteCascade-1448271507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d" returned: 0 in 0.556s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:39 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-cff9b534-f5f8-4585-ba13-4d3a9e82f245 tempest-VolumesDeleteCascade-1448271507 None] <== create_volume: return (1573ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:54:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-cff9b534-f5f8-4585-ba13-4d3a9e82f245 tempest-VolumesDeleteCascade-1448271507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.580s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cff9b534-f5f8-4585-ba13-4d3a9e82f245 tempest-VolumesDeleteCascade-1448271507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9e571cd-036b-471a-a4c1-6c1f5aa7e6e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cff9b534-f5f8-4585-ba13-4d3a9e82f245 tempest-VolumesDeleteCascade-1448271507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (045dfb7b-a2a8-4b01-b782-c1f73b870f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:39 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-cff9b534-f5f8-4585-ba13-4d3a9e82f245 tempest-VolumesDeleteCascade-1448271507 None] Volume volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d (1a8ff2e4-3674-4ef2-8c80-40fa7748e34d): created successfully Sep 25 11:54:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cff9b534-f5f8-4585-ba13-4d3a9e82f245 tempest-VolumesDeleteCascade-1448271507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (045dfb7b-a2a8-4b01-b782-c1f73b870f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cff9b534-f5f8-4585-ba13-4d3a9e82f245 tempest-VolumesDeleteCascade-1448271507 None] Flow 'volume_create_manager' (14597fcb-06f1-40cc-a249-f873091403a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:54:39 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-cff9b534-f5f8-4585-ba13-4d3a9e82f245 tempest-VolumesDeleteCascade-1448271507 None] Created volume successfully. Sep 25 11:54:40 devstack sudo[101035]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:40 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f0dad139-3b14-40a4-a6ec-8378b085787c tempest-SnapshotDependencyTests-534278840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-839b96d1-eaff-4d05-a0c4-90f85c79926b" returned: 0 in 1.111s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:40 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f0dad139-3b14-40a4-a6ec-8378b085787c tempest-SnapshotDependencyTests-534278840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-839b96d1-eaff-4d05-a0c4-90f85c79926b.080ce69e-aa83-4668-ad32-b20472f65f4a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:40 devstack sudo[101045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-839b96d1-eaff-4d05-a0c4-90f85c79926b.080ce69e-aa83-4668-ad32-b20472f65f4a Sep 25 11:54:40 devstack sudo[101045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:40 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-02f743ae-4040-4ee7-899c-01e14a0abfe3 tempest-VolumesDeleteCascade-1448271507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:40 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-02f743ae-4040-4ee7-899c-01e14a0abfe3 tempest-VolumesDeleteCascade-1448271507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:40 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-02f743ae-4040-4ee7-899c-01e14a0abfe3 tempest-VolumesDeleteCascade-1448271507 None] Creating offline snapshot 266f30b6-300e-46a5-bcf8-b535d47a5dd5 of volume 1a8ff2e4-3674-4ef2-8c80-40fa7748e34d {{(pid=86984) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:54:40 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc65b28-58b0-4482-953e-21a2a6bf93f8]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:54:40 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-02f743ae-4040-4ee7-899c-01e14a0abfe3 tempest-VolumesDeleteCascade-1448271507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:41 devstack sudo[101047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d Sep 25 11:54:41 devstack sudo[101047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:41 devstack sudo[101045]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f0dad139-3b14-40a4-a6ec-8378b085787c tempest-SnapshotDependencyTests-534278840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-839b96d1-eaff-4d05-a0c4-90f85c79926b.080ce69e-aa83-4668-ad32-b20472f65f4a" returned: 0 in 0.791s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f0dad139-3b14-40a4-a6ec-8378b085787c tempest-SnapshotDependencyTests-534278840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-839b96d1-eaff-4d05-a0c4-90f85c79926b.080ce69e-aa83-4668-ad32-b20472f65f4a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:41 devstack sudo[101052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-839b96d1-eaff-4d05-a0c4-90f85c79926b.080ce69e-aa83-4668-ad32-b20472f65f4a Sep 25 11:54:41 devstack sudo[101052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:41 devstack sudo[101047]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-02f743ae-4040-4ee7-899c-01e14a0abfe3 tempest-VolumesDeleteCascade-1448271507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d" returned: 0 in 0.810s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-02f743ae-4040-4ee7-899c-01e14a0abfe3 tempest-VolumesDeleteCascade-1448271507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d.266f30b6-300e-46a5-bcf8-b535d47a5dd5 1G {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:41 devstack sudo[101057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d.266f30b6-300e-46a5-bcf8-b535d47a5dd5 1G Sep 25 11:54:41 devstack sudo[101057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:41 devstack sudo[101052]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f0dad139-3b14-40a4-a6ec-8378b085787c tempest-SnapshotDependencyTests-534278840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-839b96d1-eaff-4d05-a0c4-90f85c79926b.080ce69e-aa83-4668-ad32-b20472f65f4a" returned: 0 in 0.667s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:41 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f0dad139-3b14-40a4-a6ec-8378b085787c tempest-SnapshotDependencyTests-534278840 None] Lock "cinder-quobyte-080ce69e-aa83-4668-ad32-b20472f65f4a" released by "_delete_snapshot" :: held 3.722s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:41 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f0dad139-3b14-40a4-a6ec-8378b085787c tempest-SnapshotDependencyTests-534278840 None] Lock "cinder-quobyte-839b96d1-eaff-4d05-a0c4-90f85c79926b" released by "delete_snapshot" :: held 3.791s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:42 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-f0dad139-3b14-40a4-a6ec-8378b085787c tempest-SnapshotDependencyTests-534278840 None] Created reservations ['4a994d8e-fd70-49c2-9c53-c1c34ee66fcf', 'ec209935-d325-4eb0-99df-290cb4fa8dd8', '6c341511-4885-4a4d-aab8-805b7d3d607a', 'd0a98261-db93-420b-a12d-a2651bde2f38'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:54:42 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-f0dad139-3b14-40a4-a6ec-8378b085787c tempest-SnapshotDependencyTests-534278840 None] Delete snapshot completed successfully. Sep 25 11:54:42 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f0dad139-3b14-40a4-a6ec-8378b085787c tempest-SnapshotDependencyTests-534278840 None] Lock "cinder-080ce69e-aa83-4668-ad32-b20472f65f4a-delete_snapshot" released by "delete_snapshot" :: held 4.086s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:42 devstack sudo[101057]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:42 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-02f743ae-4040-4ee7-899c-01e14a0abfe3 tempest-VolumesDeleteCascade-1448271507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d.266f30b6-300e-46a5-bcf8-b535d47a5dd5 1G" returned: 0 in 1.128s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:42 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-02f743ae-4040-4ee7-899c-01e14a0abfe3 tempest-VolumesDeleteCascade-1448271507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d.266f30b6-300e-46a5-bcf8-b535d47a5dd5 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:42 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-6d40bfde-5d5b-4617-84f7-88cfe6d3492d tempest-SnapshotDependencyTests-534278840 None] Acquiring lock "cinder-839b96d1-eaff-4d05-a0c4-90f85c79926b-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:42 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-6d40bfde-5d5b-4617-84f7-88cfe6d3492d tempest-SnapshotDependencyTests-534278840 None] Lock "cinder-839b96d1-eaff-4d05-a0c4-90f85c79926b-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:42 devstack sudo[101065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d.266f30b6-300e-46a5-bcf8-b535d47a5dd5 Sep 25 11:54:42 devstack sudo[101065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:42 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-6d40bfde-5d5b-4617-84f7-88cfe6d3492d tempest-SnapshotDependencyTests-534278840 None] Acquiring lock "cinder-quobyte-839b96d1-eaff-4d05-a0c4-90f85c79926b" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:42 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-6d40bfde-5d5b-4617-84f7-88cfe6d3492d tempest-SnapshotDependencyTests-534278840 None] Lock "cinder-quobyte-839b96d1-eaff-4d05-a0c4-90f85c79926b" acquired by "delete_volume" :: waited 0.048s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:43 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe73b34-0479-4b6b-b617-cfbe3c21120a]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:54:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6d40bfde-5d5b-4617-84f7-88cfe6d3492d tempest-SnapshotDependencyTests-534278840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-839b96d1-eaff-4d05-a0c4-90f85c79926b {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:43 devstack sudo[101067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-839b96d1-eaff-4d05-a0c4-90f85c79926b Sep 25 11:54:43 devstack sudo[101067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:43 devstack sudo[101065]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-02f743ae-4040-4ee7-899c-01e14a0abfe3 tempest-VolumesDeleteCascade-1448271507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d.266f30b6-300e-46a5-bcf8-b535d47a5dd5" returned: 0 in 0.720s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:43 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-02f743ae-4040-4ee7-899c-01e14a0abfe3 tempest-VolumesDeleteCascade-1448271507 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d.266f30b6-300e-46a5-bcf8-b535d47a5dd5 is being set with open permissions: ugo+rw Sep 25 11:54:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-02f743ae-4040-4ee7-899c-01e14a0abfe3 tempest-VolumesDeleteCascade-1448271507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d.266f30b6-300e-46a5-bcf8-b535d47a5dd5 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:43 devstack sudo[101072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d.266f30b6-300e-46a5-bcf8-b535d47a5dd5 Sep 25 11:54:43 devstack sudo[101072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:43 devstack sudo[101067]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6d40bfde-5d5b-4617-84f7-88cfe6d3492d tempest-SnapshotDependencyTests-534278840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-839b96d1-eaff-4d05-a0c4-90f85c79926b" returned: 0 in 0.654s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6d40bfde-5d5b-4617-84f7-88cfe6d3492d tempest-SnapshotDependencyTests-534278840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-839b96d1-eaff-4d05-a0c4-90f85c79926b {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:43 devstack sudo[101078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-839b96d1-eaff-4d05-a0c4-90f85c79926b Sep 25 11:54:43 devstack sudo[101078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:43 devstack sudo[101072]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-02f743ae-4040-4ee7-899c-01e14a0abfe3 tempest-VolumesDeleteCascade-1448271507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d.266f30b6-300e-46a5-bcf8-b535d47a5dd5" returned: 0 in 0.559s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-02f743ae-4040-4ee7-899c-01e14a0abfe3 tempest-VolumesDeleteCascade-1448271507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:44 devstack sudo[101081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d.info Sep 25 11:54:44 devstack sudo[101081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:44 devstack sudo[101078]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6d40bfde-5d5b-4617-84f7-88cfe6d3492d tempest-SnapshotDependencyTests-534278840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-839b96d1-eaff-4d05-a0c4-90f85c79926b" returned: 0 in 0.628s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:44 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-6d40bfde-5d5b-4617-84f7-88cfe6d3492d tempest-SnapshotDependencyTests-534278840 None] Lock "cinder-quobyte-839b96d1-eaff-4d05-a0c4-90f85c79926b" released by "delete_volume" :: held 1.449s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:44 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-6d40bfde-5d5b-4617-84f7-88cfe6d3492d tempest-SnapshotDependencyTests-534278840 None] Created reservations ['37e35e02-1c3b-454d-8a82-ea636f8bbc55', 'b7b39db1-98fd-43df-8048-11a818e2ea5f', 'd2c89f5f-5f6f-4f2c-8026-d60beaa6ee5a', '2d23a2f5-6c73-4626-a73b-cd372e1a907f'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:54:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-6d40bfde-5d5b-4617-84f7-88cfe6d3492d tempest-SnapshotDependencyTests-534278840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-6d40bfde-5d5b-4617-84f7-88cfe6d3492d tempest-SnapshotDependencyTests-534278840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:44 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-6d40bfde-5d5b-4617-84f7-88cfe6d3492d tempest-SnapshotDependencyTests-534278840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:54:44 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-6d40bfde-5d5b-4617-84f7-88cfe6d3492d tempest-SnapshotDependencyTests-534278840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:54:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-6d40bfde-5d5b-4617-84f7-88cfe6d3492d tempest-SnapshotDependencyTests-534278840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6d40bfde-5d5b-4617-84f7-88cfe6d3492d tempest-SnapshotDependencyTests-534278840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:44 devstack sudo[101081]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-02f743ae-4040-4ee7-899c-01e14a0abfe3 tempest-VolumesDeleteCascade-1448271507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d.info" returned: 0 in 0.522s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:44 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-02f743ae-4040-4ee7-899c-01e14a0abfe3 tempest-VolumesDeleteCascade-1448271507 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d.info is being set with open permissions: ugo+rw Sep 25 11:54:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-02f743ae-4040-4ee7-899c-01e14a0abfe3 tempest-VolumesDeleteCascade-1448271507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:44 devstack sudo[101086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:54:44 devstack sudo[101086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:44 devstack sudo[101087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d.info Sep 25 11:54:44 devstack sudo[101087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:45 devstack sudo[101086]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6d40bfde-5d5b-4617-84f7-88cfe6d3492d tempest-SnapshotDependencyTests-534278840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.431s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:45 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-6d40bfde-5d5b-4617-84f7-88cfe6d3492d tempest-SnapshotDependencyTests-534278840 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:54:45 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-6d40bfde-5d5b-4617-84f7-88cfe6d3492d tempest-SnapshotDependencyTests-534278840 None] Deleted volume successfully. Sep 25 11:54:45 devstack sudo[101087]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-02f743ae-4040-4ee7-899c-01e14a0abfe3 tempest-VolumesDeleteCascade-1448271507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d.info" returned: 0 in 0.436s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-02f743ae-4040-4ee7-899c-01e14a0abfe3 tempest-VolumesDeleteCascade-1448271507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.433s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:45 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-6d40bfde-5d5b-4617-84f7-88cfe6d3492d tempest-SnapshotDependencyTests-534278840 None] Lock "cinder-839b96d1-eaff-4d05-a0c4-90f85c79926b-delete_volume" released by "delete_volume" :: held 2.318s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:45 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-02f743ae-4040-4ee7-899c-01e14a0abfe3 tempest-VolumesDeleteCascade-1448271507 None] Create snapshot completed successfully Sep 25 11:54:45 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-a9093f15-0ed3-4d06-811e-b6dd8b534d88 tempest-SnapshotDependencyTests-534278840 None] Acquiring lock "cinder-bc658165-e975-46dc-b36b-23fd34d09e91-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:45 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-a9093f15-0ed3-4d06-811e-b6dd8b534d88 tempest-SnapshotDependencyTests-534278840 None] Lock "cinder-bc658165-e975-46dc-b36b-23fd34d09e91-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:45 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-a9093f15-0ed3-4d06-811e-b6dd8b534d88 tempest-SnapshotDependencyTests-534278840 None] Acquiring lock "cinder-quobyte-bc658165-e975-46dc-b36b-23fd34d09e91" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:45 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-a9093f15-0ed3-4d06-811e-b6dd8b534d88 tempest-SnapshotDependencyTests-534278840 None] Lock "cinder-quobyte-bc658165-e975-46dc-b36b-23fd34d09e91" acquired by "delete_volume" :: waited 0.046s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:45 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc5d1cb-eb89-4a15-9e61-d7f5325d8c95]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:54:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a9093f15-0ed3-4d06-811e-b6dd8b534d88 tempest-SnapshotDependencyTests-534278840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bc658165-e975-46dc-b36b-23fd34d09e91 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:45 devstack sudo[101092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bc658165-e975-46dc-b36b-23fd34d09e91 Sep 25 11:54:45 devstack sudo[101092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:46 devstack sudo[101092]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a9093f15-0ed3-4d06-811e-b6dd8b534d88 tempest-SnapshotDependencyTests-534278840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bc658165-e975-46dc-b36b-23fd34d09e91" returned: 0 in 0.568s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a9093f15-0ed3-4d06-811e-b6dd8b534d88 tempest-SnapshotDependencyTests-534278840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bc658165-e975-46dc-b36b-23fd34d09e91 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:46 devstack sudo[101097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bc658165-e975-46dc-b36b-23fd34d09e91 Sep 25 11:54:46 devstack sudo[101097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-7cc041f8-6123-4390-8a71-164c5ed8c71f tempest-VolumesDeleteCascade-1448271507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-7cc041f8-6123-4390-8a71-164c5ed8c71f tempest-VolumesDeleteCascade-1448271507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:46 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-7cc041f8-6123-4390-8a71-164c5ed8c71f tempest-VolumesDeleteCascade-1448271507 None] Creating offline snapshot b14dc914-06e8-4357-8bb2-9f3859b3ffc7 of volume 1a8ff2e4-3674-4ef2-8c80-40fa7748e34d {{(pid=86984) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:54:46 devstack sudo[101097]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a9093f15-0ed3-4d06-811e-b6dd8b534d88 tempest-SnapshotDependencyTests-534278840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bc658165-e975-46dc-b36b-23fd34d09e91" returned: 0 in 0.584s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:46 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[a168c536-4fc9-4f11-80fb-c8ec5c93c729]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:54:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7cc041f8-6123-4390-8a71-164c5ed8c71f tempest-VolumesDeleteCascade-1448271507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d.266f30b6-300e-46a5-bcf8-b535d47a5dd5 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:46 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-a9093f15-0ed3-4d06-811e-b6dd8b534d88 tempest-SnapshotDependencyTests-534278840 None] Lock "cinder-quobyte-bc658165-e975-46dc-b36b-23fd34d09e91" released by "delete_volume" :: held 1.267s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:46 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-a9093f15-0ed3-4d06-811e-b6dd8b534d88 tempest-SnapshotDependencyTests-534278840 None] Created reservations ['4954f7d3-aa06-448a-89ef-8798657d0b6c', '14e6b27c-ac87-4ffd-ae92-b0cd587bf567', '80c9e125-9901-43e3-bb27-79305c3b4dfd', '1b37bf11-620b-4965-ab0d-e938d3acd87c'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:54:46 devstack sudo[101100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d.266f30b6-300e-46a5-bcf8-b535d47a5dd5 Sep 25 11:54:46 devstack sudo[101100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-a9093f15-0ed3-4d06-811e-b6dd8b534d88 tempest-SnapshotDependencyTests-534278840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-a9093f15-0ed3-4d06-811e-b6dd8b534d88 tempest-SnapshotDependencyTests-534278840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:46 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-a9093f15-0ed3-4d06-811e-b6dd8b534d88 tempest-SnapshotDependencyTests-534278840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:54:46 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-a9093f15-0ed3-4d06-811e-b6dd8b534d88 tempest-SnapshotDependencyTests-534278840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:54:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-a9093f15-0ed3-4d06-811e-b6dd8b534d88 tempest-SnapshotDependencyTests-534278840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a9093f15-0ed3-4d06-811e-b6dd8b534d88 tempest-SnapshotDependencyTests-534278840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:47 devstack sudo[101102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:54:47 devstack sudo[101102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:47 devstack sudo[101100]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7cc041f8-6123-4390-8a71-164c5ed8c71f tempest-VolumesDeleteCascade-1448271507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d.266f30b6-300e-46a5-bcf8-b535d47a5dd5" returned: 0 in 0.688s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:47 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-7cc041f8-6123-4390-8a71-164c5ed8c71f tempest-VolumesDeleteCascade-1448271507 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86984) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:54:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7cc041f8-6123-4390-8a71-164c5ed8c71f tempest-VolumesDeleteCascade-1448271507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d.266f30b6-300e-46a5-bcf8-b535d47a5dd5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d.b14dc914-06e8-4357-8bb2-9f3859b3ffc7 1G {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:47 devstack sudo[101102]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a9093f15-0ed3-4d06-811e-b6dd8b534d88 tempest-SnapshotDependencyTests-534278840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.422s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:47 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-a9093f15-0ed3-4d06-811e-b6dd8b534d88 tempest-SnapshotDependencyTests-534278840 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:54:47 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-a9093f15-0ed3-4d06-811e-b6dd8b534d88 tempest-SnapshotDependencyTests-534278840 None] Deleted volume successfully. Sep 25 11:54:47 devstack sudo[101109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d.266f30b6-300e-46a5-bcf8-b535d47a5dd5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d.b14dc914-06e8-4357-8bb2-9f3859b3ffc7 1G Sep 25 11:54:47 devstack sudo[101109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:47 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-a9093f15-0ed3-4d06-811e-b6dd8b534d88 tempest-SnapshotDependencyTests-534278840 None] Lock "cinder-bc658165-e975-46dc-b36b-23fd34d09e91-delete_volume" released by "delete_volume" :: held 2.139s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:48 devstack sudo[101109]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7cc041f8-6123-4390-8a71-164c5ed8c71f tempest-VolumesDeleteCascade-1448271507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d.266f30b6-300e-46a5-bcf8-b535d47a5dd5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d.b14dc914-06e8-4357-8bb2-9f3859b3ffc7 1G" returned: 0 in 1.065s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7cc041f8-6123-4390-8a71-164c5ed8c71f tempest-VolumesDeleteCascade-1448271507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d.266f30b6-300e-46a5-bcf8-b535d47a5dd5 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d.b14dc914-06e8-4357-8bb2-9f3859b3ffc7 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:48 devstack sudo[101114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d.266f30b6-300e-46a5-bcf8-b535d47a5dd5 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d.b14dc914-06e8-4357-8bb2-9f3859b3ffc7 Sep 25 11:54:48 devstack sudo[101114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:49 devstack sudo[101114]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7cc041f8-6123-4390-8a71-164c5ed8c71f tempest-VolumesDeleteCascade-1448271507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d.266f30b6-300e-46a5-bcf8-b535d47a5dd5 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d.b14dc914-06e8-4357-8bb2-9f3859b3ffc7" returned: 0 in 0.756s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:49 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-7cc041f8-6123-4390-8a71-164c5ed8c71f tempest-VolumesDeleteCascade-1448271507 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d.b14dc914-06e8-4357-8bb2-9f3859b3ffc7 is being set with open permissions: ugo+rw Sep 25 11:54:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7cc041f8-6123-4390-8a71-164c5ed8c71f tempest-VolumesDeleteCascade-1448271507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d.b14dc914-06e8-4357-8bb2-9f3859b3ffc7 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:49 devstack sudo[101120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d.b14dc914-06e8-4357-8bb2-9f3859b3ffc7 Sep 25 11:54:49 devstack sudo[101120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:49 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-e991cc00-540a-4d9c-a6b8-4caace741e6b tempest-VolumeImageDependencyTests-1643693718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:54:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e991cc00-540a-4d9c-a6b8-4caace741e6b tempest-VolumeImageDependencyTests-1643693718 None] Flow 'volume_create_manager' (d70f0c78-4624-47e4-b15e-c733bae882c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:54:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e991cc00-540a-4d9c-a6b8-4caace741e6b tempest-VolumeImageDependencyTests-1643693718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e641542f-1cd6-4a11-81a4-2dd72e248db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e991cc00-540a-4d9c-a6b8-4caace741e6b tempest-VolumeImageDependencyTests-1643693718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e641542f-1cd6-4a11-81a4-2dd72e248db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:54:49Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b355aa32-0925-461a-adba-ac53f0952a33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d46ef1f954e8400aa9d707c9fd2c43e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:54:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:54:49Z,use_quota=True,user_id='869630f1f31e4335a703df371cf4266f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e991cc00-540a-4d9c-a6b8-4caace741e6b tempest-VolumeImageDependencyTests-1643693718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25465208-8570-44e7-b7d7-ab7cd3fd7ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e991cc00-540a-4d9c-a6b8-4caace741e6b tempest-VolumeImageDependencyTests-1643693718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25465208-8570-44e7-b7d7-ab7cd3fd7ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e991cc00-540a-4d9c-a6b8-4caace741e6b tempest-VolumeImageDependencyTests-1643693718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2a52b7b-a2a1-4f73-a4eb-3b3f691197b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:49 devstack cinder-volume[86984]: DEBUG cinder.image.glance [None req-e991cc00-540a-4d9c-a6b8-4caace741e6b tempest-VolumeImageDependencyTests-1643693718 None] Creating Keystone auth plugin from conf {{(pid=86984) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 11:54:49 devstack sudo[101120]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7cc041f8-6123-4390-8a71-164c5ed8c71f tempest-VolumesDeleteCascade-1448271507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d.b14dc914-06e8-4357-8bb2-9f3859b3ffc7" returned: 0 in 0.371s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-7cc041f8-6123-4390-8a71-164c5ed8c71f tempest-VolumesDeleteCascade-1448271507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.093s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:49 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-7cc041f8-6123-4390-8a71-164c5ed8c71f tempest-VolumesDeleteCascade-1448271507 None] Create snapshot completed successfully Sep 25 11:54:50 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e991cc00-540a-4d9c-a6b8-4caace741e6b tempest-VolumeImageDependencyTests-1643693718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2a52b7b-a2a1-4f73-a4eb-3b3f691197b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b355aa32-0925-461a-adba-ac53f0952a33', 'volume_name': 'volume-b355aa32-0925-461a-adba-ac53f0952a33', 'volume_size': 1, 'image_id': '31d65f7d-8f56-41eb-ab8b-48b826c03d90', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/31d65f7d-8f56-41eb-ab8b-48b826c03d90', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b15ed65766bc7659e0e29f0416328123', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd46ef1f954e8400aa9d707c9fd2c43e0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b7b4f0861510fe05f37b6fc48b002e32592e3f63b65bb4b187129da5a5724b27532a9988bc7a20854df56578a5fef580d98992a47db2fdf555e0206d2387b6b1', 'id': '31d65f7d-8f56-41eb-ab8b-48b826c03d90', 'created_at': datetime.datetime(2026, 9, 25, 9, 54, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 54, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/31d65f7d-8f56-41eb-ab8b-48b826c03d90/file', 'properties': {}}, 'image_service': }' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:50 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e991cc00-540a-4d9c-a6b8-4caace741e6b tempest-VolumeImageDependencyTests-1643693718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70d21bee-2460-4443-be3e-0f48b054d725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:50 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e991cc00-540a-4d9c-a6b8-4caace741e6b tempest-VolumeImageDependencyTests-1643693718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70d21bee-2460-4443-be3e-0f48b054d725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:50 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e991cc00-540a-4d9c-a6b8-4caace741e6b tempest-VolumeImageDependencyTests-1643693718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0615636-479f-493a-af7a-f1e970a18845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:50 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-e991cc00-540a-4d9c-a6b8-4caace741e6b tempest-VolumeImageDependencyTests-1643693718 None] Volume b355aa32-0925-461a-adba-ac53f0952a33: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b355aa32-0925-461a-adba-ac53f0952a33', 'volume_size': 1, 'image_id': '31d65f7d-8f56-41eb-ab8b-48b826c03d90', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/31d65f7d-8f56-41eb-ab8b-48b826c03d90', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b15ed65766bc7659e0e29f0416328123', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd46ef1f954e8400aa9d707c9fd2c43e0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b7b4f0861510fe05f37b6fc48b002e32592e3f63b65bb4b187129da5a5724b27532a9988bc7a20854df56578a5fef580d98992a47db2fdf555e0206d2387b6b1', 'id': '31d65f7d-8f56-41eb-ab8b-48b826c03d90', 'created_at': datetime.datetime(2026, 9, 25, 9, 54, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 54, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/31d65f7d-8f56-41eb-ab8b-48b826c03d90/file', 'properties': {}}, 'image_service': } Sep 25 11:54:50 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-e991cc00-540a-4d9c-a6b8-4caace741e6b tempest-VolumeImageDependencyTests-1643693718 None] Trying to clone b355aa32-0925-461a-adba-ac53f0952a33 from image 31d65f7d-8f56-41eb-ab8b-48b826c03d90 at location (None, [{'url': 'file:///opt/stack/data/glance/images/31d65f7d-8f56-41eb-ab8b-48b826c03d90', 'metadata': {}}]). {{(pid=86984) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 11:54:50 devstack cinder-volume[86984]: DEBUG cinder.image.image_utils [None req-e991cc00-540a-4d9c-a6b8-4caace741e6b tempest-VolumeImageDependencyTests-1643693718 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_31d65f7d-8f56-41eb-ab8b-48b826c03d90_irdywhy6devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86984) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 11:54:50 devstack cinder-volume[86984]: INFO cinder.image.image_utils [None req-e991cc00-540a-4d9c-a6b8-4caace741e6b tempest-VolumeImageDependencyTests-1643693718 None] Image download 0.00 MB at 0.00 MB/s Sep 25 11:54:50 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[c676ba20-ef7c-4c29-bb06-44b5f81972d3]: (4, 'raw') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:54:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e991cc00-540a-4d9c-a6b8-4caace741e6b tempest-VolumeImageDependencyTests-1643693718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_31d65f7d-8f56-41eb-ab8b-48b826c03d90_irdywhy6devstack@QuobyteHD {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:50 devstack sudo[101123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_31d65f7d-8f56-41eb-ab8b-48b826c03d90_irdywhy6devstack@QuobyteHD Sep 25 11:54:50 devstack sudo[101123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:50 devstack sudo[101123]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e991cc00-540a-4d9c-a6b8-4caace741e6b tempest-VolumeImageDependencyTests-1643693718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_31d65f7d-8f56-41eb-ab8b-48b826c03d90_irdywhy6devstack@QuobyteHD" returned: 0 in 0.466s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e991cc00-540a-4d9c-a6b8-4caace741e6b tempest-VolumeImageDependencyTests-1643693718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_31d65f7d-8f56-41eb-ab8b-48b826c03d90_irdywhy6devstack@QuobyteHD {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:50 devstack sudo[101128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_31d65f7d-8f56-41eb-ab8b-48b826c03d90_irdywhy6devstack@QuobyteHD Sep 25 11:54:50 devstack sudo[101128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:50 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-704ca7b1-c963-465b-84a5-713627c0551d tempest-VolumesDeleteCascade-1448271507 None] Acquiring lock "cinder-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:50 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-704ca7b1-c963-465b-84a5-713627c0551d tempest-VolumesDeleteCascade-1448271507 None] Lock "cinder-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:51 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-704ca7b1-c963-465b-84a5-713627c0551d tempest-VolumesDeleteCascade-1448271507 None] Performing cascade delete. {{(pid=86984) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 25 11:54:51 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-704ca7b1-c963-465b-84a5-713627c0551d tempest-VolumesDeleteCascade-1448271507 None] Acquiring lock "cinder-266f30b6-300e-46a5-bcf8-b535d47a5dd5-delete_snapshot" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:51 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-704ca7b1-c963-465b-84a5-713627c0551d tempest-VolumesDeleteCascade-1448271507 None] Lock "cinder-266f30b6-300e-46a5-bcf8-b535d47a5dd5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:51 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-704ca7b1-c963-465b-84a5-713627c0551d tempest-VolumesDeleteCascade-1448271507 None] Acquiring lock "cinder-quobyte-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:51 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-704ca7b1-c963-465b-84a5-713627c0551d tempest-VolumesDeleteCascade-1448271507 None] Lock "cinder-quobyte-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:51 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-704ca7b1-c963-465b-84a5-713627c0551d tempest-VolumesDeleteCascade-1448271507 None] Acquiring lock "cinder-quobyte-266f30b6-300e-46a5-bcf8-b535d47a5dd5" by "_delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:51 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-704ca7b1-c963-465b-84a5-713627c0551d tempest-VolumesDeleteCascade-1448271507 None] Lock "cinder-quobyte-266f30b6-300e-46a5-bcf8-b535d47a5dd5" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:51 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-704ca7b1-c963-465b-84a5-713627c0551d tempest-VolumesDeleteCascade-1448271507 None] Deleting offline snapshot 266f30b6-300e-46a5-bcf8-b535d47a5dd5 of volume 1a8ff2e4-3674-4ef2-8c80-40fa7748e34d {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:54:51 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-704ca7b1-c963-465b-84a5-713627c0551d tempest-VolumesDeleteCascade-1448271507 None] snapshot_file for this snap is: volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d.266f30b6-300e-46a5-bcf8-b535d47a5dd5 {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:54:51 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e8711c5-984b-4c3c-a5d4-6b26a5b77e31]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:54:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-704ca7b1-c963-465b-84a5-713627c0551d tempest-VolumesDeleteCascade-1448271507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d.266f30b6-300e-46a5-bcf8-b535d47a5dd5 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:51 devstack sudo[101128]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e991cc00-540a-4d9c-a6b8-4caace741e6b tempest-VolumeImageDependencyTests-1643693718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_31d65f7d-8f56-41eb-ab8b-48b826c03d90_irdywhy6devstack@QuobyteHD" returned: 1 in 0.495s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e991cc00-540a-4d9c-a6b8-4caace741e6b tempest-VolumeImageDependencyTests-1643693718 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_31d65f7d-8f56-41eb-ab8b-48b826c03d90_irdywhy6devstack@QuobyteHD' failed. Not Retrying. {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 11:54:51 devstack cinder-volume[86984]: DEBUG cinder.image.image_utils [None req-e991cc00-540a-4d9c-a6b8-4caace741e6b tempest-VolumeImageDependencyTests-1643693718 None] Temporary image 31d65f7d-8f56-41eb-ab8b-48b826c03d90 is fetched for user 869630f1f31e4335a703df371cf4266f. {{(pid=86984) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 11:54:51 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f3980e-d75d-4536-a835-14954fda7683]: (4, 'raw') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:54:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e991cc00-540a-4d9c-a6b8-4caace741e6b tempest-VolumeImageDependencyTests-1643693718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_31d65f7d-8f56-41eb-ab8b-48b826c03d90_irdywhy6devstack@QuobyteHD {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:51 devstack sudo[101133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d.266f30b6-300e-46a5-bcf8-b535d47a5dd5 Sep 25 11:54:51 devstack sudo[101133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:51 devstack sudo[101135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_31d65f7d-8f56-41eb-ab8b-48b826c03d90_irdywhy6devstack@QuobyteHD Sep 25 11:54:51 devstack sudo[101135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:51 devstack sudo[101133]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-704ca7b1-c963-465b-84a5-713627c0551d tempest-VolumesDeleteCascade-1448271507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d.266f30b6-300e-46a5-bcf8-b535d47a5dd5" returned: 0 in 0.556s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:51 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-704ca7b1-c963-465b-84a5-713627c0551d tempest-VolumesDeleteCascade-1448271507 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86984) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:54:51 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd27d8ee-48bb-4585-898b-47ce34bf3115]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:54:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-704ca7b1-c963-465b-84a5-713627c0551d tempest-VolumesDeleteCascade-1448271507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:51 devstack sudo[101135]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e991cc00-540a-4d9c-a6b8-4caace741e6b tempest-VolumeImageDependencyTests-1643693718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_31d65f7d-8f56-41eb-ab8b-48b826c03d90_irdywhy6devstack@QuobyteHD" returned: 0 in 0.525s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e991cc00-540a-4d9c-a6b8-4caace741e6b tempest-VolumeImageDependencyTests-1643693718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_31d65f7d-8f56-41eb-ab8b-48b826c03d90_irdywhy6devstack@QuobyteHD {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:52 devstack sudo[101177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d Sep 25 11:54:52 devstack sudo[101177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:52 devstack sudo[101178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_31d65f7d-8f56-41eb-ab8b-48b826c03d90_irdywhy6devstack@QuobyteHD Sep 25 11:54:52 devstack sudo[101178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:52 devstack sudo[101177]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-704ca7b1-c963-465b-84a5-713627c0551d tempest-VolumesDeleteCascade-1448271507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d" returned: 0 in 0.635s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:52 devstack sudo[101178]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e991cc00-540a-4d9c-a6b8-4caace741e6b tempest-VolumeImageDependencyTests-1643693718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_31d65f7d-8f56-41eb-ab8b-48b826c03d90_irdywhy6devstack@QuobyteHD" returned: 1 in 0.650s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e991cc00-540a-4d9c-a6b8-4caace741e6b tempest-VolumeImageDependencyTests-1643693718 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_31d65f7d-8f56-41eb-ab8b-48b826c03d90_irdywhy6devstack@QuobyteHD' failed. Not Retrying. {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 11:54:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-e991cc00-540a-4d9c-a6b8-4caace741e6b tempest-VolumeImageDependencyTests-1643693718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-e991cc00-540a-4d9c-a6b8-4caace741e6b tempest-VolumeImageDependencyTests-1643693718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:52 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-e991cc00-540a-4d9c-a6b8-4caace741e6b tempest-VolumeImageDependencyTests-1643693718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:54:49Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b355aa32-0925-461a-adba-ac53f0952a33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d46ef1f954e8400aa9d707c9fd2c43e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:54:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:54:49Z,use_quota=True,user_id='869630f1f31e4335a703df371cf4266f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:54:52 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-e991cc00-540a-4d9c-a6b8-4caace741e6b tempest-VolumeImageDependencyTests-1643693718 None] Creating volume b355aa32-0925-461a-adba-ac53f0952a33 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:54:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-e991cc00-540a-4d9c-a6b8-4caace741e6b tempest-VolumeImageDependencyTests-1643693718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-e991cc00-540a-4d9c-a6b8-4caace741e6b tempest-VolumeImageDependencyTests-1643693718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:52 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-e991cc00-540a-4d9c-a6b8-4caace741e6b tempest-VolumeImageDependencyTests-1643693718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:54:52 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-e991cc00-540a-4d9c-a6b8-4caace741e6b tempest-VolumeImageDependencyTests-1643693718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:54:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-e991cc00-540a-4d9c-a6b8-4caace741e6b tempest-VolumeImageDependencyTests-1643693718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:52 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-e991cc00-540a-4d9c-a6b8-4caace741e6b tempest-VolumeImageDependencyTests-1643693718 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:54:52 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-e991cc00-540a-4d9c-a6b8-4caace741e6b tempest-VolumeImageDependencyTests-1643693718 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:54:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e991cc00-540a-4d9c-a6b8-4caace741e6b tempest-VolumeImageDependencyTests-1643693718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b355aa32-0925-461a-adba-ac53f0952a33 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:52 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff036ed-c919-44b7-b2dd-7b1ae39889d1]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:54:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-704ca7b1-c963-465b-84a5-713627c0551d tempest-VolumesDeleteCascade-1448271507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d.b14dc914-06e8-4357-8bb2-9f3859b3ffc7 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:52 devstack sudo[101189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b355aa32-0925-461a-adba-ac53f0952a33 1073741824 Sep 25 11:54:52 devstack sudo[101189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:52 devstack sudo[101190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d.b14dc914-06e8-4357-8bb2-9f3859b3ffc7 Sep 25 11:54:52 devstack sudo[101190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:53 devstack sudo[101190]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-704ca7b1-c963-465b-84a5-713627c0551d tempest-VolumesDeleteCascade-1448271507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d.b14dc914-06e8-4357-8bb2-9f3859b3ffc7" returned: 0 in 0.490s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:53 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-704ca7b1-c963-465b-84a5-713627c0551d tempest-VolumesDeleteCascade-1448271507 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86984) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:54:53 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ddc58e-3251-47e2-9c9c-5c03eced56ea]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:54:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-704ca7b1-c963-465b-84a5-713627c0551d tempest-VolumesDeleteCascade-1448271507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d.266f30b6-300e-46a5-bcf8-b535d47a5dd5 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:53 devstack sudo[101189]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e991cc00-540a-4d9c-a6b8-4caace741e6b tempest-VolumeImageDependencyTests-1643693718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b355aa32-0925-461a-adba-ac53f0952a33 1073741824" returned: 0 in 0.669s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:53 devstack sudo[101200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d.266f30b6-300e-46a5-bcf8-b535d47a5dd5 Sep 25 11:54:53 devstack sudo[101200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e991cc00-540a-4d9c-a6b8-4caace741e6b tempest-VolumeImageDependencyTests-1643693718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b355aa32-0925-461a-adba-ac53f0952a33 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:53 devstack sudo[101202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b355aa32-0925-461a-adba-ac53f0952a33 Sep 25 11:54:53 devstack sudo[101202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:53 devstack sudo[101202]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e991cc00-540a-4d9c-a6b8-4caace741e6b tempest-VolumeImageDependencyTests-1643693718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b355aa32-0925-461a-adba-ac53f0952a33" returned: 0 in 0.308s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:53 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-e991cc00-540a-4d9c-a6b8-4caace741e6b tempest-VolumeImageDependencyTests-1643693718 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:54:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-e991cc00-540a-4d9c-a6b8-4caace741e6b tempest-VolumeImageDependencyTests-1643693718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:53 devstack cinder-volume[86984]: DEBUG cinder.volume.volume_utils [None req-e991cc00-540a-4d9c-a6b8-4caace741e6b tempest-VolumeImageDependencyTests-1643693718 None] Attempting download of 31d65f7d-8f56-41eb-ab8b-48b826c03d90 ((None, [{'url': 'file:///opt/stack/data/glance/images/31d65f7d-8f56-41eb-ab8b-48b826c03d90', 'metadata': {}}])) to volume b355aa32-0925-461a-adba-ac53f0952a33. {{(pid=86984) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 11:54:53 devstack sudo[101200]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-704ca7b1-c963-465b-84a5-713627c0551d tempest-VolumesDeleteCascade-1448271507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d.266f30b6-300e-46a5-bcf8-b535d47a5dd5" returned: 0 in 0.632s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:53 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-704ca7b1-c963-465b-84a5-713627c0551d tempest-VolumesDeleteCascade-1448271507 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86984) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:54:53 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[b93b5855-5d6c-4c06-b3ac-103b422a1849]: (4, 'raw') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:54:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e991cc00-540a-4d9c-a6b8-4caace741e6b tempest-VolumeImageDependencyTests-1643693718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_31d65f7d-8f56-41eb-ab8b-48b826c03d90_kkxee8ds {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:53 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[51bb57a1-ccd0-46f6-85bd-03b0707ecfa5]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:54:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-704ca7b1-c963-465b-84a5-713627c0551d tempest-VolumesDeleteCascade-1448271507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:54 devstack sudo[101210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_31d65f7d-8f56-41eb-ab8b-48b826c03d90_kkxee8ds Sep 25 11:54:54 devstack sudo[101210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:54 devstack sudo[101211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d Sep 25 11:54:54 devstack sudo[101211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:54 devstack sudo[101210]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e991cc00-540a-4d9c-a6b8-4caace741e6b tempest-VolumeImageDependencyTests-1643693718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_31d65f7d-8f56-41eb-ab8b-48b826c03d90_kkxee8ds" returned: 0 in 0.638s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e991cc00-540a-4d9c-a6b8-4caace741e6b tempest-VolumeImageDependencyTests-1643693718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_31d65f7d-8f56-41eb-ab8b-48b826c03d90_kkxee8ds {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:54 devstack sudo[101211]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-704ca7b1-c963-465b-84a5-713627c0551d tempest-VolumesDeleteCascade-1448271507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d" returned: 0 in 0.696s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-704ca7b1-c963-465b-84a5-713627c0551d tempest-VolumesDeleteCascade-1448271507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d.266f30b6-300e-46a5-bcf8-b535d47a5dd5 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:54 devstack sudo[101220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d.266f30b6-300e-46a5-bcf8-b535d47a5dd5 Sep 25 11:54:54 devstack sudo[101220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:54 devstack sudo[101219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_31d65f7d-8f56-41eb-ab8b-48b826c03d90_kkxee8ds Sep 25 11:54:54 devstack sudo[101219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:54 devstack sudo[101219]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e991cc00-540a-4d9c-a6b8-4caace741e6b tempest-VolumeImageDependencyTests-1643693718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_31d65f7d-8f56-41eb-ab8b-48b826c03d90_kkxee8ds" returned: 1 in 0.479s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e991cc00-540a-4d9c-a6b8-4caace741e6b tempest-VolumeImageDependencyTests-1643693718 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_31d65f7d-8f56-41eb-ab8b-48b826c03d90_kkxee8ds' failed. Not Retrying. {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 11:54:54 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[802553e0-94f8-48d8-b84b-644ab1977ec8]: (4, 'raw') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:54:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e991cc00-540a-4d9c-a6b8-4caace741e6b tempest-VolumeImageDependencyTests-1643693718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_31d65f7d-8f56-41eb-ab8b-48b826c03d90_irdywhy6devstack@QuobyteHD {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:55 devstack sudo[101220]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-704ca7b1-c963-465b-84a5-713627c0551d tempest-VolumesDeleteCascade-1448271507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d.266f30b6-300e-46a5-bcf8-b535d47a5dd5" returned: 0 in 0.517s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-704ca7b1-c963-465b-84a5-713627c0551d tempest-VolumesDeleteCascade-1448271507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d.266f30b6-300e-46a5-bcf8-b535d47a5dd5 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:55 devstack sudo[101229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d.266f30b6-300e-46a5-bcf8-b535d47a5dd5 Sep 25 11:54:55 devstack sudo[101229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:55 devstack sudo[101228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_31d65f7d-8f56-41eb-ab8b-48b826c03d90_irdywhy6devstack@QuobyteHD Sep 25 11:54:55 devstack sudo[101228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:55 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-37e05f39-0935-4078-92cd-01a683e9b09a tempest-TestShelveInstance-101884204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:54:55 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-37e05f39-0935-4078-92cd-01a683e9b09a tempest-TestShelveInstance-101884204 None] Flow 'volume_create_manager' (eb37b4bc-f4c4-4a6f-946c-9b457abc59a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:54:55 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-37e05f39-0935-4078-92cd-01a683e9b09a tempest-TestShelveInstance-101884204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41c3b4fe-94d3-4ed8-b22c-ac4ffc85d0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:55 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-37e05f39-0935-4078-92cd-01a683e9b09a tempest-TestShelveInstance-101884204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41c3b4fe-94d3-4ed8-b22c-ac4ffc85d0ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:54:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-850478600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afefdf65-66cb-4acc-a2b7-9a1b2e0f8d13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='706eb65041b446338c271108be3577e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:54:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:54:55Z,use_quota=True,user_id='e9a4ea1cfdbb4ef68e12ba81491a492f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:55 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-37e05f39-0935-4078-92cd-01a683e9b09a tempest-TestShelveInstance-101884204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dea795d-c8e5-41e9-9459-9b4982dca7f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:55 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-37e05f39-0935-4078-92cd-01a683e9b09a tempest-TestShelveInstance-101884204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dea795d-c8e5-41e9-9459-9b4982dca7f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:55 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-37e05f39-0935-4078-92cd-01a683e9b09a tempest-TestShelveInstance-101884204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d65ab0cc-89eb-4cfc-b805-362a3efc31cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:55 devstack cinder-volume[86984]: DEBUG cinder.image.glance [None req-37e05f39-0935-4078-92cd-01a683e9b09a tempest-TestShelveInstance-101884204 None] Creating Keystone auth plugin from conf {{(pid=86984) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 11:54:55 devstack sudo[101229]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-704ca7b1-c963-465b-84a5-713627c0551d tempest-VolumesDeleteCascade-1448271507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d.266f30b6-300e-46a5-bcf8-b535d47a5dd5" returned: 0 in 0.446s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-704ca7b1-c963-465b-84a5-713627c0551d tempest-VolumesDeleteCascade-1448271507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d.b14dc914-06e8-4357-8bb2-9f3859b3ffc7 -F qcow2 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:55 devstack sudo[101234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d.b14dc914-06e8-4357-8bb2-9f3859b3ffc7 -F qcow2 Sep 25 11:54:55 devstack sudo[101234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:55 devstack sudo[101228]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e991cc00-540a-4d9c-a6b8-4caace741e6b tempest-VolumeImageDependencyTests-1643693718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_31d65f7d-8f56-41eb-ab8b-48b826c03d90_irdywhy6devstack@QuobyteHD" returned: 0 in 0.635s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e991cc00-540a-4d9c-a6b8-4caace741e6b tempest-VolumeImageDependencyTests-1643693718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_31d65f7d-8f56-41eb-ab8b-48b826c03d90_irdywhy6devstack@QuobyteHD {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:55 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-37e05f39-0935-4078-92cd-01a683e9b09a tempest-TestShelveInstance-101884204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d65ab0cc-89eb-4cfc-b805-362a3efc31cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'afefdf65-66cb-4acc-a2b7-9a1b2e0f8d13', 'volume_name': 'volume-afefdf65-66cb-4acc-a2b7-9a1b2e0f8d13', 'volume_size': 1, 'image_id': 'd93b0aa8-e297-4aff-bb90-fe80872f8b63', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d93b0aa8-e297-4aff-bb90-fe80872f8b63', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a57d184bdf174982a6b60117d6d4a5b4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd93b0aa8-e297-4aff-bb90-fe80872f8b63', 'created_at': datetime.datetime(2026, 9, 25, 9, 31, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 31, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d93b0aa8-e297-4aff-bb90-fe80872f8b63/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:55 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-37e05f39-0935-4078-92cd-01a683e9b09a tempest-TestShelveInstance-101884204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47fa56b3-5def-45ae-a43b-75b9559d5666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:55 devstack sudo[101238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_31d65f7d-8f56-41eb-ab8b-48b826c03d90_irdywhy6devstack@QuobyteHD Sep 25 11:54:55 devstack sudo[101238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:55 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-37e05f39-0935-4078-92cd-01a683e9b09a tempest-TestShelveInstance-101884204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47fa56b3-5def-45ae-a43b-75b9559d5666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:55 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-37e05f39-0935-4078-92cd-01a683e9b09a tempest-TestShelveInstance-101884204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9b8f17d-b063-4a1a-a975-66956208af3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:55 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-37e05f39-0935-4078-92cd-01a683e9b09a tempest-TestShelveInstance-101884204 None] Volume afefdf65-66cb-4acc-a2b7-9a1b2e0f8d13: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-afefdf65-66cb-4acc-a2b7-9a1b2e0f8d13', 'volume_size': 1, 'image_id': 'd93b0aa8-e297-4aff-bb90-fe80872f8b63', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d93b0aa8-e297-4aff-bb90-fe80872f8b63', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a57d184bdf174982a6b60117d6d4a5b4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd93b0aa8-e297-4aff-bb90-fe80872f8b63', 'created_at': datetime.datetime(2026, 9, 25, 9, 31, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 31, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d93b0aa8-e297-4aff-bb90-fe80872f8b63/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 25 11:54:55 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-37e05f39-0935-4078-92cd-01a683e9b09a tempest-TestShelveInstance-101884204 None] Trying to clone afefdf65-66cb-4acc-a2b7-9a1b2e0f8d13 from image d93b0aa8-e297-4aff-bb90-fe80872f8b63 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d93b0aa8-e297-4aff-bb90-fe80872f8b63', 'metadata': {}}]). {{(pid=86984) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 11:54:55 devstack sudo[101234]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-704ca7b1-c963-465b-84a5-713627c0551d tempest-VolumesDeleteCascade-1448271507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d.b14dc914-06e8-4357-8bb2-9f3859b3ffc7 -F qcow2" returned: 0 in 0.507s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:56 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-704ca7b1-c963-465b-84a5-713627c0551d tempest-VolumesDeleteCascade-1448271507 None] Lock "cinder-quobyte-266f30b6-300e-46a5-bcf8-b535d47a5dd5" released by "_delete_snapshot" :: held 4.885s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:56 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-704ca7b1-c963-465b-84a5-713627c0551d tempest-VolumesDeleteCascade-1448271507 None] Lock "cinder-quobyte-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d" released by "delete_snapshot" :: held 4.920s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:56 devstack sudo[101238]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:56 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e991cc00-540a-4d9c-a6b8-4caace741e6b tempest-VolumeImageDependencyTests-1643693718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_31d65f7d-8f56-41eb-ab8b-48b826c03d90_irdywhy6devstack@QuobyteHD" returned: 1 in 0.591s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:56 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e991cc00-540a-4d9c-a6b8-4caace741e6b tempest-VolumeImageDependencyTests-1643693718 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_31d65f7d-8f56-41eb-ab8b-48b826c03d90_irdywhy6devstack@QuobyteHD' failed. Not Retrying. {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 11:54:56 devstack cinder-volume[86984]: DEBUG cinder.image.image_utils [None req-e991cc00-540a-4d9c-a6b8-4caace741e6b tempest-VolumeImageDependencyTests-1643693718 None] 31d65f7d-8f56-41eb-ab8b-48b826c03d90 was raw, converting to qcow2 {{(pid=86984) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 11:54:56 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e991cc00-540a-4d9c-a6b8-4caace741e6b tempest-VolumeImageDependencyTests-1643693718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_31d65f7d-8f56-41eb-ab8b-48b826c03d90_irdywhy6devstack@QuobyteHD /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b355aa32-0925-461a-adba-ac53f0952a33 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:56 devstack sudo[101247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_31d65f7d-8f56-41eb-ab8b-48b826c03d90_irdywhy6devstack@QuobyteHD /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b355aa32-0925-461a-adba-ac53f0952a33 Sep 25 11:54:56 devstack sudo[101247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:56 devstack cinder-volume[86984]: DEBUG cinder.image.image_utils [None req-37e05f39-0935-4078-92cd-01a683e9b09a tempest-TestShelveInstance-101884204 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d93b0aa8-e297-4aff-bb90-fe80872f8b63_sc32zvlxdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86984) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 11:54:56 devstack cinder-volume[86984]: INFO cinder.image.image_utils [None req-37e05f39-0935-4078-92cd-01a683e9b09a tempest-TestShelveInstance-101884204 None] Image download 20.69 MB at 20.69 MB/s Sep 25 11:54:56 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c8e056-9e96-4db2-9c93-3dce6969bccd]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:54:56 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-37e05f39-0935-4078-92cd-01a683e9b09a tempest-TestShelveInstance-101884204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d93b0aa8-e297-4aff-bb90-fe80872f8b63_sc32zvlxdevstack@QuobyteHD {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:56 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-704ca7b1-c963-465b-84a5-713627c0551d tempest-VolumesDeleteCascade-1448271507 None] Created reservations ['117be704-f060-437e-ad41-ad92e3504de7', 'b83935c8-4d94-4d50-86c4-bc39972b58d9', 'ce181579-2626-4b62-a3b1-d2037ea3123b', 'b877263c-451b-437f-b9d6-c4579f3b405e'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:54:56 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-704ca7b1-c963-465b-84a5-713627c0551d tempest-VolumesDeleteCascade-1448271507 None] Delete snapshot completed successfully. Sep 25 11:54:56 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-704ca7b1-c963-465b-84a5-713627c0551d tempest-VolumesDeleteCascade-1448271507 None] Lock "cinder-266f30b6-300e-46a5-bcf8-b535d47a5dd5-delete_snapshot" released by "delete_snapshot" :: held 5.289s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:56 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-704ca7b1-c963-465b-84a5-713627c0551d tempest-VolumesDeleteCascade-1448271507 None] Acquiring lock "cinder-b14dc914-06e8-4357-8bb2-9f3859b3ffc7-delete_snapshot" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:56 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-704ca7b1-c963-465b-84a5-713627c0551d tempest-VolumesDeleteCascade-1448271507 None] Lock "cinder-b14dc914-06e8-4357-8bb2-9f3859b3ffc7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:56 devstack sudo[101249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d93b0aa8-e297-4aff-bb90-fe80872f8b63_sc32zvlxdevstack@QuobyteHD Sep 25 11:54:56 devstack sudo[101249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:56 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-704ca7b1-c963-465b-84a5-713627c0551d tempest-VolumesDeleteCascade-1448271507 None] Acquiring lock "cinder-quobyte-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:56 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-704ca7b1-c963-465b-84a5-713627c0551d tempest-VolumesDeleteCascade-1448271507 None] Lock "cinder-quobyte-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:56 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-704ca7b1-c963-465b-84a5-713627c0551d tempest-VolumesDeleteCascade-1448271507 None] Acquiring lock "cinder-quobyte-b14dc914-06e8-4357-8bb2-9f3859b3ffc7" by "_delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:56 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-704ca7b1-c963-465b-84a5-713627c0551d tempest-VolumesDeleteCascade-1448271507 None] Lock "cinder-quobyte-b14dc914-06e8-4357-8bb2-9f3859b3ffc7" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:56 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-704ca7b1-c963-465b-84a5-713627c0551d tempest-VolumesDeleteCascade-1448271507 None] Deleting offline snapshot b14dc914-06e8-4357-8bb2-9f3859b3ffc7 of volume 1a8ff2e4-3674-4ef2-8c80-40fa7748e34d {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:54:56 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-704ca7b1-c963-465b-84a5-713627c0551d tempest-VolumesDeleteCascade-1448271507 None] snapshot_file for this snap is: volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d.b14dc914-06e8-4357-8bb2-9f3859b3ffc7 {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:54:56 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9bcd1f7-e50e-46c9-b44e-c6daac0c546d]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:54:56 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-704ca7b1-c963-465b-84a5-713627c0551d tempest-VolumesDeleteCascade-1448271507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d.b14dc914-06e8-4357-8bb2-9f3859b3ffc7 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:56 devstack sudo[101254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d.b14dc914-06e8-4357-8bb2-9f3859b3ffc7 Sep 25 11:54:56 devstack sudo[101254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:56 devstack sudo[101249]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:56 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-37e05f39-0935-4078-92cd-01a683e9b09a tempest-TestShelveInstance-101884204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d93b0aa8-e297-4aff-bb90-fe80872f8b63_sc32zvlxdevstack@QuobyteHD" returned: 0 in 0.604s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:56 devstack cinder-volume[86984]: DEBUG cinder.image.image_utils [None req-37e05f39-0935-4078-92cd-01a683e9b09a tempest-TestShelveInstance-101884204 None] Temporary image d93b0aa8-e297-4aff-bb90-fe80872f8b63 is fetched for user e9a4ea1cfdbb4ef68e12ba81491a492f. {{(pid=86984) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 11:54:56 devstack sudo[101247]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:56 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e991cc00-540a-4d9c-a6b8-4caace741e6b tempest-VolumeImageDependencyTests-1643693718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_31d65f7d-8f56-41eb-ab8b-48b826c03d90_irdywhy6devstack@QuobyteHD /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b355aa32-0925-461a-adba-ac53f0952a33" returned: 0 in 0.778s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:56 devstack cinder-volume[86984]: DEBUG cinder.image.image_utils [None req-e991cc00-540a-4d9c-a6b8-4caace741e6b tempest-VolumeImageDependencyTests-1643693718 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_31d65f7d-8f56-41eb-ab8b-48b826c03d90_irdywhy6devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b355aa32-0925-461a-adba-ac53f0952a33 {{(pid=86984) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 11:54:56 devstack cinder-volume[86984]: INFO cinder.image.image_utils [None req-e991cc00-540a-4d9c-a6b8-4caace741e6b tempest-VolumeImageDependencyTests-1643693718 None] Converted 0.00 MB image at 0.00 MB/s Sep 25 11:54:56 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e991cc00-540a-4d9c-a6b8-4caace741e6b tempest-VolumeImageDependencyTests-1643693718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b355aa32-0925-461a-adba-ac53f0952a33 1G {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:56 devstack sudo[101260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b355aa32-0925-461a-adba-ac53f0952a33 1G Sep 25 11:54:56 devstack sudo[101260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:56 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[db722bf2-a0b9-4882-80f7-e7136e8a2c03]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:54:56 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-37e05f39-0935-4078-92cd-01a683e9b09a tempest-TestShelveInstance-101884204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d93b0aa8-e297-4aff-bb90-fe80872f8b63_sc32zvlxdevstack@QuobyteHD {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:57 devstack sudo[101254]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:57 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-704ca7b1-c963-465b-84a5-713627c0551d tempest-VolumesDeleteCascade-1448271507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d.b14dc914-06e8-4357-8bb2-9f3859b3ffc7" returned: 0 in 0.560s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:57 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-704ca7b1-c963-465b-84a5-713627c0551d tempest-VolumesDeleteCascade-1448271507 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86984) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:54:57 devstack sudo[101264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d93b0aa8-e297-4aff-bb90-fe80872f8b63_sc32zvlxdevstack@QuobyteHD Sep 25 11:54:57 devstack sudo[101264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:57 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec8de54a-81aa-466b-8cc7-a34541d9620d]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:54:57 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-704ca7b1-c963-465b-84a5-713627c0551d tempest-VolumesDeleteCascade-1448271507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:57 devstack sudo[101267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d Sep 25 11:54:57 devstack sudo[101267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:57 devstack sudo[101264]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:57 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-37e05f39-0935-4078-92cd-01a683e9b09a tempest-TestShelveInstance-101884204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d93b0aa8-e297-4aff-bb90-fe80872f8b63_sc32zvlxdevstack@QuobyteHD" returned: 0 in 0.417s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:57 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-37e05f39-0935-4078-92cd-01a683e9b09a tempest-TestShelveInstance-101884204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:57 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-37e05f39-0935-4078-92cd-01a683e9b09a tempest-TestShelveInstance-101884204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:57 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-37e05f39-0935-4078-92cd-01a683e9b09a tempest-TestShelveInstance-101884204 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:54:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-850478600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afefdf65-66cb-4acc-a2b7-9a1b2e0f8d13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='706eb65041b446338c271108be3577e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:54:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:54:55Z,use_quota=True,user_id='e9a4ea1cfdbb4ef68e12ba81491a492f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:54:57 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-37e05f39-0935-4078-92cd-01a683e9b09a tempest-TestShelveInstance-101884204 None] Creating volume afefdf65-66cb-4acc-a2b7-9a1b2e0f8d13 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:54:57 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-37e05f39-0935-4078-92cd-01a683e9b09a tempest-TestShelveInstance-101884204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:57 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-37e05f39-0935-4078-92cd-01a683e9b09a tempest-TestShelveInstance-101884204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:57 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-37e05f39-0935-4078-92cd-01a683e9b09a tempest-TestShelveInstance-101884204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:54:57 devstack sudo[101260]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:57 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-37e05f39-0935-4078-92cd-01a683e9b09a tempest-TestShelveInstance-101884204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:54:57 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-37e05f39-0935-4078-92cd-01a683e9b09a tempest-TestShelveInstance-101884204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:57 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-37e05f39-0935-4078-92cd-01a683e9b09a tempest-TestShelveInstance-101884204 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:54:57 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-37e05f39-0935-4078-92cd-01a683e9b09a tempest-TestShelveInstance-101884204 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:54:57 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-37e05f39-0935-4078-92cd-01a683e9b09a tempest-TestShelveInstance-101884204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-afefdf65-66cb-4acc-a2b7-9a1b2e0f8d13 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:57 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e991cc00-540a-4d9c-a6b8-4caace741e6b tempest-VolumeImageDependencyTests-1643693718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b355aa32-0925-461a-adba-ac53f0952a33 1G" returned: 0 in 0.510s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:57 devstack cinder-volume[86984]: DEBUG cinder.volume.volume_utils [None req-e991cc00-540a-4d9c-a6b8-4caace741e6b tempest-VolumeImageDependencyTests-1643693718 None] Downloaded image 31d65f7d-8f56-41eb-ab8b-48b826c03d90 ((None, [{'url': 'file:///opt/stack/data/glance/images/31d65f7d-8f56-41eb-ab8b-48b826c03d90', 'metadata': {}}])) to volume b355aa32-0925-461a-adba-ac53f0952a33 successfully. {{(pid=86984) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 11:54:57 devstack cinder-volume[86984]: DEBUG cinder.image.image_utils [None req-e991cc00-540a-4d9c-a6b8-4caace741e6b tempest-VolumeImageDependencyTests-1643693718 None] Temporary image 31d65f7d-8f56-41eb-ab8b-48b826c03d90 for user 869630f1f31e4335a703df371cf4266f is deleted. {{(pid=86984) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 11:54:57 devstack cinder-volume[86984]: DEBUG cinder.volume.volume_utils [None req-e991cc00-540a-4d9c-a6b8-4caace741e6b tempest-VolumeImageDependencyTests-1643693718 None] Marking volume b355aa32-0925-461a-adba-ac53f0952a33 as bootable. {{(pid=86984) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 11:54:57 devstack sudo[101277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-afefdf65-66cb-4acc-a2b7-9a1b2e0f8d13 1073741824 Sep 25 11:54:57 devstack sudo[101277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:57 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-e991cc00-540a-4d9c-a6b8-4caace741e6b tempest-VolumeImageDependencyTests-1643693718 None] Copying metadata from image 31d65f7d-8f56-41eb-ab8b-48b826c03d90 to b355aa32-0925-461a-adba-ac53f0952a33. {{(pid=86984) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 11:54:57 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-e991cc00-540a-4d9c-a6b8-4caace741e6b tempest-VolumeImageDependencyTests-1643693718 None] Creating volume glance metadata for volume b355aa32-0925-461a-adba-ac53f0952a33 backed by image 31d65f7d-8f56-41eb-ab8b-48b826c03d90 with: {'image_id': '31d65f7d-8f56-41eb-ab8b-48b826c03d90', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'b15ed65766bc7659e0e29f0416328123', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86984) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 11:54:57 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e991cc00-540a-4d9c-a6b8-4caace741e6b tempest-VolumeImageDependencyTests-1643693718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0615636-479f-493a-af7a-f1e970a18845) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b355aa32-0925-461a-adba-ac53f0952a33', 'volume_size': 1, 'image_id': '31d65f7d-8f56-41eb-ab8b-48b826c03d90', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/31d65f7d-8f56-41eb-ab8b-48b826c03d90', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b15ed65766bc7659e0e29f0416328123', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd46ef1f954e8400aa9d707c9fd2c43e0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b7b4f0861510fe05f37b6fc48b002e32592e3f63b65bb4b187129da5a5724b27532a9988bc7a20854df56578a5fef580d98992a47db2fdf555e0206d2387b6b1', 'id': '31d65f7d-8f56-41eb-ab8b-48b826c03d90', 'created_at': datetime.datetime(2026, 9, 25, 9, 54, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 54, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/31d65f7d-8f56-41eb-ab8b-48b826c03d90/file', 'properties': {}}, 'image_service': }' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:57 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e991cc00-540a-4d9c-a6b8-4caace741e6b tempest-VolumeImageDependencyTests-1643693718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5442094f-764c-4321-bfba-314eb68a4de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:54:57 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-e991cc00-540a-4d9c-a6b8-4caace741e6b tempest-VolumeImageDependencyTests-1643693718 None] Volume volume-b355aa32-0925-461a-adba-ac53f0952a33 (b355aa32-0925-461a-adba-ac53f0952a33): created successfully Sep 25 11:54:57 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e991cc00-540a-4d9c-a6b8-4caace741e6b tempest-VolumeImageDependencyTests-1643693718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5442094f-764c-4321-bfba-314eb68a4de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:54:57 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e991cc00-540a-4d9c-a6b8-4caace741e6b tempest-VolumeImageDependencyTests-1643693718 None] Flow 'volume_create_manager' (d70f0c78-4624-47e4-b15e-c733bae882c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:54:57 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-e991cc00-540a-4d9c-a6b8-4caace741e6b tempest-VolumeImageDependencyTests-1643693718 None] Created volume successfully. Sep 25 11:54:57 devstack sudo[101267]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:57 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-704ca7b1-c963-465b-84a5-713627c0551d tempest-VolumesDeleteCascade-1448271507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d" returned: 0 in 0.699s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:57 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-704ca7b1-c963-465b-84a5-713627c0551d tempest-VolumesDeleteCascade-1448271507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d.b14dc914-06e8-4357-8bb2-9f3859b3ffc7 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:57 devstack sudo[101286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d.b14dc914-06e8-4357-8bb2-9f3859b3ffc7 Sep 25 11:54:57 devstack sudo[101286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:58 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-85b96480-17e6-49fa-9946-a0bf751f5491 tempest-VolumeImageDependencyTests-1643693718 None] Acquiring lock "cinder-b355aa32-0925-461a-adba-ac53f0952a33-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:58 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-85b96480-17e6-49fa-9946-a0bf751f5491 tempest-VolumeImageDependencyTests-1643693718 None] Lock "cinder-b355aa32-0925-461a-adba-ac53f0952a33-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:58 devstack sudo[101277]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:58 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-85b96480-17e6-49fa-9946-a0bf751f5491 tempest-VolumeImageDependencyTests-1643693718 None] Acquiring lock "cinder-quobyte-b355aa32-0925-461a-adba-ac53f0952a33" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:58 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-37e05f39-0935-4078-92cd-01a683e9b09a tempest-TestShelveInstance-101884204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-afefdf65-66cb-4acc-a2b7-9a1b2e0f8d13 1073741824" returned: 0 in 0.788s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:58 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-85b96480-17e6-49fa-9946-a0bf751f5491 tempest-VolumeImageDependencyTests-1643693718 None] Lock "cinder-quobyte-b355aa32-0925-461a-adba-ac53f0952a33" acquired by "delete_volume" :: waited 0.040s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:58 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[83fa94bd-3f64-4deb-82fc-20a97351bc83]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:54:58 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-85b96480-17e6-49fa-9946-a0bf751f5491 tempest-VolumeImageDependencyTests-1643693718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b355aa32-0925-461a-adba-ac53f0952a33 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:58 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-37e05f39-0935-4078-92cd-01a683e9b09a tempest-TestShelveInstance-101884204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-afefdf65-66cb-4acc-a2b7-9a1b2e0f8d13 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:58 devstack sudo[101294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-afefdf65-66cb-4acc-a2b7-9a1b2e0f8d13 Sep 25 11:54:58 devstack sudo[101294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:58 devstack sudo[101286]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:58 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-704ca7b1-c963-465b-84a5-713627c0551d tempest-VolumesDeleteCascade-1448271507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d.b14dc914-06e8-4357-8bb2-9f3859b3ffc7" returned: 0 in 0.537s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:58 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-704ca7b1-c963-465b-84a5-713627c0551d tempest-VolumesDeleteCascade-1448271507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d.b14dc914-06e8-4357-8bb2-9f3859b3ffc7 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:58 devstack sudo[101296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d.b14dc914-06e8-4357-8bb2-9f3859b3ffc7 Sep 25 11:54:58 devstack sudo[101296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:58 devstack sudo[101292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b355aa32-0925-461a-adba-ac53f0952a33 Sep 25 11:54:58 devstack sudo[101292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:58 devstack sudo[101294]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:58 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-37e05f39-0935-4078-92cd-01a683e9b09a tempest-TestShelveInstance-101884204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-afefdf65-66cb-4acc-a2b7-9a1b2e0f8d13" returned: 0 in 0.308s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:58 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-37e05f39-0935-4078-92cd-01a683e9b09a tempest-TestShelveInstance-101884204 None] <== create_volume: return (1203ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:54:58 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-37e05f39-0935-4078-92cd-01a683e9b09a tempest-TestShelveInstance-101884204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.206s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:58 devstack cinder-volume[86984]: DEBUG cinder.volume.volume_utils [None req-37e05f39-0935-4078-92cd-01a683e9b09a tempest-TestShelveInstance-101884204 None] Attempting download of d93b0aa8-e297-4aff-bb90-fe80872f8b63 ((None, [{'url': 'file:///opt/stack/data/glance/images/d93b0aa8-e297-4aff-bb90-fe80872f8b63', 'metadata': {}}])) to volume afefdf65-66cb-4acc-a2b7-9a1b2e0f8d13. {{(pid=86984) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 11:54:58 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3346fa6-35f1-4836-8062-1002bcb313b0]: (4, 'raw') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:54:58 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-37e05f39-0935-4078-92cd-01a683e9b09a tempest-TestShelveInstance-101884204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d93b0aa8-e297-4aff-bb90-fe80872f8b63_g_559ojx {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:58 devstack sudo[101296]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:58 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-704ca7b1-c963-465b-84a5-713627c0551d tempest-VolumesDeleteCascade-1448271507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d.b14dc914-06e8-4357-8bb2-9f3859b3ffc7" returned: 0 in 0.357s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:58 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-704ca7b1-c963-465b-84a5-713627c0551d tempest-VolumesDeleteCascade-1448271507 None] Lock "cinder-quobyte-b14dc914-06e8-4357-8bb2-9f3859b3ffc7" released by "_delete_snapshot" :: held 2.336s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:58 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-704ca7b1-c963-465b-84a5-713627c0551d tempest-VolumesDeleteCascade-1448271507 None] Lock "cinder-quobyte-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d" released by "delete_snapshot" :: held 2.371s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:58 devstack sudo[101292]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:58 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-85b96480-17e6-49fa-9946-a0bf751f5491 tempest-VolumeImageDependencyTests-1643693718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b355aa32-0925-461a-adba-ac53f0952a33" returned: 0 in 0.577s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:58 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-85b96480-17e6-49fa-9946-a0bf751f5491 tempest-VolumeImageDependencyTests-1643693718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b355aa32-0925-461a-adba-ac53f0952a33 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:58 devstack sudo[101303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d93b0aa8-e297-4aff-bb90-fe80872f8b63_g_559ojx Sep 25 11:54:58 devstack sudo[101303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:58 devstack sudo[101305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b355aa32-0925-461a-adba-ac53f0952a33 Sep 25 11:54:58 devstack sudo[101305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:58 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-704ca7b1-c963-465b-84a5-713627c0551d tempest-VolumesDeleteCascade-1448271507 None] Created reservations ['7f829788-e544-465a-a42d-28249a797a80', '05abb356-99f6-45bb-9640-5ad606433938', '636c819f-67fe-44d7-a2c6-841c1a6c395b', 'bf34d92c-42d2-41b8-9bdb-960c93635995'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:54:59 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-704ca7b1-c963-465b-84a5-713627c0551d tempest-VolumesDeleteCascade-1448271507 None] Delete snapshot completed successfully. Sep 25 11:54:59 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-704ca7b1-c963-465b-84a5-713627c0551d tempest-VolumesDeleteCascade-1448271507 None] Lock "cinder-b14dc914-06e8-4357-8bb2-9f3859b3ffc7-delete_snapshot" released by "delete_snapshot" :: held 2.662s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:59 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-704ca7b1-c963-465b-84a5-713627c0551d tempest-VolumesDeleteCascade-1448271507 None] Snapshots deleted, issuing volume delete {{(pid=86984) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 25 11:54:59 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-704ca7b1-c963-465b-84a5-713627c0551d tempest-VolumesDeleteCascade-1448271507 None] Acquiring lock "cinder-quobyte-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:54:59 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-704ca7b1-c963-465b-84a5-713627c0551d tempest-VolumesDeleteCascade-1448271507 None] Lock "cinder-quobyte-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d" acquired by "delete_volume" :: waited 0.029s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:54:59 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe363851-dc81-4546-b0b5-16237e2743c0]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:54:59 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-704ca7b1-c963-465b-84a5-713627c0551d tempest-VolumesDeleteCascade-1448271507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:59 devstack sudo[101303]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:59 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-37e05f39-0935-4078-92cd-01a683e9b09a tempest-TestShelveInstance-101884204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d93b0aa8-e297-4aff-bb90-fe80872f8b63_g_559ojx" returned: 0 in 0.455s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:59 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-37e05f39-0935-4078-92cd-01a683e9b09a tempest-TestShelveInstance-101884204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d93b0aa8-e297-4aff-bb90-fe80872f8b63_g_559ojx {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:59 devstack sudo[101305]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:59 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-85b96480-17e6-49fa-9946-a0bf751f5491 tempest-VolumeImageDependencyTests-1643693718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b355aa32-0925-461a-adba-ac53f0952a33" returned: 0 in 0.421s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:59 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-85b96480-17e6-49fa-9946-a0bf751f5491 tempest-VolumeImageDependencyTests-1643693718 None] Lock "cinder-quobyte-b355aa32-0925-461a-adba-ac53f0952a33" released by "delete_volume" :: held 1.075s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:54:59 devstack sudo[101311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d Sep 25 11:54:59 devstack sudo[101311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:59 devstack sudo[101312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d93b0aa8-e297-4aff-bb90-fe80872f8b63_g_559ojx Sep 25 11:54:59 devstack sudo[101312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:59 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-85b96480-17e6-49fa-9946-a0bf751f5491 tempest-VolumeImageDependencyTests-1643693718 None] Created reservations ['1e5c219f-e66a-41e9-ab18-eb9a3b3f788e', '85c3288b-eac0-4fc7-be0e-79e6631156d3', 'afed6568-5591-4286-bab9-a1884a224a3f', 'e854e2bd-c5ce-4ad8-a1d5-7ed2cb6e2451'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:54:59 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-85b96480-17e6-49fa-9946-a0bf751f5491 tempest-VolumeImageDependencyTests-1643693718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:54:59 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-85b96480-17e6-49fa-9946-a0bf751f5491 tempest-VolumeImageDependencyTests-1643693718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:54:59 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-85b96480-17e6-49fa-9946-a0bf751f5491 tempest-VolumeImageDependencyTests-1643693718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:54:59 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-85b96480-17e6-49fa-9946-a0bf751f5491 tempest-VolumeImageDependencyTests-1643693718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:54:59 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-85b96480-17e6-49fa-9946-a0bf751f5491 tempest-VolumeImageDependencyTests-1643693718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:54:59 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-85b96480-17e6-49fa-9946-a0bf751f5491 tempest-VolumeImageDependencyTests-1643693718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:59 devstack sudo[101315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:54:59 devstack sudo[101315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:59 devstack sudo[101312]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:59 devstack sudo[101311]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:59 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-37e05f39-0935-4078-92cd-01a683e9b09a tempest-TestShelveInstance-101884204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d93b0aa8-e297-4aff-bb90-fe80872f8b63_g_559ojx" returned: 1 in 0.583s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:59 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-37e05f39-0935-4078-92cd-01a683e9b09a tempest-TestShelveInstance-101884204 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d93b0aa8-e297-4aff-bb90-fe80872f8b63_g_559ojx' failed. Not Retrying. {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 11:54:59 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b760d54-ca43-4c48-819d-bb02d822092b]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:54:59 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-37e05f39-0935-4078-92cd-01a683e9b09a tempest-TestShelveInstance-101884204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d93b0aa8-e297-4aff-bb90-fe80872f8b63_sc32zvlxdevstack@QuobyteHD {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:59 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-704ca7b1-c963-465b-84a5-713627c0551d tempest-VolumesDeleteCascade-1448271507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d" returned: 0 in 0.631s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:59 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-704ca7b1-c963-465b-84a5-713627c0551d tempest-VolumesDeleteCascade-1448271507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:54:59 devstack sudo[101323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d Sep 25 11:54:59 devstack sudo[101323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:59 devstack sudo[101315]: pam_unix(sudo:session): session closed for user root Sep 25 11:54:59 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-85b96480-17e6-49fa-9946-a0bf751f5491 tempest-VolumeImageDependencyTests-1643693718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.317s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:54:59 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-85b96480-17e6-49fa-9946-a0bf751f5491 tempest-VolumeImageDependencyTests-1643693718 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:54:59 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-85b96480-17e6-49fa-9946-a0bf751f5491 tempest-VolumeImageDependencyTests-1643693718 None] Deleted volume successfully. Sep 25 11:54:59 devstack sudo[101322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d93b0aa8-e297-4aff-bb90-fe80872f8b63_sc32zvlxdevstack@QuobyteHD Sep 25 11:54:59 devstack sudo[101322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:54:59 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-85b96480-17e6-49fa-9946-a0bf751f5491 tempest-VolumeImageDependencyTests-1643693718 None] Lock "cinder-b355aa32-0925-461a-adba-ac53f0952a33-delete_volume" released by "delete_volume" :: held 1.830s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:55:00 devstack sudo[101323]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:00 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-704ca7b1-c963-465b-84a5-713627c0551d tempest-VolumesDeleteCascade-1448271507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d" returned: 0 in 0.283s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:00 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-704ca7b1-c963-465b-84a5-713627c0551d tempest-VolumesDeleteCascade-1448271507 None] Lock "cinder-quobyte-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d" released by "delete_volume" :: held 1.002s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:55:00 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-704ca7b1-c963-465b-84a5-713627c0551d tempest-VolumesDeleteCascade-1448271507 None] Created reservations ['b883a4a5-10f7-4d7a-b1bf-98991c5728b2', '97bbd935-877e-4b7f-a375-d55905c11b7a', '25c22bbc-0e70-489f-a879-5ca77f2557a6', '25ba91af-167a-4639-9798-99840743ec7c'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:55:00 devstack sudo[101322]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:00 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-37e05f39-0935-4078-92cd-01a683e9b09a tempest-TestShelveInstance-101884204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d93b0aa8-e297-4aff-bb90-fe80872f8b63_sc32zvlxdevstack@QuobyteHD" returned: 0 in 0.388s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:00 devstack cinder-volume[86984]: DEBUG cinder.image.image_utils [None req-37e05f39-0935-4078-92cd-01a683e9b09a tempest-TestShelveInstance-101884204 None] d93b0aa8-e297-4aff-bb90-fe80872f8b63 was qcow2, converting to qcow2 {{(pid=86984) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 11:55:00 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-37e05f39-0935-4078-92cd-01a683e9b09a tempest-TestShelveInstance-101884204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d93b0aa8-e297-4aff-bb90-fe80872f8b63_sc32zvlxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-afefdf65-66cb-4acc-a2b7-9a1b2e0f8d13 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:00 devstack sudo[101331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d93b0aa8-e297-4aff-bb90-fe80872f8b63_sc32zvlxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-afefdf65-66cb-4acc-a2b7-9a1b2e0f8d13 Sep 25 11:55:00 devstack sudo[101331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:00 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-704ca7b1-c963-465b-84a5-713627c0551d tempest-VolumesDeleteCascade-1448271507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:55:00 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-704ca7b1-c963-465b-84a5-713627c0551d tempest-VolumesDeleteCascade-1448271507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:55:00 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-704ca7b1-c963-465b-84a5-713627c0551d tempest-VolumesDeleteCascade-1448271507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:55:00 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-704ca7b1-c963-465b-84a5-713627c0551d tempest-VolumesDeleteCascade-1448271507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:55:00 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-704ca7b1-c963-465b-84a5-713627c0551d tempest-VolumesDeleteCascade-1448271507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:55:00 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-704ca7b1-c963-465b-84a5-713627c0551d tempest-VolumesDeleteCascade-1448271507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:00 devstack sudo[101333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:55:00 devstack sudo[101333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:00 devstack sudo[101333]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:00 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-704ca7b1-c963-465b-84a5-713627c0551d tempest-VolumesDeleteCascade-1448271507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.534s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:00 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-704ca7b1-c963-465b-84a5-713627c0551d tempest-VolumesDeleteCascade-1448271507 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:55:00 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-704ca7b1-c963-465b-84a5-713627c0551d tempest-VolumesDeleteCascade-1448271507 None] Deleted volume successfully. Sep 25 11:55:00 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-704ca7b1-c963-465b-84a5-713627c0551d tempest-VolumesDeleteCascade-1448271507 None] Lock "cinder-1a8ff2e4-3674-4ef2-8c80-40fa7748e34d-delete_volume" released by "delete_volume" :: held 9.891s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:55:02 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-ade8c65f-9ee5-4359-9366-e26cfe49ca47 tempest-VolumesDeleteCascade-1448271507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:55:02 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ade8c65f-9ee5-4359-9366-e26cfe49ca47 tempest-VolumesDeleteCascade-1448271507 None] Flow 'volume_create_manager' (156cdb23-3aee-4ec7-b2f3-e0ccded3aeda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:55:02 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ade8c65f-9ee5-4359-9366-e26cfe49ca47 tempest-VolumesDeleteCascade-1448271507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a33cd41-bd94-4aad-9644-be9babb9fa48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:03 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ade8c65f-9ee5-4359-9366-e26cfe49ca47 tempest-VolumesDeleteCascade-1448271507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a33cd41-bd94-4aad-9644-be9babb9fa48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:55:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-250520824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fba7e9d-3997-4d91-9bbc-ec16e9536a98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b041d48844854458800f13297c9facdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:55:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:55:03Z,use_quota=True,user_id='f42a3eec66a945cca809837b82cda048',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:03 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ade8c65f-9ee5-4359-9366-e26cfe49ca47 tempest-VolumesDeleteCascade-1448271507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19a7fa27-2964-4c8b-acdb-3300628be0a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:03 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ade8c65f-9ee5-4359-9366-e26cfe49ca47 tempest-VolumesDeleteCascade-1448271507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19a7fa27-2964-4c8b-acdb-3300628be0a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:03 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ade8c65f-9ee5-4359-9366-e26cfe49ca47 tempest-VolumesDeleteCascade-1448271507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8c5ea79-772a-42df-8026-9f0ddccb61fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:03 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ade8c65f-9ee5-4359-9366-e26cfe49ca47 tempest-VolumesDeleteCascade-1448271507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8c5ea79-772a-42df-8026-9f0ddccb61fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fba7e9d-3997-4d91-9bbc-ec16e9536a98', 'volume_name': 'volume-7fba7e9d-3997-4d91-9bbc-ec16e9536a98', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:03 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ade8c65f-9ee5-4359-9366-e26cfe49ca47 tempest-VolumesDeleteCascade-1448271507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccc3b37d-ef9e-4b8a-a0b3-da178632bae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:03 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ade8c65f-9ee5-4359-9366-e26cfe49ca47 tempest-VolumesDeleteCascade-1448271507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccc3b37d-ef9e-4b8a-a0b3-da178632bae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:03 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ade8c65f-9ee5-4359-9366-e26cfe49ca47 tempest-VolumesDeleteCascade-1448271507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cf42d4e-e303-4f94-a5c5-d42a2bb0a160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:03 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-ade8c65f-9ee5-4359-9366-e26cfe49ca47 tempest-VolumesDeleteCascade-1448271507 None] Volume 7fba7e9d-3997-4d91-9bbc-ec16e9536a98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fba7e9d-3997-4d91-9bbc-ec16e9536a98', 'volume_size': 1} Sep 25 11:55:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-ade8c65f-9ee5-4359-9366-e26cfe49ca47 tempest-VolumesDeleteCascade-1448271507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:55:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-ade8c65f-9ee5-4359-9366-e26cfe49ca47 tempest-VolumesDeleteCascade-1448271507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:55:03 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-ade8c65f-9ee5-4359-9366-e26cfe49ca47 tempest-VolumesDeleteCascade-1448271507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:55:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-250520824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fba7e9d-3997-4d91-9bbc-ec16e9536a98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b041d48844854458800f13297c9facdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:55:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:55:03Z,use_quota=True,user_id='f42a3eec66a945cca809837b82cda048',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:55:03 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-ade8c65f-9ee5-4359-9366-e26cfe49ca47 tempest-VolumesDeleteCascade-1448271507 None] Creating volume 7fba7e9d-3997-4d91-9bbc-ec16e9536a98 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:55:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-ade8c65f-9ee5-4359-9366-e26cfe49ca47 tempest-VolumesDeleteCascade-1448271507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:55:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-ade8c65f-9ee5-4359-9366-e26cfe49ca47 tempest-VolumesDeleteCascade-1448271507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:55:03 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-ade8c65f-9ee5-4359-9366-e26cfe49ca47 tempest-VolumesDeleteCascade-1448271507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:55:03 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-ade8c65f-9ee5-4359-9366-e26cfe49ca47 tempest-VolumesDeleteCascade-1448271507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:55:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-ade8c65f-9ee5-4359-9366-e26cfe49ca47 tempest-VolumesDeleteCascade-1448271507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:55:03 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-ade8c65f-9ee5-4359-9366-e26cfe49ca47 tempest-VolumesDeleteCascade-1448271507 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:55:03 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-ade8c65f-9ee5-4359-9366-e26cfe49ca47 tempest-VolumesDeleteCascade-1448271507 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:55:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ade8c65f-9ee5-4359-9366-e26cfe49ca47 tempest-VolumesDeleteCascade-1448271507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7fba7e9d-3997-4d91-9bbc-ec16e9536a98 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:03 devstack sudo[101346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7fba7e9d-3997-4d91-9bbc-ec16e9536a98 1073741824 Sep 25 11:55:03 devstack sudo[101346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:03 devstack sudo[101331]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-37e05f39-0935-4078-92cd-01a683e9b09a tempest-TestShelveInstance-101884204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d93b0aa8-e297-4aff-bb90-fe80872f8b63_sc32zvlxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-afefdf65-66cb-4acc-a2b7-9a1b2e0f8d13" returned: 0 in 3.103s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:03 devstack cinder-volume[86984]: DEBUG cinder.image.image_utils [None req-37e05f39-0935-4078-92cd-01a683e9b09a tempest-TestShelveInstance-101884204 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d93b0aa8-e297-4aff-bb90-fe80872f8b63_sc32zvlxdevstack@QuobyteHD, size 112.00 MB, duration 3.10 sec, destination /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-afefdf65-66cb-4acc-a2b7-9a1b2e0f8d13 {{(pid=86984) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 11:55:03 devstack cinder-volume[86984]: INFO cinder.image.image_utils [None req-37e05f39-0935-4078-92cd-01a683e9b09a tempest-TestShelveInstance-101884204 None] Converted 112.00 MB image at 36.07 MB/s Sep 25 11:55:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-37e05f39-0935-4078-92cd-01a683e9b09a tempest-TestShelveInstance-101884204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-afefdf65-66cb-4acc-a2b7-9a1b2e0f8d13 1G {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:03 devstack sudo[101348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-afefdf65-66cb-4acc-a2b7-9a1b2e0f8d13 1G Sep 25 11:55:03 devstack sudo[101348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:03 devstack sudo[101348]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-37e05f39-0935-4078-92cd-01a683e9b09a tempest-TestShelveInstance-101884204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-afefdf65-66cb-4acc-a2b7-9a1b2e0f8d13 1G" returned: 0 in 0.541s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:03 devstack cinder-volume[86984]: DEBUG cinder.volume.volume_utils [None req-37e05f39-0935-4078-92cd-01a683e9b09a tempest-TestShelveInstance-101884204 None] Downloaded image d93b0aa8-e297-4aff-bb90-fe80872f8b63 ((None, [{'url': 'file:///opt/stack/data/glance/images/d93b0aa8-e297-4aff-bb90-fe80872f8b63', 'metadata': {}}])) to volume afefdf65-66cb-4acc-a2b7-9a1b2e0f8d13 successfully. {{(pid=86984) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 11:55:03 devstack sudo[101346]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:03 devstack cinder-volume[86984]: DEBUG cinder.image.image_utils [None req-37e05f39-0935-4078-92cd-01a683e9b09a tempest-TestShelveInstance-101884204 None] Temporary image d93b0aa8-e297-4aff-bb90-fe80872f8b63 for user e9a4ea1cfdbb4ef68e12ba81491a492f is deleted. {{(pid=86984) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 11:55:03 devstack cinder-volume[86984]: DEBUG cinder.volume.volume_utils [None req-37e05f39-0935-4078-92cd-01a683e9b09a tempest-TestShelveInstance-101884204 None] Marking volume afefdf65-66cb-4acc-a2b7-9a1b2e0f8d13 as bootable. {{(pid=86984) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 11:55:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ade8c65f-9ee5-4359-9366-e26cfe49ca47 tempest-VolumesDeleteCascade-1448271507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7fba7e9d-3997-4d91-9bbc-ec16e9536a98 1073741824" returned: 0 in 0.794s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:03 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-37e05f39-0935-4078-92cd-01a683e9b09a tempest-TestShelveInstance-101884204 None] Copying metadata from image d93b0aa8-e297-4aff-bb90-fe80872f8b63 to afefdf65-66cb-4acc-a2b7-9a1b2e0f8d13. {{(pid=86984) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 11:55:03 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-37e05f39-0935-4078-92cd-01a683e9b09a tempest-TestShelveInstance-101884204 None] Creating volume glance metadata for volume afefdf65-66cb-4acc-a2b7-9a1b2e0f8d13 backed by image d93b0aa8-e297-4aff-bb90-fe80872f8b63 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd93b0aa8-e297-4aff-bb90-fe80872f8b63', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86984) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 11:55:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ade8c65f-9ee5-4359-9366-e26cfe49ca47 tempest-VolumesDeleteCascade-1448271507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7fba7e9d-3997-4d91-9bbc-ec16e9536a98 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:04 devstack sudo[101358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7fba7e9d-3997-4d91-9bbc-ec16e9536a98 Sep 25 11:55:04 devstack sudo[101358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:04 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-37e05f39-0935-4078-92cd-01a683e9b09a tempest-TestShelveInstance-101884204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9b8f17d-b063-4a1a-a975-66956208af3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afefdf65-66cb-4acc-a2b7-9a1b2e0f8d13', 'volume_size': 1, 'image_id': 'd93b0aa8-e297-4aff-bb90-fe80872f8b63', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d93b0aa8-e297-4aff-bb90-fe80872f8b63', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a57d184bdf174982a6b60117d6d4a5b4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd93b0aa8-e297-4aff-bb90-fe80872f8b63', 'created_at': datetime.datetime(2026, 9, 25, 9, 31, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 31, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d93b0aa8-e297-4aff-bb90-fe80872f8b63/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:04 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-37e05f39-0935-4078-92cd-01a683e9b09a tempest-TestShelveInstance-101884204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c8c8cbd-12ca-4819-a39c-b25e7e924463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:04 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-37e05f39-0935-4078-92cd-01a683e9b09a tempest-TestShelveInstance-101884204 None] Volume volume-afefdf65-66cb-4acc-a2b7-9a1b2e0f8d13 (afefdf65-66cb-4acc-a2b7-9a1b2e0f8d13): created successfully Sep 25 11:55:04 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-37e05f39-0935-4078-92cd-01a683e9b09a tempest-TestShelveInstance-101884204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c8c8cbd-12ca-4819-a39c-b25e7e924463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:04 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-37e05f39-0935-4078-92cd-01a683e9b09a tempest-TestShelveInstance-101884204 None] Flow 'volume_create_manager' (eb37b4bc-f4c4-4a6f-946c-9b457abc59a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:55:04 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-37e05f39-0935-4078-92cd-01a683e9b09a tempest-TestShelveInstance-101884204 None] Created volume successfully. Sep 25 11:55:04 devstack sudo[101358]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:04 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ade8c65f-9ee5-4359-9366-e26cfe49ca47 tempest-VolumesDeleteCascade-1448271507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7fba7e9d-3997-4d91-9bbc-ec16e9536a98" returned: 0 in 0.337s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:04 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-ade8c65f-9ee5-4359-9366-e26cfe49ca47 tempest-VolumesDeleteCascade-1448271507 None] <== create_volume: return (1242ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:55:04 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-ade8c65f-9ee5-4359-9366-e26cfe49ca47 tempest-VolumesDeleteCascade-1448271507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.245s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:55:04 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ade8c65f-9ee5-4359-9366-e26cfe49ca47 tempest-VolumesDeleteCascade-1448271507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cf42d4e-e303-4f94-a5c5-d42a2bb0a160) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fba7e9d-3997-4d91-9bbc-ec16e9536a98', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:04 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ade8c65f-9ee5-4359-9366-e26cfe49ca47 tempest-VolumesDeleteCascade-1448271507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adb78a6b-b230-48ff-b167-c6fe2d325481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:04 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-ade8c65f-9ee5-4359-9366-e26cfe49ca47 tempest-VolumesDeleteCascade-1448271507 None] Volume volume-7fba7e9d-3997-4d91-9bbc-ec16e9536a98 (7fba7e9d-3997-4d91-9bbc-ec16e9536a98): created successfully Sep 25 11:55:04 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ade8c65f-9ee5-4359-9366-e26cfe49ca47 tempest-VolumesDeleteCascade-1448271507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adb78a6b-b230-48ff-b167-c6fe2d325481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:04 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ade8c65f-9ee5-4359-9366-e26cfe49ca47 tempest-VolumesDeleteCascade-1448271507 None] Flow 'volume_create_manager' (156cdb23-3aee-4ec7-b2f3-e0ccded3aeda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:55:04 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-ade8c65f-9ee5-4359-9366-e26cfe49ca47 tempest-VolumesDeleteCascade-1448271507 None] Created volume successfully. Sep 25 11:55:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-1f9c60f9-5a0d-4614-bcb5-91ef0c222aaf tempest-VolumesDeleteCascade-1448271507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:55:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-1f9c60f9-5a0d-4614-bcb5-91ef0c222aaf tempest-VolumesDeleteCascade-1448271507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:55:05 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-1f9c60f9-5a0d-4614-bcb5-91ef0c222aaf tempest-VolumesDeleteCascade-1448271507 None] Creating offline snapshot 61837169-1345-436d-8a82-a45f183e8e46 of volume 7fba7e9d-3997-4d91-9bbc-ec16e9536a98 {{(pid=86984) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:55:05 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[8918c005-31bd-484b-b6d7-48eadb9d9ff9]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:55:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-1f9c60f9-5a0d-4614-bcb5-91ef0c222aaf tempest-VolumesDeleteCascade-1448271507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7fba7e9d-3997-4d91-9bbc-ec16e9536a98 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:05 devstack sudo[101476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7fba7e9d-3997-4d91-9bbc-ec16e9536a98 Sep 25 11:55:05 devstack sudo[101476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:06 devstack sudo[101476]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-1f9c60f9-5a0d-4614-bcb5-91ef0c222aaf tempest-VolumesDeleteCascade-1448271507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7fba7e9d-3997-4d91-9bbc-ec16e9536a98" returned: 0 in 0.600s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-1f9c60f9-5a0d-4614-bcb5-91ef0c222aaf tempest-VolumesDeleteCascade-1448271507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7fba7e9d-3997-4d91-9bbc-ec16e9536a98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7fba7e9d-3997-4d91-9bbc-ec16e9536a98.61837169-1345-436d-8a82-a45f183e8e46 1G {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:06 devstack sudo[101686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7fba7e9d-3997-4d91-9bbc-ec16e9536a98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7fba7e9d-3997-4d91-9bbc-ec16e9536a98.61837169-1345-436d-8a82-a45f183e8e46 1G Sep 25 11:55:06 devstack sudo[101686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:06 devstack sudo[101686]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-1f9c60f9-5a0d-4614-bcb5-91ef0c222aaf tempest-VolumesDeleteCascade-1448271507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7fba7e9d-3997-4d91-9bbc-ec16e9536a98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7fba7e9d-3997-4d91-9bbc-ec16e9536a98.61837169-1345-436d-8a82-a45f183e8e46 1G" returned: 0 in 0.612s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-1f9c60f9-5a0d-4614-bcb5-91ef0c222aaf tempest-VolumesDeleteCascade-1448271507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fba7e9d-3997-4d91-9bbc-ec16e9536a98 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7fba7e9d-3997-4d91-9bbc-ec16e9536a98.61837169-1345-436d-8a82-a45f183e8e46 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:06 devstack sudo[101703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fba7e9d-3997-4d91-9bbc-ec16e9536a98 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7fba7e9d-3997-4d91-9bbc-ec16e9536a98.61837169-1345-436d-8a82-a45f183e8e46 Sep 25 11:55:06 devstack sudo[101703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:06 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-3423ad9f-9014-4573-a607-0919622da37b tempest-ProjectReaderTests-414172643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:55:07 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3423ad9f-9014-4573-a607-0919622da37b tempest-ProjectReaderTests-414172643 None] Flow 'volume_create_manager' (db63f682-86ee-4d83-8aab-1e0127650066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:55:07 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3423ad9f-9014-4573-a607-0919622da37b tempest-ProjectReaderTests-414172643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (308ac801-5c2d-4309-9088-fab03ad309ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:07 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3423ad9f-9014-4573-a607-0919622da37b tempest-ProjectReaderTests-414172643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (308ac801-5c2d-4309-9088-fab03ad309ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:55:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-666201279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=920199c6-129a-48be-85b8-ec6f8d9b56cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64b6fc75c67349d3895934fc5256c724',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:55:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:55:07Z,use_quota=True,user_id='e4592ebcc467449e9843b08ef7a5ccf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:07 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3423ad9f-9014-4573-a607-0919622da37b tempest-ProjectReaderTests-414172643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (596c1bc7-8a66-4948-ad64-90fde9abe678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:07 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3423ad9f-9014-4573-a607-0919622da37b tempest-ProjectReaderTests-414172643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (596c1bc7-8a66-4948-ad64-90fde9abe678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:07 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3423ad9f-9014-4573-a607-0919622da37b tempest-ProjectReaderTests-414172643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b6a9756-de30-4ca8-a46a-6b2b040bcd06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:07 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3423ad9f-9014-4573-a607-0919622da37b tempest-ProjectReaderTests-414172643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b6a9756-de30-4ca8-a46a-6b2b040bcd06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '920199c6-129a-48be-85b8-ec6f8d9b56cc', 'volume_name': 'volume-920199c6-129a-48be-85b8-ec6f8d9b56cc', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:07 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3423ad9f-9014-4573-a607-0919622da37b tempest-ProjectReaderTests-414172643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (618c2858-4be0-47e0-aab6-ce69aebdc2e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:07 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3423ad9f-9014-4573-a607-0919622da37b tempest-ProjectReaderTests-414172643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (618c2858-4be0-47e0-aab6-ce69aebdc2e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:07 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3423ad9f-9014-4573-a607-0919622da37b tempest-ProjectReaderTests-414172643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59b41ee7-f312-43af-ad07-ada6b0def036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:07 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-3423ad9f-9014-4573-a607-0919622da37b tempest-ProjectReaderTests-414172643 None] Volume 920199c6-129a-48be-85b8-ec6f8d9b56cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-920199c6-129a-48be-85b8-ec6f8d9b56cc', 'volume_size': 1} Sep 25 11:55:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3423ad9f-9014-4573-a607-0919622da37b tempest-ProjectReaderTests-414172643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:55:07 devstack sudo[101703]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-1f9c60f9-5a0d-4614-bcb5-91ef0c222aaf tempest-VolumesDeleteCascade-1448271507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fba7e9d-3997-4d91-9bbc-ec16e9536a98 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7fba7e9d-3997-4d91-9bbc-ec16e9536a98.61837169-1345-436d-8a82-a45f183e8e46" returned: 0 in 0.478s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:07 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-1f9c60f9-5a0d-4614-bcb5-91ef0c222aaf tempest-VolumesDeleteCascade-1448271507 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7fba7e9d-3997-4d91-9bbc-ec16e9536a98.61837169-1345-436d-8a82-a45f183e8e46 is being set with open permissions: ugo+rw Sep 25 11:55:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-1f9c60f9-5a0d-4614-bcb5-91ef0c222aaf tempest-VolumesDeleteCascade-1448271507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7fba7e9d-3997-4d91-9bbc-ec16e9536a98.61837169-1345-436d-8a82-a45f183e8e46 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:07 devstack sudo[101711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7fba7e9d-3997-4d91-9bbc-ec16e9536a98.61837169-1345-436d-8a82-a45f183e8e46 Sep 25 11:55:07 devstack sudo[101711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:07 devstack sudo[101711]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-1f9c60f9-5a0d-4614-bcb5-91ef0c222aaf tempest-VolumesDeleteCascade-1448271507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7fba7e9d-3997-4d91-9bbc-ec16e9536a98.61837169-1345-436d-8a82-a45f183e8e46" returned: 0 in 0.305s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-1f9c60f9-5a0d-4614-bcb5-91ef0c222aaf tempest-VolumesDeleteCascade-1448271507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7fba7e9d-3997-4d91-9bbc-ec16e9536a98.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:07 devstack sudo[101714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7fba7e9d-3997-4d91-9bbc-ec16e9536a98.info Sep 25 11:55:07 devstack sudo[101714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:07 devstack sudo[101714]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-1f9c60f9-5a0d-4614-bcb5-91ef0c222aaf tempest-VolumesDeleteCascade-1448271507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7fba7e9d-3997-4d91-9bbc-ec16e9536a98.info" returned: 0 in 0.332s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:07 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-1f9c60f9-5a0d-4614-bcb5-91ef0c222aaf tempest-VolumesDeleteCascade-1448271507 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7fba7e9d-3997-4d91-9bbc-ec16e9536a98.info is being set with open permissions: ugo+rw Sep 25 11:55:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-1f9c60f9-5a0d-4614-bcb5-91ef0c222aaf tempest-VolumesDeleteCascade-1448271507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7fba7e9d-3997-4d91-9bbc-ec16e9536a98.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:07 devstack sudo[101717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7fba7e9d-3997-4d91-9bbc-ec16e9536a98.info Sep 25 11:55:07 devstack sudo[101717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:08 devstack sudo[101717]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-1f9c60f9-5a0d-4614-bcb5-91ef0c222aaf tempest-VolumesDeleteCascade-1448271507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7fba7e9d-3997-4d91-9bbc-ec16e9536a98.info" returned: 0 in 0.329s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-1f9c60f9-5a0d-4614-bcb5-91ef0c222aaf tempest-VolumesDeleteCascade-1448271507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.824s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:55:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3423ad9f-9014-4573-a607-0919622da37b tempest-ProjectReaderTests-414172643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.088s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:55:08 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3423ad9f-9014-4573-a607-0919622da37b tempest-ProjectReaderTests-414172643 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:55:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-666201279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=920199c6-129a-48be-85b8-ec6f8d9b56cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64b6fc75c67349d3895934fc5256c724',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:55:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:55:07Z,use_quota=True,user_id='e4592ebcc467449e9843b08ef7a5ccf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:55:08 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-3423ad9f-9014-4573-a607-0919622da37b tempest-ProjectReaderTests-414172643 None] Creating volume 920199c6-129a-48be-85b8-ec6f8d9b56cc {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:55:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3423ad9f-9014-4573-a607-0919622da37b tempest-ProjectReaderTests-414172643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:55:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3423ad9f-9014-4573-a607-0919622da37b tempest-ProjectReaderTests-414172643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:55:08 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3423ad9f-9014-4573-a607-0919622da37b tempest-ProjectReaderTests-414172643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:55:08 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3423ad9f-9014-4573-a607-0919622da37b tempest-ProjectReaderTests-414172643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:55:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3423ad9f-9014-4573-a607-0919622da37b tempest-ProjectReaderTests-414172643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:55:08 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3423ad9f-9014-4573-a607-0919622da37b tempest-ProjectReaderTests-414172643 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:55:08 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-3423ad9f-9014-4573-a607-0919622da37b tempest-ProjectReaderTests-414172643 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:55:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3423ad9f-9014-4573-a607-0919622da37b tempest-ProjectReaderTests-414172643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-920199c6-129a-48be-85b8-ec6f8d9b56cc 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:08 devstack sudo[101720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-920199c6-129a-48be-85b8-ec6f8d9b56cc 1073741824 Sep 25 11:55:08 devstack sudo[101720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:08 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-1f9c60f9-5a0d-4614-bcb5-91ef0c222aaf tempest-VolumesDeleteCascade-1448271507 None] Create snapshot completed successfully Sep 25 11:55:09 devstack sudo[101720]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3423ad9f-9014-4573-a607-0919622da37b tempest-ProjectReaderTests-414172643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-920199c6-129a-48be-85b8-ec6f8d9b56cc 1073741824" returned: 0 in 0.898s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3423ad9f-9014-4573-a607-0919622da37b tempest-ProjectReaderTests-414172643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-920199c6-129a-48be-85b8-ec6f8d9b56cc {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:09 devstack sudo[101726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-920199c6-129a-48be-85b8-ec6f8d9b56cc Sep 25 11:55:09 devstack sudo[101726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:09 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-1db26da4-6fad-4ac2-a1af-77b651d93f66 tempest-VolumesDeleteCascade-1448271507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:55:09 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-1db26da4-6fad-4ac2-a1af-77b651d93f66 tempest-VolumesDeleteCascade-1448271507 None] Flow 'volume_create_manager' (f8b3c020-e01f-46fe-a485-614682f5a358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:55:09 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-1db26da4-6fad-4ac2-a1af-77b651d93f66 tempest-VolumesDeleteCascade-1448271507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cd0ed89-1d01-4051-9ec1-edfe9ab68bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:09 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-1db26da4-6fad-4ac2-a1af-77b651d93f66 tempest-VolumesDeleteCascade-1448271507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cd0ed89-1d01-4051-9ec1-edfe9ab68bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:55:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-475377320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1370e49f-94a5-47d7-92fe-0a96964c1386,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b041d48844854458800f13297c9facdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:55:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=61837169-1345-436d-8a82-a45f183e8e46,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:55:09Z,use_quota=True,user_id='f42a3eec66a945cca809837b82cda048',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:09 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-1db26da4-6fad-4ac2-a1af-77b651d93f66 tempest-VolumesDeleteCascade-1448271507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a7637ac-7873-4186-a4f0-1fe1a213f348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:09 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-1db26da4-6fad-4ac2-a1af-77b651d93f66 tempest-VolumesDeleteCascade-1448271507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a7637ac-7873-4186-a4f0-1fe1a213f348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:09 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-1db26da4-6fad-4ac2-a1af-77b651d93f66 tempest-VolumesDeleteCascade-1448271507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c4c6159-a401-4679-9264-3eb304f31976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:09 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-1db26da4-6fad-4ac2-a1af-77b651d93f66 tempest-VolumesDeleteCascade-1448271507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c4c6159-a401-4679-9264-3eb304f31976) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1370e49f-94a5-47d7-92fe-0a96964c1386', 'volume_name': 'volume-1370e49f-94a5-47d7-92fe-0a96964c1386', 'volume_size': 1, 'snapshot_id': '61837169-1345-436d-8a82-a45f183e8e46'}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:09 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-1db26da4-6fad-4ac2-a1af-77b651d93f66 tempest-VolumesDeleteCascade-1448271507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92e25a96-dc90-49d3-b4d2-6bdcb9457365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:09 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-1db26da4-6fad-4ac2-a1af-77b651d93f66 tempest-VolumesDeleteCascade-1448271507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92e25a96-dc90-49d3-b4d2-6bdcb9457365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:09 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-1db26da4-6fad-4ac2-a1af-77b651d93f66 tempest-VolumesDeleteCascade-1448271507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0a5d85c-1242-44e8-96fc-7f62821a27c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:09 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-1db26da4-6fad-4ac2-a1af-77b651d93f66 tempest-VolumesDeleteCascade-1448271507 None] Volume 1370e49f-94a5-47d7-92fe-0a96964c1386: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1370e49f-94a5-47d7-92fe-0a96964c1386', 'volume_size': 1, 'snapshot_id': '61837169-1345-436d-8a82-a45f183e8e46'} Sep 25 11:55:09 devstack sudo[101726]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-1db26da4-6fad-4ac2-a1af-77b651d93f66 tempest-VolumesDeleteCascade-1448271507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:55:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3423ad9f-9014-4573-a607-0919622da37b tempest-ProjectReaderTests-414172643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-920199c6-129a-48be-85b8-ec6f8d9b56cc" returned: 0 in 0.436s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:09 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3423ad9f-9014-4573-a607-0919622da37b tempest-ProjectReaderTests-414172643 None] <== create_volume: return (1415ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:55:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3423ad9f-9014-4573-a607-0919622da37b tempest-ProjectReaderTests-414172643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.420s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:55:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-1db26da4-6fad-4ac2-a1af-77b651d93f66 tempest-VolumesDeleteCascade-1448271507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.010s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:55:09 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-1db26da4-6fad-4ac2-a1af-77b651d93f66 tempest-VolumesDeleteCascade-1448271507 None] Acquiring lock "cinder-quobyte-61837169-1345-436d-8a82-a45f183e8e46-1370e49f-94a5-47d7-92fe-0a96964c1386" by "_create_volume_from_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:55:09 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-1db26da4-6fad-4ac2-a1af-77b651d93f66 tempest-VolumesDeleteCascade-1448271507 None] Lock "cinder-quobyte-61837169-1345-436d-8a82-a45f183e8e46-1370e49f-94a5-47d7-92fe-0a96964c1386" acquired by "_create_volume_from_snapshot" :: waited 0.037s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:55:09 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-1db26da4-6fad-4ac2-a1af-77b651d93f66 tempest-VolumesDeleteCascade-1448271507 None] Creating volume 1370e49f-94a5-47d7-92fe-0a96964c1386 from snapshot 61837169-1345-436d-8a82-a45f183e8e46 {{(pid=86984) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 11:55:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-1db26da4-6fad-4ac2-a1af-77b651d93f66 tempest-VolumesDeleteCascade-1448271507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:55:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-1db26da4-6fad-4ac2-a1af-77b651d93f66 tempest-VolumesDeleteCascade-1448271507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:55:09 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-1db26da4-6fad-4ac2-a1af-77b651d93f66 tempest-VolumesDeleteCascade-1448271507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:55:09 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-1db26da4-6fad-4ac2-a1af-77b651d93f66 tempest-VolumesDeleteCascade-1448271507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:55:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-1db26da4-6fad-4ac2-a1af-77b651d93f66 tempest-VolumesDeleteCascade-1448271507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:55:09 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-1db26da4-6fad-4ac2-a1af-77b651d93f66 tempest-VolumesDeleteCascade-1448271507 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:55:09 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-1db26da4-6fad-4ac2-a1af-77b651d93f66 tempest-VolumesDeleteCascade-1448271507 None] Acquiring lock "cinder-quobyte-1370e49f-94a5-47d7-92fe-0a96964c1386" by "_copy_volume_from_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:55:09 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3423ad9f-9014-4573-a607-0919622da37b tempest-ProjectReaderTests-414172643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59b41ee7-f312-43af-ad07-ada6b0def036) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-920199c6-129a-48be-85b8-ec6f8d9b56cc', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:09 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3423ad9f-9014-4573-a607-0919622da37b tempest-ProjectReaderTests-414172643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea00dc33-3ccb-4b7b-91a4-e4bbbb681f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:09 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-1db26da4-6fad-4ac2-a1af-77b651d93f66 tempest-VolumesDeleteCascade-1448271507 None] Lock "cinder-quobyte-1370e49f-94a5-47d7-92fe-0a96964c1386" acquired by "_copy_volume_from_snapshot" :: waited 0.063s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:55:09 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-1db26da4-6fad-4ac2-a1af-77b651d93f66 tempest-VolumesDeleteCascade-1448271507 None] snapshot: 61837169-1345-436d-8a82-a45f183e8e46, volume: 1370e49f-94a5-47d7-92fe-0a96964c1386, {{(pid=86984) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 11:55:09 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-3423ad9f-9014-4573-a607-0919622da37b tempest-ProjectReaderTests-414172643 None] Volume volume-920199c6-129a-48be-85b8-ec6f8d9b56cc (920199c6-129a-48be-85b8-ec6f8d9b56cc): created successfully Sep 25 11:55:09 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3423ad9f-9014-4573-a607-0919622da37b tempest-ProjectReaderTests-414172643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea00dc33-3ccb-4b7b-91a4-e4bbbb681f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:09 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3423ad9f-9014-4573-a607-0919622da37b tempest-ProjectReaderTests-414172643 None] Flow 'volume_create_manager' (db63f682-86ee-4d83-8aab-1e0127650066) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:55:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-1db26da4-6fad-4ac2-a1af-77b651d93f66 tempest-VolumesDeleteCascade-1448271507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:55:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-1db26da4-6fad-4ac2-a1af-77b651d93f66 tempest-VolumesDeleteCascade-1448271507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:55:09 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-1db26da4-6fad-4ac2-a1af-77b651d93f66 tempest-VolumesDeleteCascade-1448271507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:55:09 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-1db26da4-6fad-4ac2-a1af-77b651d93f66 tempest-VolumesDeleteCascade-1448271507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:55:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-1db26da4-6fad-4ac2-a1af-77b651d93f66 tempest-VolumesDeleteCascade-1448271507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:55:09 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-3423ad9f-9014-4573-a607-0919622da37b tempest-ProjectReaderTests-414172643 None] Created volume successfully. Sep 25 11:55:09 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[22dce68d-d716-40f0-a397-3c88c02b7a38]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:55:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-1db26da4-6fad-4ac2-a1af-77b651d93f66 tempest-VolumesDeleteCascade-1448271507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7fba7e9d-3997-4d91-9bbc-ec16e9536a98.61837169-1345-436d-8a82-a45f183e8e46 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-51e84ea4-f95a-46f2-b7cd-4ea87540cb0a req-262a9f79-224a-4392-a702-47c1707d02a7 tempest-TestShelveInstance-101884204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:55:10 devstack sudo[101737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7fba7e9d-3997-4d91-9bbc-ec16e9536a98.61837169-1345-436d-8a82-a45f183e8e46 Sep 25 11:55:10 devstack sudo[101737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:10 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-9bf507b5-7a3d-4f79-a875-0996aed25f2c tempest-ProjectReaderTests-414172643 None] Acquiring lock "cinder-920199c6-129a-48be-85b8-ec6f8d9b56cc-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:55:10 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-9bf507b5-7a3d-4f79-a875-0996aed25f2c tempest-ProjectReaderTests-414172643 None] Lock "cinder-920199c6-129a-48be-85b8-ec6f8d9b56cc-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:55:10 devstack sudo[101737]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-1db26da4-6fad-4ac2-a1af-77b651d93f66 tempest-VolumesDeleteCascade-1448271507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7fba7e9d-3997-4d91-9bbc-ec16e9536a98.61837169-1345-436d-8a82-a45f183e8e46" returned: 0 in 0.583s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:10 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-1db26da4-6fad-4ac2-a1af-77b651d93f66 tempest-VolumesDeleteCascade-1448271507 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7fba7e9d-3997-4d91-9bbc-ec16e9536a98(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86984) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:55:10 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-9bf507b5-7a3d-4f79-a875-0996aed25f2c tempest-ProjectReaderTests-414172643 None] Acquiring lock "cinder-quobyte-920199c6-129a-48be-85b8-ec6f8d9b56cc" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:55:10 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d52394-b861-4240-8051-a9002f311103]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:55:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-1db26da4-6fad-4ac2-a1af-77b651d93f66 tempest-VolumesDeleteCascade-1448271507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7fba7e9d-3997-4d91-9bbc-ec16e9536a98 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:10 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-9bf507b5-7a3d-4f79-a875-0996aed25f2c tempest-ProjectReaderTests-414172643 None] Lock "cinder-quobyte-920199c6-129a-48be-85b8-ec6f8d9b56cc" acquired by "delete_volume" :: waited 0.031s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:55:10 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[af240e5a-1a12-4943-b095-561c099922b3]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:55:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-9bf507b5-7a3d-4f79-a875-0996aed25f2c tempest-ProjectReaderTests-414172643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-920199c6-129a-48be-85b8-ec6f8d9b56cc {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:10 devstack sudo[101742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7fba7e9d-3997-4d91-9bbc-ec16e9536a98 Sep 25 11:55:10 devstack sudo[101742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:10 devstack sudo[101743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-920199c6-129a-48be-85b8-ec6f8d9b56cc Sep 25 11:55:10 devstack sudo[101743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:11 devstack sudo[101742]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-1db26da4-6fad-4ac2-a1af-77b651d93f66 tempest-VolumesDeleteCascade-1448271507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7fba7e9d-3997-4d91-9bbc-ec16e9536a98" returned: 0 in 0.536s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:11 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-1db26da4-6fad-4ac2-a1af-77b651d93f66 tempest-VolumesDeleteCascade-1448271507 None] will copy from snapshot at /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7fba7e9d-3997-4d91-9bbc-ec16e9536a98 {{(pid=86984) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 11:55:11 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-1db26da4-6fad-4ac2-a1af-77b651d93f66 tempest-VolumesDeleteCascade-1448271507 None] Creating direct copy from snapshot {{(pid=86984) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 11:55:11 devstack cinder-volume[86984]: DEBUG cinder.utils [None req-1db26da4-6fad-4ac2-a1af-77b651d93f66 tempest-VolumesDeleteCascade-1448271507 None] Path /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1370e49f-94a5-47d7-92fe-0a96964c1386 not found in is_blk_device check {{(pid=86984) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 11:55:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-1db26da4-6fad-4ac2-a1af-77b651d93f66 tempest-VolumesDeleteCascade-1448271507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7fba7e9d-3997-4d91-9bbc-ec16e9536a98 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1370e49f-94a5-47d7-92fe-0a96964c1386 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:11 devstack sudo[101751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7fba7e9d-3997-4d91-9bbc-ec16e9536a98 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1370e49f-94a5-47d7-92fe-0a96964c1386 Sep 25 11:55:11 devstack sudo[101751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:11 devstack sudo[101743]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-9bf507b5-7a3d-4f79-a875-0996aed25f2c tempest-ProjectReaderTests-414172643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-920199c6-129a-48be-85b8-ec6f8d9b56cc" returned: 0 in 0.590s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-9bf507b5-7a3d-4f79-a875-0996aed25f2c tempest-ProjectReaderTests-414172643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-920199c6-129a-48be-85b8-ec6f8d9b56cc {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:11 devstack sudo[101754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-920199c6-129a-48be-85b8-ec6f8d9b56cc Sep 25 11:55:11 devstack sudo[101754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:11 devstack sudo[101754]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-9bf507b5-7a3d-4f79-a875-0996aed25f2c tempest-ProjectReaderTests-414172643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-920199c6-129a-48be-85b8-ec6f8d9b56cc" returned: 0 in 0.371s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:11 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-9bf507b5-7a3d-4f79-a875-0996aed25f2c tempest-ProjectReaderTests-414172643 None] Lock "cinder-quobyte-920199c6-129a-48be-85b8-ec6f8d9b56cc" released by "delete_volume" :: held 1.038s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:55:11 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-9bf507b5-7a3d-4f79-a875-0996aed25f2c tempest-ProjectReaderTests-414172643 None] Created reservations ['366d8de3-373b-4d6d-a0c3-b317000b9985', '38357d5f-afc0-4206-b4ca-34c5ace3083d', '4eefbfc1-f05c-44bc-bcba-ca8c77012f63', '3222e920-72d7-4fb4-b33b-eacd9c343aa6'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:55:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-9bf507b5-7a3d-4f79-a875-0996aed25f2c tempest-ProjectReaderTests-414172643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:55:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-9bf507b5-7a3d-4f79-a875-0996aed25f2c tempest-ProjectReaderTests-414172643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:55:11 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-9bf507b5-7a3d-4f79-a875-0996aed25f2c tempest-ProjectReaderTests-414172643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:55:11 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-9bf507b5-7a3d-4f79-a875-0996aed25f2c tempest-ProjectReaderTests-414172643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:55:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-9bf507b5-7a3d-4f79-a875-0996aed25f2c tempest-ProjectReaderTests-414172643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:55:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-9bf507b5-7a3d-4f79-a875-0996aed25f2c tempest-ProjectReaderTests-414172643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:11 devstack sudo[101765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:55:11 devstack sudo[101765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:12 devstack sudo[101765]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:12 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-9bf507b5-7a3d-4f79-a875-0996aed25f2c tempest-ProjectReaderTests-414172643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.571s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:12 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-9bf507b5-7a3d-4f79-a875-0996aed25f2c tempest-ProjectReaderTests-414172643 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:55:12 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-9bf507b5-7a3d-4f79-a875-0996aed25f2c tempest-ProjectReaderTests-414172643 None] Deleted volume successfully. Sep 25 11:55:12 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-9bf507b5-7a3d-4f79-a875-0996aed25f2c tempest-ProjectReaderTests-414172643 None] Lock "cinder-920199c6-129a-48be-85b8-ec6f8d9b56cc-delete_volume" released by "delete_volume" :: held 2.030s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:55:15 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-89102153-873d-4ce8-8c45-a2eb93b03d59 tempest-ProjectReaderTests-414172643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:55:15 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-89102153-873d-4ce8-8c45-a2eb93b03d59 tempest-ProjectReaderTests-414172643 None] Flow 'volume_create_manager' (9b472a4b-0643-46b8-9ac1-35d294380950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:55:15 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-89102153-873d-4ce8-8c45-a2eb93b03d59 tempest-ProjectReaderTests-414172643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1ad2f36-914f-478f-9cbf-3106ee7dc067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:15 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-89102153-873d-4ce8-8c45-a2eb93b03d59 tempest-ProjectReaderTests-414172643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1ad2f36-914f-478f-9cbf-3106ee7dc067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:55:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-655924480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4df17bdd-723c-4592-b56e-55fb31f417ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64b6fc75c67349d3895934fc5256c724',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:55:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:55:15Z,use_quota=True,user_id='e4592ebcc467449e9843b08ef7a5ccf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:15 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-89102153-873d-4ce8-8c45-a2eb93b03d59 tempest-ProjectReaderTests-414172643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06ac5eb1-80fa-4bfb-8d69-ec50e04f6135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:15 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-89102153-873d-4ce8-8c45-a2eb93b03d59 tempest-ProjectReaderTests-414172643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06ac5eb1-80fa-4bfb-8d69-ec50e04f6135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:15 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-89102153-873d-4ce8-8c45-a2eb93b03d59 tempest-ProjectReaderTests-414172643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04764dab-2f63-4df5-94f6-75488d5652bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:15 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-89102153-873d-4ce8-8c45-a2eb93b03d59 tempest-ProjectReaderTests-414172643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04764dab-2f63-4df5-94f6-75488d5652bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4df17bdd-723c-4592-b56e-55fb31f417ed', 'volume_name': 'volume-4df17bdd-723c-4592-b56e-55fb31f417ed', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:15 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-89102153-873d-4ce8-8c45-a2eb93b03d59 tempest-ProjectReaderTests-414172643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7694ab34-f1f6-43c8-8175-159e465f5e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:15 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-89102153-873d-4ce8-8c45-a2eb93b03d59 tempest-ProjectReaderTests-414172643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7694ab34-f1f6-43c8-8175-159e465f5e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:15 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-89102153-873d-4ce8-8c45-a2eb93b03d59 tempest-ProjectReaderTests-414172643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1390e93-ad33-4850-92dc-751016dc58cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:15 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-89102153-873d-4ce8-8c45-a2eb93b03d59 tempest-ProjectReaderTests-414172643 None] Volume 4df17bdd-723c-4592-b56e-55fb31f417ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4df17bdd-723c-4592-b56e-55fb31f417ed', 'volume_size': 1} Sep 25 11:55:15 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-89102153-873d-4ce8-8c45-a2eb93b03d59 tempest-ProjectReaderTests-414172643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:55:19 devstack sudo[101751]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:19 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-1db26da4-6fad-4ac2-a1af-77b651d93f66 tempest-VolumesDeleteCascade-1448271507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7fba7e9d-3997-4d91-9bbc-ec16e9536a98 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1370e49f-94a5-47d7-92fe-0a96964c1386" returned: 0 in 8.203s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:19 devstack cinder-volume[86984]: DEBUG cinder.image.image_utils [None req-1db26da4-6fad-4ac2-a1af-77b651d93f66 tempest-VolumesDeleteCascade-1448271507 None] Image conversion details: src /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7fba7e9d-3997-4d91-9bbc-ec16e9536a98, size 1024.00 MB, duration 8.20 sec, destination /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1370e49f-94a5-47d7-92fe-0a96964c1386 {{(pid=86984) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 11:55:19 devstack cinder-volume[86984]: INFO cinder.image.image_utils [None req-1db26da4-6fad-4ac2-a1af-77b651d93f66 tempest-VolumesDeleteCascade-1448271507 None] Converted 1024.00 MB image at 124.82 MB/s Sep 25 11:55:19 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-1db26da4-6fad-4ac2-a1af-77b651d93f66 tempest-VolumesDeleteCascade-1448271507 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1370e49f-94a5-47d7-92fe-0a96964c1386 is being set with open permissions: ugo+rw Sep 25 11:55:19 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-1db26da4-6fad-4ac2-a1af-77b651d93f66 tempest-VolumesDeleteCascade-1448271507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1370e49f-94a5-47d7-92fe-0a96964c1386 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:19 devstack sudo[101773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1370e49f-94a5-47d7-92fe-0a96964c1386 Sep 25 11:55:19 devstack sudo[101773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:19 devstack sudo[101773]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:19 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-1db26da4-6fad-4ac2-a1af-77b651d93f66 tempest-VolumesDeleteCascade-1448271507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1370e49f-94a5-47d7-92fe-0a96964c1386" returned: 0 in 0.266s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:19 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-1db26da4-6fad-4ac2-a1af-77b651d93f66 tempest-VolumesDeleteCascade-1448271507 None] Lock "cinder-quobyte-1370e49f-94a5-47d7-92fe-0a96964c1386" released by "_copy_volume_from_snapshot" :: held 9.855s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:55:19 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-1db26da4-6fad-4ac2-a1af-77b651d93f66 tempest-VolumesDeleteCascade-1448271507 None] Lock "cinder-quobyte-61837169-1345-436d-8a82-a45f183e8e46-1370e49f-94a5-47d7-92fe-0a96964c1386" released by "_create_volume_from_snapshot" :: held 9.977s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:55:19 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-1db26da4-6fad-4ac2-a1af-77b651d93f66 tempest-VolumesDeleteCascade-1448271507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.017s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:55:19 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-51e84ea4-f95a-46f2-b7cd-4ea87540cb0a req-262a9f79-224a-4392-a702-47c1707d02a7 tempest-TestShelveInstance-101884204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 9.656s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:55:19 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-51e84ea4-f95a-46f2-b7cd-4ea87540cb0a req-262a9f79-224a-4392-a702-47c1707d02a7 tempest-TestShelveInstance-101884204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:55:19 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-89102153-873d-4ce8-8c45-a2eb93b03d59 tempest-ProjectReaderTests-414172643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.133s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:55:19 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-89102153-873d-4ce8-8c45-a2eb93b03d59 tempest-ProjectReaderTests-414172643 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:55:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-655924480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4df17bdd-723c-4592-b56e-55fb31f417ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64b6fc75c67349d3895934fc5256c724',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:55:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:55:15Z,use_quota=True,user_id='e4592ebcc467449e9843b08ef7a5ccf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:55:19 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-89102153-873d-4ce8-8c45-a2eb93b03d59 tempest-ProjectReaderTests-414172643 None] Creating volume 4df17bdd-723c-4592-b56e-55fb31f417ed {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:55:19 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-89102153-873d-4ce8-8c45-a2eb93b03d59 tempest-ProjectReaderTests-414172643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:55:19 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-89102153-873d-4ce8-8c45-a2eb93b03d59 tempest-ProjectReaderTests-414172643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:55:19 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-89102153-873d-4ce8-8c45-a2eb93b03d59 tempest-ProjectReaderTests-414172643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:55:19 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-89102153-873d-4ce8-8c45-a2eb93b03d59 tempest-ProjectReaderTests-414172643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:55:19 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-89102153-873d-4ce8-8c45-a2eb93b03d59 tempest-ProjectReaderTests-414172643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:55:19 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-89102153-873d-4ce8-8c45-a2eb93b03d59 tempest-ProjectReaderTests-414172643 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:55:19 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-89102153-873d-4ce8-8c45-a2eb93b03d59 tempest-ProjectReaderTests-414172643 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:55:19 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-89102153-873d-4ce8-8c45-a2eb93b03d59 tempest-ProjectReaderTests-414172643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-4df17bdd-723c-4592-b56e-55fb31f417ed 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:19 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-1db26da4-6fad-4ac2-a1af-77b651d93f66 tempest-VolumesDeleteCascade-1448271507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0a5d85c-1242-44e8-96fc-7f62821a27c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1370e49f-94a5-47d7-92fe-0a96964c1386', 'volume_size': 1, 'snapshot_id': '61837169-1345-436d-8a82-a45f183e8e46'}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:19 devstack sudo[101776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-4df17bdd-723c-4592-b56e-55fb31f417ed 1073741824 Sep 25 11:55:19 devstack sudo[101776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:19 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-1db26da4-6fad-4ac2-a1af-77b651d93f66 tempest-VolumesDeleteCascade-1448271507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c290f010-39ff-48e0-9d8b-01754b740d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:19 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-1db26da4-6fad-4ac2-a1af-77b651d93f66 tempest-VolumesDeleteCascade-1448271507 None] Volume volume-1370e49f-94a5-47d7-92fe-0a96964c1386 (1370e49f-94a5-47d7-92fe-0a96964c1386): created successfully Sep 25 11:55:19 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-1db26da4-6fad-4ac2-a1af-77b651d93f66 tempest-VolumesDeleteCascade-1448271507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c290f010-39ff-48e0-9d8b-01754b740d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:19 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-1db26da4-6fad-4ac2-a1af-77b651d93f66 tempest-VolumesDeleteCascade-1448271507 None] Flow 'volume_create_manager' (f8b3c020-e01f-46fe-a485-614682f5a358) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:55:19 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [req-51e84ea4-f95a-46f2-b7cd-4ea87540cb0a req-262a9f79-224a-4392-a702-47c1707d02a7 tempest-TestShelveInstance-101884204 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba', 'name': 'volume-afefdf65-66cb-4acc-a2b7-9a1b2e0f8d13', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e1a73daa-ebe7-4f6d-81c3-d87149f2c6f0', 'enforce_multipath': True} {{(pid=86984) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 11:55:19 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-1db26da4-6fad-4ac2-a1af-77b651d93f66 tempest-VolumesDeleteCascade-1448271507 None] Created volume successfully. Sep 25 11:55:19 devstack cinder-volume[86984]: INFO cinder.volume.manager [req-51e84ea4-f95a-46f2-b7cd-4ea87540cb0a req-262a9f79-224a-4392-a702-47c1707d02a7 tempest-TestShelveInstance-101884204 None] attachment_update completed successfully. Sep 25 11:55:20 devstack sudo[101776]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-89102153-873d-4ce8-8c45-a2eb93b03d59 tempest-ProjectReaderTests-414172643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-4df17bdd-723c-4592-b56e-55fb31f417ed 1073741824" returned: 0 in 0.566s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-89102153-873d-4ce8-8c45-a2eb93b03d59 tempest-ProjectReaderTests-414172643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-4df17bdd-723c-4592-b56e-55fb31f417ed {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:20 devstack sudo[101802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-4df17bdd-723c-4592-b56e-55fb31f417ed Sep 25 11:55:20 devstack sudo[101802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:20 devstack sudo[101802]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-89102153-873d-4ce8-8c45-a2eb93b03d59 tempest-ProjectReaderTests-414172643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-4df17bdd-723c-4592-b56e-55fb31f417ed" returned: 0 in 0.313s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:20 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-89102153-873d-4ce8-8c45-a2eb93b03d59 tempest-ProjectReaderTests-414172643 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:55:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-89102153-873d-4ce8-8c45-a2eb93b03d59 tempest-ProjectReaderTests-414172643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:55:20 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-89102153-873d-4ce8-8c45-a2eb93b03d59 tempest-ProjectReaderTests-414172643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1390e93-ad33-4850-92dc-751016dc58cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4df17bdd-723c-4592-b56e-55fb31f417ed', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:20 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-89102153-873d-4ce8-8c45-a2eb93b03d59 tempest-ProjectReaderTests-414172643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92b0741a-5f83-47f3-a2cd-eff12f764dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:20 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-89102153-873d-4ce8-8c45-a2eb93b03d59 tempest-ProjectReaderTests-414172643 None] Volume volume-4df17bdd-723c-4592-b56e-55fb31f417ed (4df17bdd-723c-4592-b56e-55fb31f417ed): created successfully Sep 25 11:55:20 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-89102153-873d-4ce8-8c45-a2eb93b03d59 tempest-ProjectReaderTests-414172643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92b0741a-5f83-47f3-a2cd-eff12f764dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:20 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-89102153-873d-4ce8-8c45-a2eb93b03d59 tempest-ProjectReaderTests-414172643 None] Flow 'volume_create_manager' (9b472a4b-0643-46b8-9ac1-35d294380950) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:55:20 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-89102153-873d-4ce8-8c45-a2eb93b03d59 tempest-ProjectReaderTests-414172643 None] Created volume successfully. Sep 25 11:55:20 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-31ea32b1-306e-4acb-a9dd-a3eef4d1aaf8 tempest-VolumesDeleteCascade-1448271507 None] Acquiring lock "cinder-7fba7e9d-3997-4d91-9bbc-ec16e9536a98-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:55:20 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-31ea32b1-306e-4acb-a9dd-a3eef4d1aaf8 tempest-VolumesDeleteCascade-1448271507 None] Lock "cinder-7fba7e9d-3997-4d91-9bbc-ec16e9536a98-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:55:21 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-31ea32b1-306e-4acb-a9dd-a3eef4d1aaf8 tempest-VolumesDeleteCascade-1448271507 None] Performing cascade delete. {{(pid=86984) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 25 11:55:21 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-31ea32b1-306e-4acb-a9dd-a3eef4d1aaf8 tempest-VolumesDeleteCascade-1448271507 None] Acquiring lock "cinder-61837169-1345-436d-8a82-a45f183e8e46-delete_snapshot" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:55:21 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-31ea32b1-306e-4acb-a9dd-a3eef4d1aaf8 tempest-VolumesDeleteCascade-1448271507 None] Lock "cinder-61837169-1345-436d-8a82-a45f183e8e46-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:55:21 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-31ea32b1-306e-4acb-a9dd-a3eef4d1aaf8 tempest-VolumesDeleteCascade-1448271507 None] Acquiring lock "cinder-quobyte-7fba7e9d-3997-4d91-9bbc-ec16e9536a98" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:55:21 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-31ea32b1-306e-4acb-a9dd-a3eef4d1aaf8 tempest-VolumesDeleteCascade-1448271507 None] Lock "cinder-quobyte-7fba7e9d-3997-4d91-9bbc-ec16e9536a98" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:55:21 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-31ea32b1-306e-4acb-a9dd-a3eef4d1aaf8 tempest-VolumesDeleteCascade-1448271507 None] Acquiring lock "cinder-quobyte-61837169-1345-436d-8a82-a45f183e8e46" by "_delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:55:21 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-31ea32b1-306e-4acb-a9dd-a3eef4d1aaf8 tempest-VolumesDeleteCascade-1448271507 None] Lock "cinder-quobyte-61837169-1345-436d-8a82-a45f183e8e46" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:55:21 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-31ea32b1-306e-4acb-a9dd-a3eef4d1aaf8 tempest-VolumesDeleteCascade-1448271507 None] Deleting offline snapshot 61837169-1345-436d-8a82-a45f183e8e46 of volume 7fba7e9d-3997-4d91-9bbc-ec16e9536a98 {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:55:21 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-31ea32b1-306e-4acb-a9dd-a3eef4d1aaf8 tempest-VolumesDeleteCascade-1448271507 None] snapshot_file for this snap is: volume-7fba7e9d-3997-4d91-9bbc-ec16e9536a98.61837169-1345-436d-8a82-a45f183e8e46 {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:55:21 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec45d1cd-7843-4c8a-9130-7f368a8bce22]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:55:21 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-31ea32b1-306e-4acb-a9dd-a3eef4d1aaf8 tempest-VolumesDeleteCascade-1448271507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7fba7e9d-3997-4d91-9bbc-ec16e9536a98.61837169-1345-436d-8a82-a45f183e8e46 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:21 devstack sudo[102317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7fba7e9d-3997-4d91-9bbc-ec16e9536a98.61837169-1345-436d-8a82-a45f183e8e46 Sep 25 11:55:21 devstack sudo[102317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:21 devstack sudo[102317]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:21 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-31ea32b1-306e-4acb-a9dd-a3eef4d1aaf8 tempest-VolumesDeleteCascade-1448271507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7fba7e9d-3997-4d91-9bbc-ec16e9536a98.61837169-1345-436d-8a82-a45f183e8e46" returned: 0 in 0.621s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:21 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-31ea32b1-306e-4acb-a9dd-a3eef4d1aaf8 tempest-VolumesDeleteCascade-1448271507 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7fba7e9d-3997-4d91-9bbc-ec16e9536a98(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86984) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:55:21 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f10328a-22e7-4227-a343-f736fbde2923]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:55:21 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-31ea32b1-306e-4acb-a9dd-a3eef4d1aaf8 tempest-VolumesDeleteCascade-1448271507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7fba7e9d-3997-4d91-9bbc-ec16e9536a98 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:21 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-89e854e3-18c7-4247-ad3d-29e45b7f42ba tempest-ProjectReaderTests-414172643 None] Acquiring lock "cinder-4df17bdd-723c-4592-b56e-55fb31f417ed-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:55:22 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-89e854e3-18c7-4247-ad3d-29e45b7f42ba tempest-ProjectReaderTests-414172643 None] Lock "cinder-4df17bdd-723c-4592-b56e-55fb31f417ed-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:55:22 devstack sudo[102342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7fba7e9d-3997-4d91-9bbc-ec16e9536a98 Sep 25 11:55:22 devstack sudo[102342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:22 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-89e854e3-18c7-4247-ad3d-29e45b7f42ba tempest-ProjectReaderTests-414172643 None] Acquiring lock "cinder-quobyte-4df17bdd-723c-4592-b56e-55fb31f417ed" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:55:22 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-89e854e3-18c7-4247-ad3d-29e45b7f42ba tempest-ProjectReaderTests-414172643 None] Lock "cinder-quobyte-4df17bdd-723c-4592-b56e-55fb31f417ed" acquired by "delete_volume" :: waited 0.024s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:55:22 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff3f3521-4963-4575-8448-c4b3229728ea]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:55:22 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-89e854e3-18c7-4247-ad3d-29e45b7f42ba tempest-ProjectReaderTests-414172643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-4df17bdd-723c-4592-b56e-55fb31f417ed {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:22 devstack sudo[102348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-4df17bdd-723c-4592-b56e-55fb31f417ed Sep 25 11:55:22 devstack sudo[102348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:22 devstack sudo[102348]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:22 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-89e854e3-18c7-4247-ad3d-29e45b7f42ba tempest-ProjectReaderTests-414172643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-4df17bdd-723c-4592-b56e-55fb31f417ed" returned: 0 in 0.461s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:22 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-89e854e3-18c7-4247-ad3d-29e45b7f42ba tempest-ProjectReaderTests-414172643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-4df17bdd-723c-4592-b56e-55fb31f417ed {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:22 devstack sudo[102342]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:22 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-31ea32b1-306e-4acb-a9dd-a3eef4d1aaf8 tempest-VolumesDeleteCascade-1448271507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7fba7e9d-3997-4d91-9bbc-ec16e9536a98" returned: 0 in 0.723s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:22 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-31ea32b1-306e-4acb-a9dd-a3eef4d1aaf8 tempest-VolumesDeleteCascade-1448271507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7fba7e9d-3997-4d91-9bbc-ec16e9536a98.61837169-1345-436d-8a82-a45f183e8e46 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:22 devstack sudo[102367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-4df17bdd-723c-4592-b56e-55fb31f417ed Sep 25 11:55:22 devstack sudo[102367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:22 devstack sudo[102370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7fba7e9d-3997-4d91-9bbc-ec16e9536a98.61837169-1345-436d-8a82-a45f183e8e46 Sep 25 11:55:22 devstack sudo[102370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:22 devstack sudo[102367]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:22 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-89e854e3-18c7-4247-ad3d-29e45b7f42ba tempest-ProjectReaderTests-414172643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-4df17bdd-723c-4592-b56e-55fb31f417ed" returned: 0 in 0.334s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:22 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-89e854e3-18c7-4247-ad3d-29e45b7f42ba tempest-ProjectReaderTests-414172643 None] Lock "cinder-quobyte-4df17bdd-723c-4592-b56e-55fb31f417ed" released by "delete_volume" :: held 0.857s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:55:22 devstack cinder-volume[86984]: DEBUG dbcounter [-] [86984] Writing DB stats cinder:SELECT=100,cinder:UPDATE=121,cinder:INSERT=40,cinder:DELETE=12 {{(pid=86984) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:55:22 devstack cinder-volume[86984]: DEBUG dbcounter [-] [86984] Writing DB stats cinder:SELECT=117,cinder:UPDATE=106,cinder:INSERT=37,cinder:DELETE=7 {{(pid=86984) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:55:23 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-89e854e3-18c7-4247-ad3d-29e45b7f42ba tempest-ProjectReaderTests-414172643 None] Created reservations ['81293bde-f382-4d9b-8e11-03ccf449dc5b', '38f5192f-eaca-4a01-8628-51d6c64df70e', '8f3218ee-0cfd-460b-bedb-4b240d9a4759', '7bbcf6a9-4c1a-4a1e-908e-e0e562085e79'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:55:23 devstack sudo[102370]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-31ea32b1-306e-4acb-a9dd-a3eef4d1aaf8 tempest-VolumesDeleteCascade-1448271507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7fba7e9d-3997-4d91-9bbc-ec16e9536a98.61837169-1345-436d-8a82-a45f183e8e46" returned: 0 in 0.485s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-31ea32b1-306e-4acb-a9dd-a3eef4d1aaf8 tempest-VolumesDeleteCascade-1448271507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7fba7e9d-3997-4d91-9bbc-ec16e9536a98.61837169-1345-436d-8a82-a45f183e8e46 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:23 devstack sudo[102389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7fba7e9d-3997-4d91-9bbc-ec16e9536a98.61837169-1345-436d-8a82-a45f183e8e46 Sep 25 11:55:23 devstack sudo[102389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-89e854e3-18c7-4247-ad3d-29e45b7f42ba tempest-ProjectReaderTests-414172643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:55:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-89e854e3-18c7-4247-ad3d-29e45b7f42ba tempest-ProjectReaderTests-414172643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:55:23 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-89e854e3-18c7-4247-ad3d-29e45b7f42ba tempest-ProjectReaderTests-414172643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:55:23 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-89e854e3-18c7-4247-ad3d-29e45b7f42ba tempest-ProjectReaderTests-414172643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:55:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-89e854e3-18c7-4247-ad3d-29e45b7f42ba tempest-ProjectReaderTests-414172643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:55:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-89e854e3-18c7-4247-ad3d-29e45b7f42ba tempest-ProjectReaderTests-414172643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:23 devstack sudo[102391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:55:23 devstack sudo[102391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:23 devstack sudo[102389]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-31ea32b1-306e-4acb-a9dd-a3eef4d1aaf8 tempest-VolumesDeleteCascade-1448271507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7fba7e9d-3997-4d91-9bbc-ec16e9536a98.61837169-1345-436d-8a82-a45f183e8e46" returned: 0 in 0.471s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:23 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-31ea32b1-306e-4acb-a9dd-a3eef4d1aaf8 tempest-VolumesDeleteCascade-1448271507 None] Lock "cinder-quobyte-61837169-1345-436d-8a82-a45f183e8e46" released by "_delete_snapshot" :: held 2.478s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:55:23 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-31ea32b1-306e-4acb-a9dd-a3eef4d1aaf8 tempest-VolumesDeleteCascade-1448271507 None] Lock "cinder-quobyte-7fba7e9d-3997-4d91-9bbc-ec16e9536a98" released by "delete_snapshot" :: held 2.517s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:55:23 devstack sudo[102391]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-89e854e3-18c7-4247-ad3d-29e45b7f42ba tempest-ProjectReaderTests-414172643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.386s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:23 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-89e854e3-18c7-4247-ad3d-29e45b7f42ba tempest-ProjectReaderTests-414172643 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:55:23 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-89e854e3-18c7-4247-ad3d-29e45b7f42ba tempest-ProjectReaderTests-414172643 None] Deleted volume successfully. Sep 25 11:55:23 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-89e854e3-18c7-4247-ad3d-29e45b7f42ba tempest-ProjectReaderTests-414172643 None] Lock "cinder-4df17bdd-723c-4592-b56e-55fb31f417ed-delete_volume" released by "delete_volume" :: held 1.729s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:55:23 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-31ea32b1-306e-4acb-a9dd-a3eef4d1aaf8 tempest-VolumesDeleteCascade-1448271507 None] Created reservations ['e091322e-c2cc-4be8-84a1-75303dd91264', '50253ba0-2666-4601-9d5f-ea89da91a52f', 'c7424fb2-859b-4903-972b-c2896301f6a9', '8d066911-7104-4586-8734-23d48fe0a919'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:55:23 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-31ea32b1-306e-4acb-a9dd-a3eef4d1aaf8 tempest-VolumesDeleteCascade-1448271507 None] Delete snapshot completed successfully. Sep 25 11:55:23 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-31ea32b1-306e-4acb-a9dd-a3eef4d1aaf8 tempest-VolumesDeleteCascade-1448271507 None] Lock "cinder-61837169-1345-436d-8a82-a45f183e8e46-delete_snapshot" released by "delete_snapshot" :: held 2.743s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:55:23 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-31ea32b1-306e-4acb-a9dd-a3eef4d1aaf8 tempest-VolumesDeleteCascade-1448271507 None] Snapshots deleted, issuing volume delete {{(pid=86984) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 25 11:55:23 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-31ea32b1-306e-4acb-a9dd-a3eef4d1aaf8 tempest-VolumesDeleteCascade-1448271507 None] Acquiring lock "cinder-quobyte-7fba7e9d-3997-4d91-9bbc-ec16e9536a98" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:55:23 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-31ea32b1-306e-4acb-a9dd-a3eef4d1aaf8 tempest-VolumesDeleteCascade-1448271507 None] Lock "cinder-quobyte-7fba7e9d-3997-4d91-9bbc-ec16e9536a98" acquired by "delete_volume" :: waited 0.016s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:55:23 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a8691a7-36bf-4c1e-a8e4-fc8ce1a3a73d]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:55:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-31ea32b1-306e-4acb-a9dd-a3eef4d1aaf8 tempest-VolumesDeleteCascade-1448271507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7fba7e9d-3997-4d91-9bbc-ec16e9536a98 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:24 devstack sudo[102397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7fba7e9d-3997-4d91-9bbc-ec16e9536a98 Sep 25 11:55:24 devstack sudo[102397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:24 devstack sudo[102397]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:24 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-31ea32b1-306e-4acb-a9dd-a3eef4d1aaf8 tempest-VolumesDeleteCascade-1448271507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7fba7e9d-3997-4d91-9bbc-ec16e9536a98" returned: 0 in 0.846s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:24 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-31ea32b1-306e-4acb-a9dd-a3eef4d1aaf8 tempest-VolumesDeleteCascade-1448271507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7fba7e9d-3997-4d91-9bbc-ec16e9536a98 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:24 devstack sudo[102403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7fba7e9d-3997-4d91-9bbc-ec16e9536a98 Sep 25 11:55:24 devstack sudo[102403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:25 devstack sudo[102403]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:25 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-31ea32b1-306e-4acb-a9dd-a3eef4d1aaf8 tempest-VolumesDeleteCascade-1448271507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7fba7e9d-3997-4d91-9bbc-ec16e9536a98" returned: 0 in 0.309s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:25 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-31ea32b1-306e-4acb-a9dd-a3eef4d1aaf8 tempest-VolumesDeleteCascade-1448271507 None] Lock "cinder-quobyte-7fba7e9d-3997-4d91-9bbc-ec16e9536a98" released by "delete_volume" :: held 1.257s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:55:25 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-31ea32b1-306e-4acb-a9dd-a3eef4d1aaf8 tempest-VolumesDeleteCascade-1448271507 None] Created reservations ['287f531f-56ac-4e27-b9b1-0edf929cdb73', '1365a59b-e030-4aae-b52c-53fa7ab67f1c', '65aef694-55f5-4530-8853-d7784a529b55', '372992c3-b666-4b6d-9558-632402942e93'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:55:25 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-31ea32b1-306e-4acb-a9dd-a3eef4d1aaf8 tempest-VolumesDeleteCascade-1448271507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:55:25 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-31ea32b1-306e-4acb-a9dd-a3eef4d1aaf8 tempest-VolumesDeleteCascade-1448271507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:55:25 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-31ea32b1-306e-4acb-a9dd-a3eef4d1aaf8 tempest-VolumesDeleteCascade-1448271507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:55:25 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-31ea32b1-306e-4acb-a9dd-a3eef4d1aaf8 tempest-VolumesDeleteCascade-1448271507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:55:25 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-31ea32b1-306e-4acb-a9dd-a3eef4d1aaf8 tempest-VolumesDeleteCascade-1448271507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:55:25 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-31ea32b1-306e-4acb-a9dd-a3eef4d1aaf8 tempest-VolumesDeleteCascade-1448271507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:25 devstack sudo[102406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:55:25 devstack sudo[102406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:25 devstack sudo[102406]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:25 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-31ea32b1-306e-4acb-a9dd-a3eef4d1aaf8 tempest-VolumesDeleteCascade-1448271507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.533s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:25 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-31ea32b1-306e-4acb-a9dd-a3eef4d1aaf8 tempest-VolumesDeleteCascade-1448271507 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:55:25 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-31ea32b1-306e-4acb-a9dd-a3eef4d1aaf8 tempest-VolumesDeleteCascade-1448271507 None] Deleted volume successfully. Sep 25 11:55:25 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-31ea32b1-306e-4acb-a9dd-a3eef4d1aaf8 tempest-VolumesDeleteCascade-1448271507 None] Lock "cinder-7fba7e9d-3997-4d91-9bbc-ec16e9536a98-delete_volume" released by "delete_volume" :: held 4.969s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:55:26 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-60958b75-aa8b-4a82-bda2-cf96f8a827e4 tempest-VolumesDeleteCascade-1448271507 None] Acquiring lock "cinder-1370e49f-94a5-47d7-92fe-0a96964c1386-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:55:26 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-60958b75-aa8b-4a82-bda2-cf96f8a827e4 tempest-VolumesDeleteCascade-1448271507 None] Lock "cinder-1370e49f-94a5-47d7-92fe-0a96964c1386-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:55:26 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-60958b75-aa8b-4a82-bda2-cf96f8a827e4 tempest-VolumesDeleteCascade-1448271507 None] Acquiring lock "cinder-quobyte-1370e49f-94a5-47d7-92fe-0a96964c1386" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:55:26 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-60958b75-aa8b-4a82-bda2-cf96f8a827e4 tempest-VolumesDeleteCascade-1448271507 None] Lock "cinder-quobyte-1370e49f-94a5-47d7-92fe-0a96964c1386" acquired by "delete_volume" :: waited 0.041s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:55:26 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f371e94-2549-4d7a-b435-2584da9d95a4]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:55:26 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-60958b75-aa8b-4a82-bda2-cf96f8a827e4 tempest-VolumesDeleteCascade-1448271507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1370e49f-94a5-47d7-92fe-0a96964c1386 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:26 devstack sudo[102411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1370e49f-94a5-47d7-92fe-0a96964c1386 Sep 25 11:55:26 devstack sudo[102411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:27 devstack sudo[102411]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:27 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-60958b75-aa8b-4a82-bda2-cf96f8a827e4 tempest-VolumesDeleteCascade-1448271507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1370e49f-94a5-47d7-92fe-0a96964c1386" returned: 0 in 0.874s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:27 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-60958b75-aa8b-4a82-bda2-cf96f8a827e4 tempest-VolumesDeleteCascade-1448271507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1370e49f-94a5-47d7-92fe-0a96964c1386 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:27 devstack sudo[102416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1370e49f-94a5-47d7-92fe-0a96964c1386 Sep 25 11:55:27 devstack sudo[102416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:27 devstack sudo[102416]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:27 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-60958b75-aa8b-4a82-bda2-cf96f8a827e4 tempest-VolumesDeleteCascade-1448271507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1370e49f-94a5-47d7-92fe-0a96964c1386" returned: 0 in 0.567s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:27 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-60958b75-aa8b-4a82-bda2-cf96f8a827e4 tempest-VolumesDeleteCascade-1448271507 None] Lock "cinder-quobyte-1370e49f-94a5-47d7-92fe-0a96964c1386" released by "delete_volume" :: held 1.590s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:55:27 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-60958b75-aa8b-4a82-bda2-cf96f8a827e4 tempest-VolumesDeleteCascade-1448271507 None] Created reservations ['fa69b983-641e-4c1c-87a3-dc468ef032bd', 'a33884c0-8e28-46f2-9293-fe6bcc81163e', '0c30a812-31f9-4c5c-a9ea-41782d137b60', 'dfbdba87-b2c5-4ffa-adb5-085479a3477a'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:55:28 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-60958b75-aa8b-4a82-bda2-cf96f8a827e4 tempest-VolumesDeleteCascade-1448271507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:55:28 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-60958b75-aa8b-4a82-bda2-cf96f8a827e4 tempest-VolumesDeleteCascade-1448271507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:55:28 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-60958b75-aa8b-4a82-bda2-cf96f8a827e4 tempest-VolumesDeleteCascade-1448271507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:55:28 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-60958b75-aa8b-4a82-bda2-cf96f8a827e4 tempest-VolumesDeleteCascade-1448271507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:55:28 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-60958b75-aa8b-4a82-bda2-cf96f8a827e4 tempest-VolumesDeleteCascade-1448271507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:55:28 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-60958b75-aa8b-4a82-bda2-cf96f8a827e4 tempest-VolumesDeleteCascade-1448271507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:28 devstack sudo[102420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:55:28 devstack sudo[102420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:28 devstack sudo[102420]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:28 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-60958b75-aa8b-4a82-bda2-cf96f8a827e4 tempest-VolumesDeleteCascade-1448271507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.513s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:28 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-60958b75-aa8b-4a82-bda2-cf96f8a827e4 tempest-VolumesDeleteCascade-1448271507 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:55:28 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-60958b75-aa8b-4a82-bda2-cf96f8a827e4 tempest-VolumesDeleteCascade-1448271507 None] Deleted volume successfully. Sep 25 11:55:28 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-60958b75-aa8b-4a82-bda2-cf96f8a827e4 tempest-VolumesDeleteCascade-1448271507 None] Lock "cinder-1370e49f-94a5-47d7-92fe-0a96964c1386-delete_volume" released by "delete_volume" :: held 2.639s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:55:34 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e19a0c1-badd-425b-85bb-1ed9d186b0ca tempest-VolumesMetadataTest-1131745711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:55:34 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7e19a0c1-badd-425b-85bb-1ed9d186b0ca tempest-VolumesMetadataTest-1131745711 None] Flow 'volume_create_manager' (1848ca6b-617d-48fe-9703-2dee51930a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:55:34 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7e19a0c1-badd-425b-85bb-1ed9d186b0ca tempest-VolumesMetadataTest-1131745711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ac38964-bec7-4d17-9bf8-621a1729aa7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:34 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7e19a0c1-badd-425b-85bb-1ed9d186b0ca tempest-VolumesMetadataTest-1131745711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ac38964-bec7-4d17-9bf8-621a1729aa7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:55:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-401125561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6419d57b-544a-4459-900a-95451140b367,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb63dd974c8a4e51b3f8da5533e1ee9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:55:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:55:34Z,use_quota=True,user_id='067838fa47f94ef692a1fda56c53e2a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:34 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7e19a0c1-badd-425b-85bb-1ed9d186b0ca tempest-VolumesMetadataTest-1131745711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddae7b55-1a07-4a84-a60d-30924efc06b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:34 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7e19a0c1-badd-425b-85bb-1ed9d186b0ca tempest-VolumesMetadataTest-1131745711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddae7b55-1a07-4a84-a60d-30924efc06b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:34 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7e19a0c1-badd-425b-85bb-1ed9d186b0ca tempest-VolumesMetadataTest-1131745711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f3b2a15-1950-4c1a-8e33-eb648a212b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:34 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7e19a0c1-badd-425b-85bb-1ed9d186b0ca tempest-VolumesMetadataTest-1131745711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f3b2a15-1950-4c1a-8e33-eb648a212b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6419d57b-544a-4459-900a-95451140b367', 'volume_name': 'volume-6419d57b-544a-4459-900a-95451140b367', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:34 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7e19a0c1-badd-425b-85bb-1ed9d186b0ca tempest-VolumesMetadataTest-1131745711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71739209-827b-40c4-b59e-6da7178e98f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:34 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7e19a0c1-badd-425b-85bb-1ed9d186b0ca tempest-VolumesMetadataTest-1131745711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71739209-827b-40c4-b59e-6da7178e98f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:34 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7e19a0c1-badd-425b-85bb-1ed9d186b0ca tempest-VolumesMetadataTest-1131745711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66aa19df-5782-45c8-aadb-ead1b454ecc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:34 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-7e19a0c1-badd-425b-85bb-1ed9d186b0ca tempest-VolumesMetadataTest-1131745711 None] Volume 6419d57b-544a-4459-900a-95451140b367: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6419d57b-544a-4459-900a-95451140b367', 'volume_size': 1} Sep 25 11:55:34 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-7e19a0c1-badd-425b-85bb-1ed9d186b0ca tempest-VolumesMetadataTest-1131745711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:55:34 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-7e19a0c1-badd-425b-85bb-1ed9d186b0ca tempest-VolumesMetadataTest-1131745711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:55:34 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-7e19a0c1-badd-425b-85bb-1ed9d186b0ca tempest-VolumesMetadataTest-1131745711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:55:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-401125561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6419d57b-544a-4459-900a-95451140b367,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb63dd974c8a4e51b3f8da5533e1ee9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:55:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:55:34Z,use_quota=True,user_id='067838fa47f94ef692a1fda56c53e2a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:55:34 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-7e19a0c1-badd-425b-85bb-1ed9d186b0ca tempest-VolumesMetadataTest-1131745711 None] Creating volume 6419d57b-544a-4459-900a-95451140b367 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:55:34 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-7e19a0c1-badd-425b-85bb-1ed9d186b0ca tempest-VolumesMetadataTest-1131745711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:55:34 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-7e19a0c1-badd-425b-85bb-1ed9d186b0ca tempest-VolumesMetadataTest-1131745711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:55:34 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-7e19a0c1-badd-425b-85bb-1ed9d186b0ca tempest-VolumesMetadataTest-1131745711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:55:34 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-7e19a0c1-badd-425b-85bb-1ed9d186b0ca tempest-VolumesMetadataTest-1131745711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:55:34 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-7e19a0c1-badd-425b-85bb-1ed9d186b0ca tempest-VolumesMetadataTest-1131745711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:55:34 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-7e19a0c1-badd-425b-85bb-1ed9d186b0ca tempest-VolumesMetadataTest-1131745711 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:55:34 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-7e19a0c1-badd-425b-85bb-1ed9d186b0ca tempest-VolumesMetadataTest-1131745711 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:55:34 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7e19a0c1-badd-425b-85bb-1ed9d186b0ca tempest-VolumesMetadataTest-1131745711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6419d57b-544a-4459-900a-95451140b367 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:34 devstack sudo[102428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6419d57b-544a-4459-900a-95451140b367 1073741824 Sep 25 11:55:34 devstack sudo[102428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:34 devstack sudo[102428]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:34 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7e19a0c1-badd-425b-85bb-1ed9d186b0ca tempest-VolumesMetadataTest-1131745711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6419d57b-544a-4459-900a-95451140b367 1073741824" returned: 0 in 0.495s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:34 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7e19a0c1-badd-425b-85bb-1ed9d186b0ca tempest-VolumesMetadataTest-1131745711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6419d57b-544a-4459-900a-95451140b367 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:34 devstack sudo[102433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6419d57b-544a-4459-900a-95451140b367 Sep 25 11:55:34 devstack sudo[102433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:35 devstack sudo[102433]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:35 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7e19a0c1-badd-425b-85bb-1ed9d186b0ca tempest-VolumesMetadataTest-1131745711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6419d57b-544a-4459-900a-95451140b367" returned: 0 in 0.300s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:35 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-7e19a0c1-badd-425b-85bb-1ed9d186b0ca tempest-VolumesMetadataTest-1131745711 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:55:35 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-7e19a0c1-badd-425b-85bb-1ed9d186b0ca tempest-VolumesMetadataTest-1131745711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:55:35 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7e19a0c1-badd-425b-85bb-1ed9d186b0ca tempest-VolumesMetadataTest-1131745711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66aa19df-5782-45c8-aadb-ead1b454ecc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6419d57b-544a-4459-900a-95451140b367', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:35 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7e19a0c1-badd-425b-85bb-1ed9d186b0ca tempest-VolumesMetadataTest-1131745711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7cc8a3e-8434-49d6-94ea-7154f8fc0d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:35 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-7e19a0c1-badd-425b-85bb-1ed9d186b0ca tempest-VolumesMetadataTest-1131745711 None] Volume volume-6419d57b-544a-4459-900a-95451140b367 (6419d57b-544a-4459-900a-95451140b367): created successfully Sep 25 11:55:35 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7e19a0c1-badd-425b-85bb-1ed9d186b0ca tempest-VolumesMetadataTest-1131745711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7cc8a3e-8434-49d6-94ea-7154f8fc0d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:35 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7e19a0c1-badd-425b-85bb-1ed9d186b0ca tempest-VolumesMetadataTest-1131745711 None] Flow 'volume_create_manager' (1848ca6b-617d-48fe-9703-2dee51930a75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:55:35 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-7e19a0c1-badd-425b-85bb-1ed9d186b0ca tempest-VolumesMetadataTest-1131745711 None] Created volume successfully. Sep 25 11:55:37 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-98f57445-3c0f-463d-8544-5183bbac7ff5 tempest-VolumesMetadataTest-1131745711 None] Acquiring lock "cinder-6419d57b-544a-4459-900a-95451140b367-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:55:37 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-98f57445-3c0f-463d-8544-5183bbac7ff5 tempest-VolumesMetadataTest-1131745711 None] Lock "cinder-6419d57b-544a-4459-900a-95451140b367-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:55:37 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-98f57445-3c0f-463d-8544-5183bbac7ff5 tempest-VolumesMetadataTest-1131745711 None] Acquiring lock "cinder-quobyte-6419d57b-544a-4459-900a-95451140b367" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:55:37 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-98f57445-3c0f-463d-8544-5183bbac7ff5 tempest-VolumesMetadataTest-1131745711 None] Lock "cinder-quobyte-6419d57b-544a-4459-900a-95451140b367" acquired by "delete_volume" :: waited 0.016s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:55:37 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[50dd9075-0fe4-4015-b638-f8c4075e6a29]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:55:37 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-98f57445-3c0f-463d-8544-5183bbac7ff5 tempest-VolumesMetadataTest-1131745711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6419d57b-544a-4459-900a-95451140b367 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:37 devstack sudo[102437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6419d57b-544a-4459-900a-95451140b367 Sep 25 11:55:37 devstack sudo[102437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:37 devstack sudo[102437]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:37 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-98f57445-3c0f-463d-8544-5183bbac7ff5 tempest-VolumesMetadataTest-1131745711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6419d57b-544a-4459-900a-95451140b367" returned: 0 in 0.465s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:37 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-98f57445-3c0f-463d-8544-5183bbac7ff5 tempest-VolumesMetadataTest-1131745711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6419d57b-544a-4459-900a-95451140b367 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:37 devstack sudo[102442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6419d57b-544a-4459-900a-95451140b367 Sep 25 11:55:37 devstack sudo[102442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:38 devstack sudo[102442]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-98f57445-3c0f-463d-8544-5183bbac7ff5 tempest-VolumesMetadataTest-1131745711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6419d57b-544a-4459-900a-95451140b367" returned: 0 in 0.304s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:38 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-98f57445-3c0f-463d-8544-5183bbac7ff5 tempest-VolumesMetadataTest-1131745711 None] Lock "cinder-quobyte-6419d57b-544a-4459-900a-95451140b367" released by "delete_volume" :: held 0.820s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:55:38 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-98f57445-3c0f-463d-8544-5183bbac7ff5 tempest-VolumesMetadataTest-1131745711 None] Created reservations ['77ef2311-c4e6-497d-b2b1-1135175acacc', '63d68e49-9d1a-4003-881c-4fb9623726a5', '6a425767-1ef7-42d3-a50a-262340c03d8f', 'a526024a-669a-4546-b56c-1404483027ee'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:55:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-98f57445-3c0f-463d-8544-5183bbac7ff5 tempest-VolumesMetadataTest-1131745711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:55:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-98f57445-3c0f-463d-8544-5183bbac7ff5 tempest-VolumesMetadataTest-1131745711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:55:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-98f57445-3c0f-463d-8544-5183bbac7ff5 tempest-VolumesMetadataTest-1131745711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:55:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-98f57445-3c0f-463d-8544-5183bbac7ff5 tempest-VolumesMetadataTest-1131745711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:55:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-98f57445-3c0f-463d-8544-5183bbac7ff5 tempest-VolumesMetadataTest-1131745711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:55:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-98f57445-3c0f-463d-8544-5183bbac7ff5 tempest-VolumesMetadataTest-1131745711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:38 devstack sudo[102445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:55:38 devstack sudo[102445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:38 devstack cinder-volume[86984]: DEBUG oslo_service.periodic_task [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:55:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:55:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:55:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:55:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:55:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:55:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:38 devstack sudo[102447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:55:38 devstack sudo[102447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:38 devstack sudo[102445]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-98f57445-3c0f-463d-8544-5183bbac7ff5 tempest-VolumesMetadataTest-1131745711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.368s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:38 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-98f57445-3c0f-463d-8544-5183bbac7ff5 tempest-VolumesMetadataTest-1131745711 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:55:38 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-98f57445-3c0f-463d-8544-5183bbac7ff5 tempest-VolumesMetadataTest-1131745711 None] Deleted volume successfully. Sep 25 11:55:38 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-98f57445-3c0f-463d-8544-5183bbac7ff5 tempest-VolumesMetadataTest-1131745711 None] Lock "cinder-6419d57b-544a-4459-900a-95451140b367-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:55:39 devstack sudo[102447]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.446s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:39 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:55:39 devstack cinder-volume[86984]: DEBUG oslo_service.periodic_task [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running periodic task VolumeManager._thread_info {{(pid=86984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:55:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] thread count: 28 {{(pid=86984) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 11:55:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] thread info: [<_MainThread(MainThread, started 132046492332160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86984) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 11:55:43 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e06d143-cff9-4c92-85f3-816988aa390d tempest-VolumesNegativeTest-199819350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:55:43 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7e06d143-cff9-4c92-85f3-816988aa390d tempest-VolumesNegativeTest-199819350 None] Flow 'volume_create_manager' (46305ef7-2d19-4cda-aa8f-69cd87e66b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:55:43 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7e06d143-cff9-4c92-85f3-816988aa390d tempest-VolumesNegativeTest-199819350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c527ba8-31c9-41e0-a3ca-a759610ec321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:43 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7e06d143-cff9-4c92-85f3-816988aa390d tempest-VolumesNegativeTest-199819350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c527ba8-31c9-41e0-a3ca-a759610ec321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:55:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-405984467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=049a7d11-5ca1-4fa3-a7ac-c9191b460b1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa19b1db29354a359e2a9ccfdffd66dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:55:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:55:43Z,use_quota=True,user_id='d70c13dcab3b41d59ad7eec93a644153',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:43 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7e06d143-cff9-4c92-85f3-816988aa390d tempest-VolumesNegativeTest-199819350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbe78e9f-f759-4129-9d02-95d22e70aff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:43 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7e06d143-cff9-4c92-85f3-816988aa390d tempest-VolumesNegativeTest-199819350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbe78e9f-f759-4129-9d02-95d22e70aff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:43 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7e06d143-cff9-4c92-85f3-816988aa390d tempest-VolumesNegativeTest-199819350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c211f7f5-3e64-41f0-98a5-10db26852172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:43 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7e06d143-cff9-4c92-85f3-816988aa390d tempest-VolumesNegativeTest-199819350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c211f7f5-3e64-41f0-98a5-10db26852172) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '049a7d11-5ca1-4fa3-a7ac-c9191b460b1b', 'volume_name': 'volume-049a7d11-5ca1-4fa3-a7ac-c9191b460b1b', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:43 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7e06d143-cff9-4c92-85f3-816988aa390d tempest-VolumesNegativeTest-199819350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (627d79a5-f984-4af3-b505-6e57d08c1ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:43 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7e06d143-cff9-4c92-85f3-816988aa390d tempest-VolumesNegativeTest-199819350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (627d79a5-f984-4af3-b505-6e57d08c1ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:43 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7e06d143-cff9-4c92-85f3-816988aa390d tempest-VolumesNegativeTest-199819350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8367ec0f-3164-4d3a-8f1d-baa225341ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:43 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-7e06d143-cff9-4c92-85f3-816988aa390d tempest-VolumesNegativeTest-199819350 None] Volume 049a7d11-5ca1-4fa3-a7ac-c9191b460b1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-049a7d11-5ca1-4fa3-a7ac-c9191b460b1b', 'volume_size': 1} Sep 25 11:55:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-7e06d143-cff9-4c92-85f3-816988aa390d tempest-VolumesNegativeTest-199819350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:55:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-7e06d143-cff9-4c92-85f3-816988aa390d tempest-VolumesNegativeTest-199819350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:55:43 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-7e06d143-cff9-4c92-85f3-816988aa390d tempest-VolumesNegativeTest-199819350 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:55:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-405984467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=049a7d11-5ca1-4fa3-a7ac-c9191b460b1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa19b1db29354a359e2a9ccfdffd66dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:55:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:55:43Z,use_quota=True,user_id='d70c13dcab3b41d59ad7eec93a644153',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:55:43 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-7e06d143-cff9-4c92-85f3-816988aa390d tempest-VolumesNegativeTest-199819350 None] Creating volume 049a7d11-5ca1-4fa3-a7ac-c9191b460b1b {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:55:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-7e06d143-cff9-4c92-85f3-816988aa390d tempest-VolumesNegativeTest-199819350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:55:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-7e06d143-cff9-4c92-85f3-816988aa390d tempest-VolumesNegativeTest-199819350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:55:43 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-7e06d143-cff9-4c92-85f3-816988aa390d tempest-VolumesNegativeTest-199819350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:55:43 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-7e06d143-cff9-4c92-85f3-816988aa390d tempest-VolumesNegativeTest-199819350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:55:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-7e06d143-cff9-4c92-85f3-816988aa390d tempest-VolumesNegativeTest-199819350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:55:43 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-7e06d143-cff9-4c92-85f3-816988aa390d tempest-VolumesNegativeTest-199819350 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:55:43 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-7e06d143-cff9-4c92-85f3-816988aa390d tempest-VolumesNegativeTest-199819350 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:55:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7e06d143-cff9-4c92-85f3-816988aa390d tempest-VolumesNegativeTest-199819350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-049a7d11-5ca1-4fa3-a7ac-c9191b460b1b 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:43 devstack sudo[102491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-049a7d11-5ca1-4fa3-a7ac-c9191b460b1b 1073741824 Sep 25 11:55:43 devstack sudo[102491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:44 devstack sudo[102491]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7e06d143-cff9-4c92-85f3-816988aa390d tempest-VolumesNegativeTest-199819350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-049a7d11-5ca1-4fa3-a7ac-c9191b460b1b 1073741824" returned: 0 in 0.507s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7e06d143-cff9-4c92-85f3-816988aa390d tempest-VolumesNegativeTest-199819350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-049a7d11-5ca1-4fa3-a7ac-c9191b460b1b {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:55:44 devstack sudo[102497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-049a7d11-5ca1-4fa3-a7ac-c9191b460b1b Sep 25 11:55:44 devstack sudo[102497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:55:44 devstack sudo[102497]: pam_unix(sudo:session): session closed for user root Sep 25 11:55:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7e06d143-cff9-4c92-85f3-816988aa390d tempest-VolumesNegativeTest-199819350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-049a7d11-5ca1-4fa3-a7ac-c9191b460b1b" returned: 0 in 0.321s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:55:44 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-7e06d143-cff9-4c92-85f3-816988aa390d tempest-VolumesNegativeTest-199819350 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:55:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-7e06d143-cff9-4c92-85f3-816988aa390d tempest-VolumesNegativeTest-199819350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:55:44 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7e06d143-cff9-4c92-85f3-816988aa390d tempest-VolumesNegativeTest-199819350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8367ec0f-3164-4d3a-8f1d-baa225341ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-049a7d11-5ca1-4fa3-a7ac-c9191b460b1b', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:44 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7e06d143-cff9-4c92-85f3-816988aa390d tempest-VolumesNegativeTest-199819350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6153db9-3fce-4bac-bea5-d26e9b3817ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:55:44 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-7e06d143-cff9-4c92-85f3-816988aa390d tempest-VolumesNegativeTest-199819350 None] Volume volume-049a7d11-5ca1-4fa3-a7ac-c9191b460b1b (049a7d11-5ca1-4fa3-a7ac-c9191b460b1b): created successfully Sep 25 11:55:44 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7e06d143-cff9-4c92-85f3-816988aa390d tempest-VolumesNegativeTest-199819350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6153db9-3fce-4bac-bea5-d26e9b3817ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:55:44 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7e06d143-cff9-4c92-85f3-816988aa390d tempest-VolumesNegativeTest-199819350 None] Flow 'volume_create_manager' (46305ef7-2d19-4cda-aa8f-69cd87e66b22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:55:44 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-7e06d143-cff9-4c92-85f3-816988aa390d tempest-VolumesNegativeTest-199819350 None] Created volume successfully. Sep 25 11:55:54 devstack cinder-volume[86984]: DEBUG dbcounter [-] [86984] Writing DB stats cinder:SELECT=29,cinder:INSERT=11,cinder:UPDATE=45,cinder:DELETE=1 {{(pid=86984) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:55:54 devstack cinder-volume[86984]: DEBUG dbcounter [-] [86984] Writing DB stats cinder:INSERT=11,cinder:UPDATE=40,cinder:SELECT=22,cinder:DELETE=5 {{(pid=86984) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:55:57 devstack cinder-volume[86984]: INFO cinder.volume.manager [req-c57d6bae-a609-4aae-a08e-780857f0c590 req-30132743-231c-483d-aa35-9bdee0bfe9a3 tempest-TestShelveInstance-101884204 None] Terminate volume connection completed successfully. Sep 25 11:55:57 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [req-c57d6bae-a609-4aae-a08e-780857f0c590 req-30132743-231c-483d-aa35-9bdee0bfe9a3 tempest-TestShelveInstance-101884204 None] Deleting attachment e1a73daa-ebe7-4f6d-81c3-d87149f2c6f0. {{(pid=86984) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 11:56:00 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-82ba62b2-9dfb-4fa2-9840-4cde75e8dc93 req-7367dbb9-36b9-4f4e-8e5b-373a9d52e10d tempest-TestShelveInstance-101884204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:56:00 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-82ba62b2-9dfb-4fa2-9840-4cde75e8dc93 req-7367dbb9-36b9-4f4e-8e5b-373a9d52e10d tempest-TestShelveInstance-101884204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:56:00 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-82ba62b2-9dfb-4fa2-9840-4cde75e8dc93 req-7367dbb9-36b9-4f4e-8e5b-373a9d52e10d tempest-TestShelveInstance-101884204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:56:00 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [req-82ba62b2-9dfb-4fa2-9840-4cde75e8dc93 req-7367dbb9-36b9-4f4e-8e5b-373a9d52e10d tempest-TestShelveInstance-101884204 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba', 'name': 'volume-afefdf65-66cb-4acc-a2b7-9a1b2e0f8d13', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3c2b92e2-c106-4ee6-9f0f-f0072a6224d9', 'enforce_multipath': True} {{(pid=86984) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 11:56:00 devstack cinder-volume[86984]: INFO cinder.volume.manager [req-82ba62b2-9dfb-4fa2-9840-4cde75e8dc93 req-7367dbb9-36b9-4f4e-8e5b-373a9d52e10d tempest-TestShelveInstance-101884204 None] attachment_update completed successfully. Sep 25 11:56:07 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-cb660890-e9e7-4409-9c2c-3e64a10236ae tempest-VolumesNegativeTest-199819350 None] Acquiring lock "cinder-049a7d11-5ca1-4fa3-a7ac-c9191b460b1b-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:56:07 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-cb660890-e9e7-4409-9c2c-3e64a10236ae tempest-VolumesNegativeTest-199819350 None] Lock "cinder-049a7d11-5ca1-4fa3-a7ac-c9191b460b1b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:56:07 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-cb660890-e9e7-4409-9c2c-3e64a10236ae tempest-VolumesNegativeTest-199819350 None] Acquiring lock "cinder-quobyte-049a7d11-5ca1-4fa3-a7ac-c9191b460b1b" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:56:07 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-cb660890-e9e7-4409-9c2c-3e64a10236ae tempest-VolumesNegativeTest-199819350 None] Lock "cinder-quobyte-049a7d11-5ca1-4fa3-a7ac-c9191b460b1b" acquired by "delete_volume" :: waited 0.019s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:56:07 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[829c7ab2-5705-42dd-92c0-7e11d33ac158]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:56:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cb660890-e9e7-4409-9c2c-3e64a10236ae tempest-VolumesNegativeTest-199819350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-049a7d11-5ca1-4fa3-a7ac-c9191b460b1b {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:07 devstack sudo[103215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-049a7d11-5ca1-4fa3-a7ac-c9191b460b1b Sep 25 11:56:07 devstack sudo[103215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:08 devstack sudo[103215]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cb660890-e9e7-4409-9c2c-3e64a10236ae tempest-VolumesNegativeTest-199819350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-049a7d11-5ca1-4fa3-a7ac-c9191b460b1b" returned: 0 in 0.540s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cb660890-e9e7-4409-9c2c-3e64a10236ae tempest-VolumesNegativeTest-199819350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-049a7d11-5ca1-4fa3-a7ac-c9191b460b1b {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:08 devstack sudo[103220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-049a7d11-5ca1-4fa3-a7ac-c9191b460b1b Sep 25 11:56:08 devstack sudo[103220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:08 devstack sudo[103220]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cb660890-e9e7-4409-9c2c-3e64a10236ae tempest-VolumesNegativeTest-199819350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-049a7d11-5ca1-4fa3-a7ac-c9191b460b1b" returned: 0 in 0.310s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:08 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-cb660890-e9e7-4409-9c2c-3e64a10236ae tempest-VolumesNegativeTest-199819350 None] Lock "cinder-quobyte-049a7d11-5ca1-4fa3-a7ac-c9191b460b1b" released by "delete_volume" :: held 0.905s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:56:08 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-cb660890-e9e7-4409-9c2c-3e64a10236ae tempest-VolumesNegativeTest-199819350 None] Created reservations ['739ac76e-f4b1-409b-99cb-9530b8f3549e', '3f2b0c27-4c1c-47d8-bfa5-fa2b74810234', '0f893f03-68b4-446c-9b46-3fc836a98867', 'f8928e9d-3b39-42b7-bd44-601f195422b2'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:56:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-cb660890-e9e7-4409-9c2c-3e64a10236ae tempest-VolumesNegativeTest-199819350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:56:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-cb660890-e9e7-4409-9c2c-3e64a10236ae tempest-VolumesNegativeTest-199819350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:56:08 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-cb660890-e9e7-4409-9c2c-3e64a10236ae tempest-VolumesNegativeTest-199819350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:56:08 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-cb660890-e9e7-4409-9c2c-3e64a10236ae tempest-VolumesNegativeTest-199819350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:56:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-cb660890-e9e7-4409-9c2c-3e64a10236ae tempest-VolumesNegativeTest-199819350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:56:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cb660890-e9e7-4409-9c2c-3e64a10236ae tempest-VolumesNegativeTest-199819350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:08 devstack sudo[103223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:56:08 devstack sudo[103223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:09 devstack sudo[103223]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cb660890-e9e7-4409-9c2c-3e64a10236ae tempest-VolumesNegativeTest-199819350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.354s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:09 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-cb660890-e9e7-4409-9c2c-3e64a10236ae tempest-VolumesNegativeTest-199819350 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:56:09 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-cb660890-e9e7-4409-9c2c-3e64a10236ae tempest-VolumesNegativeTest-199819350 None] Deleted volume successfully. Sep 25 11:56:09 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-cb660890-e9e7-4409-9c2c-3e64a10236ae tempest-VolumesNegativeTest-199819350 None] Lock "cinder-049a7d11-5ca1-4fa3-a7ac-c9191b460b1b-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:56:19 devstack cinder-volume[86984]: DEBUG dbcounter [-] [86984] Writing DB stats cinder:SELECT=11,cinder:UPDATE=12,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86984) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:56:22 devstack cinder-volume[86984]: DEBUG dbcounter [-] [86984] Writing DB stats cinder:SELECT=15,cinder:UPDATE=8,cinder:INSERT=1 {{(pid=86984) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:56:37 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b79548a-d5b0-4514-b67a-40574bc6c599 tempest-TestInstancesWithCinderVolumes-1743152953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:56:37 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6b79548a-d5b0-4514-b67a-40574bc6c599 tempest-TestInstancesWithCinderVolumes-1743152953 None] Flow 'volume_create_manager' (75a684bd-506a-424a-88e0-e16dae31c469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:56:37 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6b79548a-d5b0-4514-b67a-40574bc6c599 tempest-TestInstancesWithCinderVolumes-1743152953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eefcbbd3-7c96-4037-b824-f087eeca60eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:56:37 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6b79548a-d5b0-4514-b67a-40574bc6c599 tempest-TestInstancesWithCinderVolumes-1743152953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eefcbbd3-7c96-4037-b824-f087eeca60eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:56:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1262680342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cb44c34-0495-4416-9baa-ea11d68e0505,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7968d904c220425bbebffaab45bf9134',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:56:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:56:38Z,use_quota=True,user_id='2b33415797b74bddad58193bf033eff1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(28d606e2-f8ea-4fc4-a48f-1f588f46a233),volume_type_id=28d606e2-f8ea-4fc4-a48f-1f588f46a233)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:56:37 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6b79548a-d5b0-4514-b67a-40574bc6c599 tempest-TestInstancesWithCinderVolumes-1743152953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c6da3b3-4954-4b32-b949-a8eb0f60f03b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:56:37 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6b79548a-d5b0-4514-b67a-40574bc6c599 tempest-TestInstancesWithCinderVolumes-1743152953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c6da3b3-4954-4b32-b949-a8eb0f60f03b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:56:37 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6b79548a-d5b0-4514-b67a-40574bc6c599 tempest-TestInstancesWithCinderVolumes-1743152953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c4f55f6-ec2f-4af2-b62c-121b007bf1f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:56:37 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6b79548a-d5b0-4514-b67a-40574bc6c599 tempest-TestInstancesWithCinderVolumes-1743152953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c4f55f6-ec2f-4af2-b62c-121b007bf1f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cb44c34-0495-4416-9baa-ea11d68e0505', 'volume_name': 'volume-9cb44c34-0495-4416-9baa-ea11d68e0505', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:56:37 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6b79548a-d5b0-4514-b67a-40574bc6c599 tempest-TestInstancesWithCinderVolumes-1743152953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (796017b3-9fe3-4b13-b5a4-b4ab75f32e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:56:37 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6b79548a-d5b0-4514-b67a-40574bc6c599 tempest-TestInstancesWithCinderVolumes-1743152953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (796017b3-9fe3-4b13-b5a4-b4ab75f32e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:56:37 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6b79548a-d5b0-4514-b67a-40574bc6c599 tempest-TestInstancesWithCinderVolumes-1743152953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfd3fb3b-bb35-4f37-8bd3-d901dd62e356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:56:37 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-6b79548a-d5b0-4514-b67a-40574bc6c599 tempest-TestInstancesWithCinderVolumes-1743152953 None] Volume 9cb44c34-0495-4416-9baa-ea11d68e0505: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cb44c34-0495-4416-9baa-ea11d68e0505', 'volume_size': 1} Sep 25 11:56:37 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-6b79548a-d5b0-4514-b67a-40574bc6c599 tempest-TestInstancesWithCinderVolumes-1743152953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:56:37 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-6b79548a-d5b0-4514-b67a-40574bc6c599 tempest-TestInstancesWithCinderVolumes-1743152953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:56:37 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-6b79548a-d5b0-4514-b67a-40574bc6c599 tempest-TestInstancesWithCinderVolumes-1743152953 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:56:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1262680342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cb44c34-0495-4416-9baa-ea11d68e0505,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7968d904c220425bbebffaab45bf9134',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:56:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:56:38Z,use_quota=True,user_id='2b33415797b74bddad58193bf033eff1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(28d606e2-f8ea-4fc4-a48f-1f588f46a233),volume_type_id=28d606e2-f8ea-4fc4-a48f-1f588f46a233)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:56:37 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-6b79548a-d5b0-4514-b67a-40574bc6c599 tempest-TestInstancesWithCinderVolumes-1743152953 None] Creating volume 9cb44c34-0495-4416-9baa-ea11d68e0505 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:56:37 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-6b79548a-d5b0-4514-b67a-40574bc6c599 tempest-TestInstancesWithCinderVolumes-1743152953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:56:37 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-6b79548a-d5b0-4514-b67a-40574bc6c599 tempest-TestInstancesWithCinderVolumes-1743152953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:56:37 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-6b79548a-d5b0-4514-b67a-40574bc6c599 tempest-TestInstancesWithCinderVolumes-1743152953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:56:37 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-6b79548a-d5b0-4514-b67a-40574bc6c599 tempest-TestInstancesWithCinderVolumes-1743152953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:56:37 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-6b79548a-d5b0-4514-b67a-40574bc6c599 tempest-TestInstancesWithCinderVolumes-1743152953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:56:37 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-6b79548a-d5b0-4514-b67a-40574bc6c599 tempest-TestInstancesWithCinderVolumes-1743152953 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:56:37 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-6b79548a-d5b0-4514-b67a-40574bc6c599 tempest-TestInstancesWithCinderVolumes-1743152953 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:56:37 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6b79548a-d5b0-4514-b67a-40574bc6c599 tempest-TestInstancesWithCinderVolumes-1743152953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9cb44c34-0495-4416-9baa-ea11d68e0505 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:37 devstack sudo[103271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9cb44c34-0495-4416-9baa-ea11d68e0505 1073741824 Sep 25 11:56:37 devstack sudo[103271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:38 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2bc8a0c-f47d-45b8-b124-a932e501df95 tempest-TestInstancesWithCinderVolumes-1743152953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:56:38 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-a2bc8a0c-f47d-45b8-b124-a932e501df95 tempest-TestInstancesWithCinderVolumes-1743152953 None] Flow 'volume_create_manager' (dcb2c7d0-61df-48a4-b807-1584cb639b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:56:38 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-a2bc8a0c-f47d-45b8-b124-a932e501df95 tempest-TestInstancesWithCinderVolumes-1743152953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bca6a0a-6563-4381-9b79-72ab6e98ce76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:56:38 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-a2bc8a0c-f47d-45b8-b124-a932e501df95 tempest-TestInstancesWithCinderVolumes-1743152953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bca6a0a-6563-4381-9b79-72ab6e98ce76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:56:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1363672847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fca96b2-0b3a-4db9-9af4-f894b392a561,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7968d904c220425bbebffaab45bf9134',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:56:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:56:38Z,use_quota=True,user_id='2b33415797b74bddad58193bf033eff1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6a16be23-1e4c-4275-8242-3d3bd45a485d),volume_type_id=6a16be23-1e4c-4275-8242-3d3bd45a485d)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:56:38 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-a2bc8a0c-f47d-45b8-b124-a932e501df95 tempest-TestInstancesWithCinderVolumes-1743152953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed355fa7-eb4b-4eed-ab76-bd5a40384b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:56:38 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-a2bc8a0c-f47d-45b8-b124-a932e501df95 tempest-TestInstancesWithCinderVolumes-1743152953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed355fa7-eb4b-4eed-ab76-bd5a40384b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:56:38 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-a2bc8a0c-f47d-45b8-b124-a932e501df95 tempest-TestInstancesWithCinderVolumes-1743152953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d965e80-e5c9-4345-9d22-97f5b53f0827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:56:38 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-a2bc8a0c-f47d-45b8-b124-a932e501df95 tempest-TestInstancesWithCinderVolumes-1743152953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d965e80-e5c9-4345-9d22-97f5b53f0827) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fca96b2-0b3a-4db9-9af4-f894b392a561', 'volume_name': 'volume-0fca96b2-0b3a-4db9-9af4-f894b392a561', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:56:38 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-a2bc8a0c-f47d-45b8-b124-a932e501df95 tempest-TestInstancesWithCinderVolumes-1743152953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db7f6f26-2484-497f-a2e8-29568cdf2702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:56:38 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-a2bc8a0c-f47d-45b8-b124-a932e501df95 tempest-TestInstancesWithCinderVolumes-1743152953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db7f6f26-2484-497f-a2e8-29568cdf2702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:56:38 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-a2bc8a0c-f47d-45b8-b124-a932e501df95 tempest-TestInstancesWithCinderVolumes-1743152953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13a90bd7-5da8-4cfe-b646-453a28b870d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:56:38 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-a2bc8a0c-f47d-45b8-b124-a932e501df95 tempest-TestInstancesWithCinderVolumes-1743152953 None] Volume 0fca96b2-0b3a-4db9-9af4-f894b392a561: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fca96b2-0b3a-4db9-9af4-f894b392a561', 'volume_size': 1} Sep 25 11:56:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-a2bc8a0c-f47d-45b8-b124-a932e501df95 tempest-TestInstancesWithCinderVolumes-1743152953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:56:38 devstack sudo[103271]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6b79548a-d5b0-4514-b67a-40574bc6c599 tempest-TestInstancesWithCinderVolumes-1743152953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9cb44c34-0495-4416-9baa-ea11d68e0505 1073741824" returned: 0 in 0.553s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6b79548a-d5b0-4514-b67a-40574bc6c599 tempest-TestInstancesWithCinderVolumes-1743152953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9cb44c34-0495-4416-9baa-ea11d68e0505 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:38 devstack sudo[103277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9cb44c34-0495-4416-9baa-ea11d68e0505 Sep 25 11:56:38 devstack sudo[103277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:38 devstack cinder-volume[86984]: DEBUG oslo_service.periodic_task [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:56:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:56:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:56:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:56:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:56:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:56:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:38 devstack sudo[103277]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6b79548a-d5b0-4514-b67a-40574bc6c599 tempest-TestInstancesWithCinderVolumes-1743152953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9cb44c34-0495-4416-9baa-ea11d68e0505" returned: 0 in 0.332s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-6b79548a-d5b0-4514-b67a-40574bc6c599 tempest-TestInstancesWithCinderVolumes-1743152953 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:56:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-6b79548a-d5b0-4514-b67a-40574bc6c599 tempest-TestInstancesWithCinderVolumes-1743152953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:56:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-a2bc8a0c-f47d-45b8-b124-a932e501df95 tempest-TestInstancesWithCinderVolumes-1743152953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.467s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:56:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-a2bc8a0c-f47d-45b8-b124-a932e501df95 tempest-TestInstancesWithCinderVolumes-1743152953 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:56:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1363672847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fca96b2-0b3a-4db9-9af4-f894b392a561,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7968d904c220425bbebffaab45bf9134',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:56:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:56:38Z,use_quota=True,user_id='2b33415797b74bddad58193bf033eff1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6a16be23-1e4c-4275-8242-3d3bd45a485d),volume_type_id=6a16be23-1e4c-4275-8242-3d3bd45a485d)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:56:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-a2bc8a0c-f47d-45b8-b124-a932e501df95 tempest-TestInstancesWithCinderVolumes-1743152953 None] Creating volume 0fca96b2-0b3a-4db9-9af4-f894b392a561 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:56:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-a2bc8a0c-f47d-45b8-b124-a932e501df95 tempest-TestInstancesWithCinderVolumes-1743152953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:56:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-a2bc8a0c-f47d-45b8-b124-a932e501df95 tempest-TestInstancesWithCinderVolumes-1743152953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:56:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-a2bc8a0c-f47d-45b8-b124-a932e501df95 tempest-TestInstancesWithCinderVolumes-1743152953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:56:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-a2bc8a0c-f47d-45b8-b124-a932e501df95 tempest-TestInstancesWithCinderVolumes-1743152953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:56:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-a2bc8a0c-f47d-45b8-b124-a932e501df95 tempest-TestInstancesWithCinderVolumes-1743152953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:56:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-a2bc8a0c-f47d-45b8-b124-a932e501df95 tempest-TestInstancesWithCinderVolumes-1743152953 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:56:38 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-a2bc8a0c-f47d-45b8-b124-a932e501df95 tempest-TestInstancesWithCinderVolumes-1743152953 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:56:38 devstack sudo[103280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:56:38 devstack sudo[103280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a2bc8a0c-f47d-45b8-b124-a932e501df95 tempest-TestInstancesWithCinderVolumes-1743152953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0fca96b2-0b3a-4db9-9af4-f894b392a561 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:38 devstack sudo[103282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0fca96b2-0b3a-4db9-9af4-f894b392a561 1073741824 Sep 25 11:56:38 devstack sudo[103282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:38 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6b79548a-d5b0-4514-b67a-40574bc6c599 tempest-TestInstancesWithCinderVolumes-1743152953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfd3fb3b-bb35-4f37-8bd3-d901dd62e356) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cb44c34-0495-4416-9baa-ea11d68e0505', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:56:38 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6b79548a-d5b0-4514-b67a-40574bc6c599 tempest-TestInstancesWithCinderVolumes-1743152953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (915b5033-bec0-4d64-aea1-fe3ea655eca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:56:38 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-6b79548a-d5b0-4514-b67a-40574bc6c599 tempest-TestInstancesWithCinderVolumes-1743152953 None] Volume volume-9cb44c34-0495-4416-9baa-ea11d68e0505 (9cb44c34-0495-4416-9baa-ea11d68e0505): created successfully Sep 25 11:56:38 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6b79548a-d5b0-4514-b67a-40574bc6c599 tempest-TestInstancesWithCinderVolumes-1743152953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (915b5033-bec0-4d64-aea1-fe3ea655eca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:56:38 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6b79548a-d5b0-4514-b67a-40574bc6c599 tempest-TestInstancesWithCinderVolumes-1743152953 None] Flow 'volume_create_manager' (75a684bd-506a-424a-88e0-e16dae31c469) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:56:38 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-6b79548a-d5b0-4514-b67a-40574bc6c599 tempest-TestInstancesWithCinderVolumes-1743152953 None] Created volume successfully. Sep 25 11:56:38 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-8956c7c1-f2cb-4ac9-aac1-14942198dd7c tempest-TestInstancesWithCinderVolumes-1743152953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:56:38 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8956c7c1-f2cb-4ac9-aac1-14942198dd7c tempest-TestInstancesWithCinderVolumes-1743152953 None] Flow 'volume_create_manager' (aae28471-44c1-4120-bb6c-f5bef1f4f331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:56:38 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8956c7c1-f2cb-4ac9-aac1-14942198dd7c tempest-TestInstancesWithCinderVolumes-1743152953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0da5c34d-ad10-4f0a-a9ba-19809173ded5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:56:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8956c7c1-f2cb-4ac9-aac1-14942198dd7c tempest-TestInstancesWithCinderVolumes-1743152953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0da5c34d-ad10-4f0a-a9ba-19809173ded5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:56:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1174992493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50f5bb77-b8a5-4e1e-b25c-d12019e2cb4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7968d904c220425bbebffaab45bf9134',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:56:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:56:39Z,use_quota=True,user_id='2b33415797b74bddad58193bf033eff1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e06eeb6-87bc-4fc1-b38b-bd52f046571d),volume_type_id=6e06eeb6-87bc-4fc1-b38b-bd52f046571d)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:56:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8956c7c1-f2cb-4ac9-aac1-14942198dd7c tempest-TestInstancesWithCinderVolumes-1743152953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad2b61ae-0bb5-4f97-bf5b-f829249d6746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:56:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8956c7c1-f2cb-4ac9-aac1-14942198dd7c tempest-TestInstancesWithCinderVolumes-1743152953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad2b61ae-0bb5-4f97-bf5b-f829249d6746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:56:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8956c7c1-f2cb-4ac9-aac1-14942198dd7c tempest-TestInstancesWithCinderVolumes-1743152953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9da0ce75-bb1b-47e4-8169-dfe32863cb30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:56:39 devstack cinder-volume[86984]: DEBUG cinder.image.glance [None req-8956c7c1-f2cb-4ac9-aac1-14942198dd7c tempest-TestInstancesWithCinderVolumes-1743152953 None] Creating Keystone auth plugin from conf {{(pid=86984) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 11:56:39 devstack sudo[103280]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.436s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:39 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:56:39 devstack cinder-volume[86984]: DEBUG oslo_service.periodic_task [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running periodic task VolumeManager._thread_info {{(pid=86984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:56:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] thread count: 28 {{(pid=86984) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 11:56:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] thread info: [<_MainThread(MainThread, started 132046492332160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86984) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 11:56:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8956c7c1-f2cb-4ac9-aac1-14942198dd7c tempest-TestInstancesWithCinderVolumes-1743152953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9da0ce75-bb1b-47e4-8169-dfe32863cb30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '50f5bb77-b8a5-4e1e-b25c-d12019e2cb4b', 'volume_name': 'volume-50f5bb77-b8a5-4e1e-b25c-d12019e2cb4b', 'volume_size': 1, 'image_id': '2b4f8c4d-1412-4382-89bb-a748b16b3820', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2b4f8c4d-1412-4382-89bb-a748b16b3820', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1495324592', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7968d904c220425bbebffaab45bf9134', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2b4f8c4d-1412-4382-89bb-a748b16b3820', 'created_at': datetime.datetime(2026, 9, 25, 9, 56, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 56, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2b4f8c4d-1412-4382-89bb-a748b16b3820/file', 'properties': {}}, 'image_service': }' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:56:39 devstack sudo[103282]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8956c7c1-f2cb-4ac9-aac1-14942198dd7c tempest-TestInstancesWithCinderVolumes-1743152953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcd61fec-84a4-4fc1-86ea-3c26ef4005c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:56:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8956c7c1-f2cb-4ac9-aac1-14942198dd7c tempest-TestInstancesWithCinderVolumes-1743152953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcd61fec-84a4-4fc1-86ea-3c26ef4005c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:56:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8956c7c1-f2cb-4ac9-aac1-14942198dd7c tempest-TestInstancesWithCinderVolumes-1743152953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1e5b271-a44a-4415-8c42-087b0fcfcc31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:56:39 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-8956c7c1-f2cb-4ac9-aac1-14942198dd7c tempest-TestInstancesWithCinderVolumes-1743152953 None] Volume 50f5bb77-b8a5-4e1e-b25c-d12019e2cb4b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-50f5bb77-b8a5-4e1e-b25c-d12019e2cb4b', 'volume_size': 1, 'image_id': '2b4f8c4d-1412-4382-89bb-a748b16b3820', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2b4f8c4d-1412-4382-89bb-a748b16b3820', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1495324592', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7968d904c220425bbebffaab45bf9134', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2b4f8c4d-1412-4382-89bb-a748b16b3820', 'created_at': datetime.datetime(2026, 9, 25, 9, 56, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 56, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2b4f8c4d-1412-4382-89bb-a748b16b3820/file', 'properties': {}}, 'image_service': } Sep 25 11:56:39 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-8956c7c1-f2cb-4ac9-aac1-14942198dd7c tempest-TestInstancesWithCinderVolumes-1743152953 None] Trying to clone 50f5bb77-b8a5-4e1e-b25c-d12019e2cb4b from image 2b4f8c4d-1412-4382-89bb-a748b16b3820 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2b4f8c4d-1412-4382-89bb-a748b16b3820', 'metadata': {}}]). {{(pid=86984) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 11:56:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a2bc8a0c-f47d-45b8-b124-a932e501df95 tempest-TestInstancesWithCinderVolumes-1743152953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0fca96b2-0b3a-4db9-9af4-f894b392a561 1073741824" returned: 0 in 0.596s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a2bc8a0c-f47d-45b8-b124-a932e501df95 tempest-TestInstancesWithCinderVolumes-1743152953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0fca96b2-0b3a-4db9-9af4-f894b392a561 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:39 devstack sudo[103292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0fca96b2-0b3a-4db9-9af4-f894b392a561 Sep 25 11:56:39 devstack sudo[103292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:39 devstack sudo[103292]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a2bc8a0c-f47d-45b8-b124-a932e501df95 tempest-TestInstancesWithCinderVolumes-1743152953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0fca96b2-0b3a-4db9-9af4-f894b392a561" returned: 0 in 0.301s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:39 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-a2bc8a0c-f47d-45b8-b124-a932e501df95 tempest-TestInstancesWithCinderVolumes-1743152953 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:56:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-a2bc8a0c-f47d-45b8-b124-a932e501df95 tempest-TestInstancesWithCinderVolumes-1743152953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:56:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-a2bc8a0c-f47d-45b8-b124-a932e501df95 tempest-TestInstancesWithCinderVolumes-1743152953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13a90bd7-5da8-4cfe-b646-453a28b870d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fca96b2-0b3a-4db9-9af4-f894b392a561', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:56:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-a2bc8a0c-f47d-45b8-b124-a932e501df95 tempest-TestInstancesWithCinderVolumes-1743152953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbfa4287-9364-455c-8fc0-d6ddacf0124c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:56:39 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-a2bc8a0c-f47d-45b8-b124-a932e501df95 tempest-TestInstancesWithCinderVolumes-1743152953 None] Volume volume-0fca96b2-0b3a-4db9-9af4-f894b392a561 (0fca96b2-0b3a-4db9-9af4-f894b392a561): created successfully Sep 25 11:56:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-a2bc8a0c-f47d-45b8-b124-a932e501df95 tempest-TestInstancesWithCinderVolumes-1743152953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbfa4287-9364-455c-8fc0-d6ddacf0124c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:56:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-a2bc8a0c-f47d-45b8-b124-a932e501df95 tempest-TestInstancesWithCinderVolumes-1743152953 None] Flow 'volume_create_manager' (dcb2c7d0-61df-48a4-b807-1584cb639b2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:56:39 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-a2bc8a0c-f47d-45b8-b124-a932e501df95 tempest-TestInstancesWithCinderVolumes-1743152953 None] Created volume successfully. Sep 25 11:56:42 devstack cinder-volume[86984]: DEBUG cinder.image.image_utils [None req-8956c7c1-f2cb-4ac9-aac1-14942198dd7c tempest-TestInstancesWithCinderVolumes-1743152953 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2b4f8c4d-1412-4382-89bb-a748b16b3820_sm41vlatdevstack@QuobyteHD, size 20.69 MB, duration 3.16 sec {{(pid=86984) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 11:56:42 devstack cinder-volume[86984]: INFO cinder.image.image_utils [None req-8956c7c1-f2cb-4ac9-aac1-14942198dd7c tempest-TestInstancesWithCinderVolumes-1743152953 None] Image download 20.69 MB at 6.54 MB/s Sep 25 11:56:42 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf38024-9373-4ae0-9fca-e7176eb71ad7]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:56:42 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8956c7c1-f2cb-4ac9-aac1-14942198dd7c tempest-TestInstancesWithCinderVolumes-1743152953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2b4f8c4d-1412-4382-89bb-a748b16b3820_sm41vlatdevstack@QuobyteHD {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:42 devstack sudo[103298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2b4f8c4d-1412-4382-89bb-a748b16b3820_sm41vlatdevstack@QuobyteHD Sep 25 11:56:42 devstack sudo[103298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:42 devstack sudo[103298]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:42 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8956c7c1-f2cb-4ac9-aac1-14942198dd7c tempest-TestInstancesWithCinderVolumes-1743152953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2b4f8c4d-1412-4382-89bb-a748b16b3820_sm41vlatdevstack@QuobyteHD" returned: 0 in 0.348s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:42 devstack cinder-volume[86984]: DEBUG cinder.image.image_utils [None req-8956c7c1-f2cb-4ac9-aac1-14942198dd7c tempest-TestInstancesWithCinderVolumes-1743152953 None] Temporary image 2b4f8c4d-1412-4382-89bb-a748b16b3820 is fetched for user 2b33415797b74bddad58193bf033eff1. {{(pid=86984) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 11:56:42 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[000025da-037e-42a3-bbb0-e30207356ff8]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:56:42 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8956c7c1-f2cb-4ac9-aac1-14942198dd7c tempest-TestInstancesWithCinderVolumes-1743152953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2b4f8c4d-1412-4382-89bb-a748b16b3820_sm41vlatdevstack@QuobyteHD {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:43 devstack sudo[103303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2b4f8c4d-1412-4382-89bb-a748b16b3820_sm41vlatdevstack@QuobyteHD Sep 25 11:56:43 devstack sudo[103303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:43 devstack sudo[103303]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8956c7c1-f2cb-4ac9-aac1-14942198dd7c tempest-TestInstancesWithCinderVolumes-1743152953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2b4f8c4d-1412-4382-89bb-a748b16b3820_sm41vlatdevstack@QuobyteHD" returned: 0 in 0.394s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-8956c7c1-f2cb-4ac9-aac1-14942198dd7c tempest-TestInstancesWithCinderVolumes-1743152953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:56:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-8956c7c1-f2cb-4ac9-aac1-14942198dd7c tempest-TestInstancesWithCinderVolumes-1743152953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:56:43 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-8956c7c1-f2cb-4ac9-aac1-14942198dd7c tempest-TestInstancesWithCinderVolumes-1743152953 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:56:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1174992493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50f5bb77-b8a5-4e1e-b25c-d12019e2cb4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7968d904c220425bbebffaab45bf9134',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:56:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:56:39Z,use_quota=True,user_id='2b33415797b74bddad58193bf033eff1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e06eeb6-87bc-4fc1-b38b-bd52f046571d),volume_type_id=6e06eeb6-87bc-4fc1-b38b-bd52f046571d)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:56:43 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-8956c7c1-f2cb-4ac9-aac1-14942198dd7c tempest-TestInstancesWithCinderVolumes-1743152953 None] Creating volume 50f5bb77-b8a5-4e1e-b25c-d12019e2cb4b {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:56:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-8956c7c1-f2cb-4ac9-aac1-14942198dd7c tempest-TestInstancesWithCinderVolumes-1743152953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:56:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-8956c7c1-f2cb-4ac9-aac1-14942198dd7c tempest-TestInstancesWithCinderVolumes-1743152953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:56:43 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-8956c7c1-f2cb-4ac9-aac1-14942198dd7c tempest-TestInstancesWithCinderVolumes-1743152953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:56:43 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-8956c7c1-f2cb-4ac9-aac1-14942198dd7c tempest-TestInstancesWithCinderVolumes-1743152953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:56:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-8956c7c1-f2cb-4ac9-aac1-14942198dd7c tempest-TestInstancesWithCinderVolumes-1743152953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:56:43 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-8956c7c1-f2cb-4ac9-aac1-14942198dd7c tempest-TestInstancesWithCinderVolumes-1743152953 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:56:43 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-8956c7c1-f2cb-4ac9-aac1-14942198dd7c tempest-TestInstancesWithCinderVolumes-1743152953 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:56:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8956c7c1-f2cb-4ac9-aac1-14942198dd7c tempest-TestInstancesWithCinderVolumes-1743152953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-50f5bb77-b8a5-4e1e-b25c-d12019e2cb4b 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:43 devstack sudo[103313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-50f5bb77-b8a5-4e1e-b25c-d12019e2cb4b 1073741824 Sep 25 11:56:43 devstack sudo[103313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:43 devstack sudo[103313]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8956c7c1-f2cb-4ac9-aac1-14942198dd7c tempest-TestInstancesWithCinderVolumes-1743152953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-50f5bb77-b8a5-4e1e-b25c-d12019e2cb4b 1073741824" returned: 0 in 0.551s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8956c7c1-f2cb-4ac9-aac1-14942198dd7c tempest-TestInstancesWithCinderVolumes-1743152953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-50f5bb77-b8a5-4e1e-b25c-d12019e2cb4b {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:43 devstack sudo[103320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-50f5bb77-b8a5-4e1e-b25c-d12019e2cb4b Sep 25 11:56:43 devstack sudo[103320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:44 devstack sudo[103320]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8956c7c1-f2cb-4ac9-aac1-14942198dd7c tempest-TestInstancesWithCinderVolumes-1743152953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-50f5bb77-b8a5-4e1e-b25c-d12019e2cb4b" returned: 0 in 0.346s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:44 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-8956c7c1-f2cb-4ac9-aac1-14942198dd7c tempest-TestInstancesWithCinderVolumes-1743152953 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:56:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-8956c7c1-f2cb-4ac9-aac1-14942198dd7c tempest-TestInstancesWithCinderVolumes-1743152953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:56:44 devstack cinder-volume[86984]: DEBUG cinder.volume.volume_utils [None req-8956c7c1-f2cb-4ac9-aac1-14942198dd7c tempest-TestInstancesWithCinderVolumes-1743152953 None] Attempting download of 2b4f8c4d-1412-4382-89bb-a748b16b3820 ((None, [{'url': 'file:///opt/stack/data/glance/images/2b4f8c4d-1412-4382-89bb-a748b16b3820', 'metadata': {}}])) to volume 50f5bb77-b8a5-4e1e-b25c-d12019e2cb4b. {{(pid=86984) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 11:56:44 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4bf9fd0-3f34-4a13-9e77-26d4f5a34634]: (4, 'raw') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:56:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8956c7c1-f2cb-4ac9-aac1-14942198dd7c tempest-TestInstancesWithCinderVolumes-1743152953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2b4f8c4d-1412-4382-89bb-a748b16b3820_7__xz7j5 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:44 devstack sudo[103325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2b4f8c4d-1412-4382-89bb-a748b16b3820_7__xz7j5 Sep 25 11:56:44 devstack sudo[103325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:44 devstack sudo[103325]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8956c7c1-f2cb-4ac9-aac1-14942198dd7c tempest-TestInstancesWithCinderVolumes-1743152953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2b4f8c4d-1412-4382-89bb-a748b16b3820_7__xz7j5" returned: 0 in 0.538s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8956c7c1-f2cb-4ac9-aac1-14942198dd7c tempest-TestInstancesWithCinderVolumes-1743152953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2b4f8c4d-1412-4382-89bb-a748b16b3820_7__xz7j5 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:45 devstack sudo[103334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2b4f8c4d-1412-4382-89bb-a748b16b3820_7__xz7j5 Sep 25 11:56:45 devstack sudo[103334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:45 devstack sudo[103334]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8956c7c1-f2cb-4ac9-aac1-14942198dd7c tempest-TestInstancesWithCinderVolumes-1743152953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2b4f8c4d-1412-4382-89bb-a748b16b3820_7__xz7j5" returned: 1 in 0.600s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8956c7c1-f2cb-4ac9-aac1-14942198dd7c tempest-TestInstancesWithCinderVolumes-1743152953 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2b4f8c4d-1412-4382-89bb-a748b16b3820_7__xz7j5' failed. Not Retrying. {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 11:56:45 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1e03b4-b8cf-4b8b-a96c-106bcc62ef7f]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:56:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8956c7c1-f2cb-4ac9-aac1-14942198dd7c tempest-TestInstancesWithCinderVolumes-1743152953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2b4f8c4d-1412-4382-89bb-a748b16b3820_sm41vlatdevstack@QuobyteHD {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:45 devstack sudo[103357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2b4f8c4d-1412-4382-89bb-a748b16b3820_sm41vlatdevstack@QuobyteHD Sep 25 11:56:45 devstack sudo[103357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:46 devstack sudo[103357]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8956c7c1-f2cb-4ac9-aac1-14942198dd7c tempest-TestInstancesWithCinderVolumes-1743152953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2b4f8c4d-1412-4382-89bb-a748b16b3820_sm41vlatdevstack@QuobyteHD" returned: 0 in 0.452s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:46 devstack cinder-volume[86984]: DEBUG cinder.image.image_utils [None req-8956c7c1-f2cb-4ac9-aac1-14942198dd7c tempest-TestInstancesWithCinderVolumes-1743152953 None] 2b4f8c4d-1412-4382-89bb-a748b16b3820 was qcow2, converting to qcow2 {{(pid=86984) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 11:56:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8956c7c1-f2cb-4ac9-aac1-14942198dd7c tempest-TestInstancesWithCinderVolumes-1743152953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2b4f8c4d-1412-4382-89bb-a748b16b3820_sm41vlatdevstack@QuobyteHD /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-50f5bb77-b8a5-4e1e-b25c-d12019e2cb4b {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:46 devstack sudo[103363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2b4f8c4d-1412-4382-89bb-a748b16b3820_sm41vlatdevstack@QuobyteHD /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-50f5bb77-b8a5-4e1e-b25c-d12019e2cb4b Sep 25 11:56:46 devstack sudo[103363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:46 devstack cinder-volume[86984]: INFO cinder.volume.manager [req-1fb72346-9ab0-44b0-9884-cb514d9cda8b req-3e33c6c4-ffbf-4cb3-96b0-0f4b360ba123 tempest-TestShelveInstance-101884204 None] Terminate volume connection completed successfully. Sep 25 11:56:46 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [req-1fb72346-9ab0-44b0-9884-cb514d9cda8b req-3e33c6c4-ffbf-4cb3-96b0-0f4b360ba123 tempest-TestShelveInstance-101884204 None] Deleting attachment 3c2b92e2-c106-4ee6-9f0f-f0072a6224d9. {{(pid=86984) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 11:56:46 devstack cinder-volume[86984]: DEBUG cinder.coordination [req-1fb72346-9ab0-44b0-9884-cb514d9cda8b req-25644501-aac2-49a3-94cb-eb7395d64436 tempest-TestShelveInstance-101884204 None] Acquiring lock "cinder-afefdf65-66cb-4acc-a2b7-9a1b2e0f8d13-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:56:46 devstack cinder-volume[86984]: DEBUG cinder.coordination [req-1fb72346-9ab0-44b0-9884-cb514d9cda8b req-25644501-aac2-49a3-94cb-eb7395d64436 tempest-TestShelveInstance-101884204 None] Lock "cinder-afefdf65-66cb-4acc-a2b7-9a1b2e0f8d13-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:56:46 devstack cinder-volume[86984]: DEBUG cinder.coordination [req-1fb72346-9ab0-44b0-9884-cb514d9cda8b req-25644501-aac2-49a3-94cb-eb7395d64436 tempest-TestShelveInstance-101884204 None] Acquiring lock "cinder-quobyte-afefdf65-66cb-4acc-a2b7-9a1b2e0f8d13" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:56:46 devstack cinder-volume[86984]: DEBUG cinder.coordination [req-1fb72346-9ab0-44b0-9884-cb514d9cda8b req-25644501-aac2-49a3-94cb-eb7395d64436 tempest-TestShelveInstance-101884204 None] Lock "cinder-quobyte-afefdf65-66cb-4acc-a2b7-9a1b2e0f8d13" acquired by "delete_volume" :: waited 0.028s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:56:46 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[e323837e-13c7-479a-a3d1-b97816bb409d]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:56:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [req-1fb72346-9ab0-44b0-9884-cb514d9cda8b req-25644501-aac2-49a3-94cb-eb7395d64436 tempest-TestShelveInstance-101884204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-afefdf65-66cb-4acc-a2b7-9a1b2e0f8d13 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:47 devstack sudo[103372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-afefdf65-66cb-4acc-a2b7-9a1b2e0f8d13 Sep 25 11:56:47 devstack sudo[103372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:47 devstack sudo[103372]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [req-1fb72346-9ab0-44b0-9884-cb514d9cda8b req-25644501-aac2-49a3-94cb-eb7395d64436 tempest-TestShelveInstance-101884204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-afefdf65-66cb-4acc-a2b7-9a1b2e0f8d13" returned: 0 in 0.562s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [req-1fb72346-9ab0-44b0-9884-cb514d9cda8b req-25644501-aac2-49a3-94cb-eb7395d64436 tempest-TestShelveInstance-101884204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-afefdf65-66cb-4acc-a2b7-9a1b2e0f8d13 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:47 devstack sudo[103377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-afefdf65-66cb-4acc-a2b7-9a1b2e0f8d13 Sep 25 11:56:47 devstack sudo[103377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:47 devstack sudo[103377]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [req-1fb72346-9ab0-44b0-9884-cb514d9cda8b req-25644501-aac2-49a3-94cb-eb7395d64436 tempest-TestShelveInstance-101884204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-afefdf65-66cb-4acc-a2b7-9a1b2e0f8d13" returned: 0 in 0.386s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:47 devstack cinder-volume[86984]: DEBUG cinder.coordination [req-1fb72346-9ab0-44b0-9884-cb514d9cda8b req-25644501-aac2-49a3-94cb-eb7395d64436 tempest-TestShelveInstance-101884204 None] Lock "cinder-quobyte-afefdf65-66cb-4acc-a2b7-9a1b2e0f8d13" released by "delete_volume" :: held 1.022s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:56:48 devstack cinder-volume[86984]: DEBUG cinder.quota [req-1fb72346-9ab0-44b0-9884-cb514d9cda8b req-25644501-aac2-49a3-94cb-eb7395d64436 tempest-TestShelveInstance-101884204 None] Created reservations ['bcc5e749-378a-4b2b-857b-f057b0252e70', '4d62d542-29f9-4477-99a5-3e2400b1faa0', '658b9903-1464-4ad9-b3ff-4039eaadf36a', '2f8385f4-6120-4dac-a52a-6ed0161a39c9'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:56:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-1fb72346-9ab0-44b0-9884-cb514d9cda8b req-25644501-aac2-49a3-94cb-eb7395d64436 tempest-TestShelveInstance-101884204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:56:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-1fb72346-9ab0-44b0-9884-cb514d9cda8b req-25644501-aac2-49a3-94cb-eb7395d64436 tempest-TestShelveInstance-101884204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:56:48 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [req-1fb72346-9ab0-44b0-9884-cb514d9cda8b req-25644501-aac2-49a3-94cb-eb7395d64436 tempest-TestShelveInstance-101884204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:56:48 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [req-1fb72346-9ab0-44b0-9884-cb514d9cda8b req-25644501-aac2-49a3-94cb-eb7395d64436 tempest-TestShelveInstance-101884204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:56:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-1fb72346-9ab0-44b0-9884-cb514d9cda8b req-25644501-aac2-49a3-94cb-eb7395d64436 tempest-TestShelveInstance-101884204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:56:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [req-1fb72346-9ab0-44b0-9884-cb514d9cda8b req-25644501-aac2-49a3-94cb-eb7395d64436 tempest-TestShelveInstance-101884204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:48 devstack sudo[103380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:56:48 devstack sudo[103380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:48 devstack sudo[103380]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [req-1fb72346-9ab0-44b0-9884-cb514d9cda8b req-25644501-aac2-49a3-94cb-eb7395d64436 tempest-TestShelveInstance-101884204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.321s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:48 devstack cinder-volume[86984]: DEBUG cinder.manager [req-1fb72346-9ab0-44b0-9884-cb514d9cda8b req-25644501-aac2-49a3-94cb-eb7395d64436 tempest-TestShelveInstance-101884204 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:56:48 devstack cinder-volume[86984]: INFO cinder.volume.manager [req-1fb72346-9ab0-44b0-9884-cb514d9cda8b req-25644501-aac2-49a3-94cb-eb7395d64436 tempest-TestShelveInstance-101884204 None] Deleted volume successfully. Sep 25 11:56:48 devstack cinder-volume[86984]: DEBUG cinder.coordination [req-1fb72346-9ab0-44b0-9884-cb514d9cda8b req-25644501-aac2-49a3-94cb-eb7395d64436 tempest-TestShelveInstance-101884204 None] Lock "cinder-afefdf65-66cb-4acc-a2b7-9a1b2e0f8d13-delete_volume" released by "delete_volume" :: held 1.647s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:56:48 devstack sudo[103363]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8956c7c1-f2cb-4ac9-aac1-14942198dd7c tempest-TestInstancesWithCinderVolumes-1743152953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2b4f8c4d-1412-4382-89bb-a748b16b3820_sm41vlatdevstack@QuobyteHD /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-50f5bb77-b8a5-4e1e-b25c-d12019e2cb4b" returned: 0 in 2.663s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:48 devstack cinder-volume[86984]: DEBUG cinder.image.image_utils [None req-8956c7c1-f2cb-4ac9-aac1-14942198dd7c tempest-TestInstancesWithCinderVolumes-1743152953 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2b4f8c4d-1412-4382-89bb-a748b16b3820_sm41vlatdevstack@QuobyteHD, size 112.00 MB, duration 2.67 sec, destination /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-50f5bb77-b8a5-4e1e-b25c-d12019e2cb4b {{(pid=86984) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 11:56:48 devstack cinder-volume[86984]: INFO cinder.image.image_utils [None req-8956c7c1-f2cb-4ac9-aac1-14942198dd7c tempest-TestInstancesWithCinderVolumes-1743152953 None] Converted 112.00 MB image at 42.00 MB/s Sep 25 11:56:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8956c7c1-f2cb-4ac9-aac1-14942198dd7c tempest-TestInstancesWithCinderVolumes-1743152953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-50f5bb77-b8a5-4e1e-b25c-d12019e2cb4b 1G {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:56:48 devstack sudo[103383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-50f5bb77-b8a5-4e1e-b25c-d12019e2cb4b 1G Sep 25 11:56:48 devstack sudo[103383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:56:49 devstack sudo[103383]: pam_unix(sudo:session): session closed for user root Sep 25 11:56:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8956c7c1-f2cb-4ac9-aac1-14942198dd7c tempest-TestInstancesWithCinderVolumes-1743152953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-50f5bb77-b8a5-4e1e-b25c-d12019e2cb4b 1G" returned: 0 in 0.388s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:56:49 devstack cinder-volume[86984]: DEBUG cinder.volume.volume_utils [None req-8956c7c1-f2cb-4ac9-aac1-14942198dd7c tempest-TestInstancesWithCinderVolumes-1743152953 None] Downloaded image 2b4f8c4d-1412-4382-89bb-a748b16b3820 ((None, [{'url': 'file:///opt/stack/data/glance/images/2b4f8c4d-1412-4382-89bb-a748b16b3820', 'metadata': {}}])) to volume 50f5bb77-b8a5-4e1e-b25c-d12019e2cb4b successfully. {{(pid=86984) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 11:56:49 devstack cinder-volume[86984]: DEBUG cinder.image.image_utils [None req-8956c7c1-f2cb-4ac9-aac1-14942198dd7c tempest-TestInstancesWithCinderVolumes-1743152953 None] Temporary image 2b4f8c4d-1412-4382-89bb-a748b16b3820 for user 2b33415797b74bddad58193bf033eff1 is deleted. {{(pid=86984) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 11:56:49 devstack cinder-volume[86984]: DEBUG cinder.volume.volume_utils [None req-8956c7c1-f2cb-4ac9-aac1-14942198dd7c tempest-TestInstancesWithCinderVolumes-1743152953 None] Marking volume 50f5bb77-b8a5-4e1e-b25c-d12019e2cb4b as bootable. {{(pid=86984) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 11:56:49 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-8956c7c1-f2cb-4ac9-aac1-14942198dd7c tempest-TestInstancesWithCinderVolumes-1743152953 None] Copying metadata from image 2b4f8c4d-1412-4382-89bb-a748b16b3820 to 50f5bb77-b8a5-4e1e-b25c-d12019e2cb4b. {{(pid=86984) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 11:56:49 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-8956c7c1-f2cb-4ac9-aac1-14942198dd7c tempest-TestInstancesWithCinderVolumes-1743152953 None] Creating volume glance metadata for volume 50f5bb77-b8a5-4e1e-b25c-d12019e2cb4b backed by image 2b4f8c4d-1412-4382-89bb-a748b16b3820 with: {'image_id': '2b4f8c4d-1412-4382-89bb-a748b16b3820', 'image_name': 'tempest-scenario-img--1495324592', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86984) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 11:56:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8956c7c1-f2cb-4ac9-aac1-14942198dd7c tempest-TestInstancesWithCinderVolumes-1743152953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1e5b271-a44a-4415-8c42-087b0fcfcc31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50f5bb77-b8a5-4e1e-b25c-d12019e2cb4b', 'volume_size': 1, 'image_id': '2b4f8c4d-1412-4382-89bb-a748b16b3820', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2b4f8c4d-1412-4382-89bb-a748b16b3820', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1495324592', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7968d904c220425bbebffaab45bf9134', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2b4f8c4d-1412-4382-89bb-a748b16b3820', 'created_at': datetime.datetime(2026, 9, 25, 9, 56, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 9, 56, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2b4f8c4d-1412-4382-89bb-a748b16b3820/file', 'properties': {}}, 'image_service': }' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:56:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8956c7c1-f2cb-4ac9-aac1-14942198dd7c tempest-TestInstancesWithCinderVolumes-1743152953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a5315a7-30ae-4376-83c5-6cffbd7e6b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:56:49 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-8956c7c1-f2cb-4ac9-aac1-14942198dd7c tempest-TestInstancesWithCinderVolumes-1743152953 None] Volume volume-50f5bb77-b8a5-4e1e-b25c-d12019e2cb4b (50f5bb77-b8a5-4e1e-b25c-d12019e2cb4b): created successfully Sep 25 11:56:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8956c7c1-f2cb-4ac9-aac1-14942198dd7c tempest-TestInstancesWithCinderVolumes-1743152953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a5315a7-30ae-4376-83c5-6cffbd7e6b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:56:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8956c7c1-f2cb-4ac9-aac1-14942198dd7c tempest-TestInstancesWithCinderVolumes-1743152953 None] Flow 'volume_create_manager' (aae28471-44c1-4120-bb6c-f5bef1f4f331) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:56:49 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-8956c7c1-f2cb-4ac9-aac1-14942198dd7c tempest-TestInstancesWithCinderVolumes-1743152953 None] Created volume successfully. Sep 25 11:56:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-0e2c01aa-6034-4e7e-bbc7-5d3024caccf7 req-a6f52684-c6b0-435a-af81-ca63de592de7 tempest-TestInstancesWithCinderVolumes-1743152953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:56:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-0e2c01aa-6034-4e7e-bbc7-5d3024caccf7 req-a6f52684-c6b0-435a-af81-ca63de592de7 tempest-TestInstancesWithCinderVolumes-1743152953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:56:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-0e2c01aa-6034-4e7e-bbc7-5d3024caccf7 req-a6f52684-c6b0-435a-af81-ca63de592de7 tempest-TestInstancesWithCinderVolumes-1743152953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:56:52 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [req-0e2c01aa-6034-4e7e-bbc7-5d3024caccf7 req-a6f52684-c6b0-435a-af81-ca63de592de7 tempest-TestInstancesWithCinderVolumes-1743152953 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba', 'name': 'volume-50f5bb77-b8a5-4e1e-b25c-d12019e2cb4b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'eca0feb6-fd75-4be8-b370-e888a048e8b8', 'enforce_multipath': True} {{(pid=86984) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 11:56:52 devstack cinder-volume[86984]: INFO cinder.volume.manager [req-0e2c01aa-6034-4e7e-bbc7-5d3024caccf7 req-a6f52684-c6b0-435a-af81-ca63de592de7 tempest-TestInstancesWithCinderVolumes-1743152953 None] attachment_update completed successfully. Sep 25 11:57:02 devstack cinder-volume[86984]: DEBUG dbcounter [-] [86984] Writing DB stats cinder:SELECT=27,cinder:UPDATE=21,cinder:INSERT=7,cinder:DELETE=2 {{(pid=86984) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:57:02 devstack cinder-volume[86984]: DEBUG dbcounter [-] [86984] Writing DB stats cinder:SELECT=21,cinder:UPDATE=19,cinder:INSERT=9,cinder:DELETE=2 {{(pid=86984) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:57:30 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-3e48c34f-ce76-40f0-8013-8e5005adad1a req-2447312d-f6b3-4125-b70e-0095d199abfe tempest-TestInstancesWithCinderVolumes-1743152953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:57:30 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-3e48c34f-ce76-40f0-8013-8e5005adad1a req-2447312d-f6b3-4125-b70e-0095d199abfe tempest-TestInstancesWithCinderVolumes-1743152953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:57:30 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-3e48c34f-ce76-40f0-8013-8e5005adad1a req-2447312d-f6b3-4125-b70e-0095d199abfe tempest-TestInstancesWithCinderVolumes-1743152953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:57:30 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [req-3e48c34f-ce76-40f0-8013-8e5005adad1a req-2447312d-f6b3-4125-b70e-0095d199abfe tempest-TestInstancesWithCinderVolumes-1743152953 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba', 'name': 'volume-9cb44c34-0495-4416-9baa-ea11d68e0505', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2fe4b80e-b967-486e-8c62-6126e43394a5', 'enforce_multipath': True} {{(pid=86984) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 11:57:30 devstack cinder-volume[86984]: INFO cinder.volume.manager [req-3e48c34f-ce76-40f0-8013-8e5005adad1a req-2447312d-f6b3-4125-b70e-0095d199abfe tempest-TestInstancesWithCinderVolumes-1743152953 None] attachment_update completed successfully. Sep 25 11:57:32 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-96997177-1ad9-41d0-9c16-574251c8d782 tempest-TestStampPattern-968508865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:57:32 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-96997177-1ad9-41d0-9c16-574251c8d782 tempest-TestStampPattern-968508865 None] Flow 'volume_create_manager' (863a21f1-e908-471f-8009-564aa7c15d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:57:32 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-96997177-1ad9-41d0-9c16-574251c8d782 tempest-TestStampPattern-968508865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af1aa8b8-8cdd-4879-8593-7f9aab647e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:57:32 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-96997177-1ad9-41d0-9c16-574251c8d782 tempest-TestStampPattern-968508865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af1aa8b8-8cdd-4879-8593-7f9aab647e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:57:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-82207455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0eff559b-29de-48d2-9e06-6fdcf4611362,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9f5c02d110445069c29c21fed1071a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:57:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:57:33Z,use_quota=True,user_id='1f1df0de6007425a87e40bf8cffd3f90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:57:32 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-96997177-1ad9-41d0-9c16-574251c8d782 tempest-TestStampPattern-968508865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (764a12c2-a124-4e49-972c-04fd287ef89d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:57:32 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-96997177-1ad9-41d0-9c16-574251c8d782 tempest-TestStampPattern-968508865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (764a12c2-a124-4e49-972c-04fd287ef89d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:57:32 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-96997177-1ad9-41d0-9c16-574251c8d782 tempest-TestStampPattern-968508865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8b8f144-74fe-4c6b-a05d-974adfdf1f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:57:32 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-96997177-1ad9-41d0-9c16-574251c8d782 tempest-TestStampPattern-968508865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8b8f144-74fe-4c6b-a05d-974adfdf1f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0eff559b-29de-48d2-9e06-6fdcf4611362', 'volume_name': 'volume-0eff559b-29de-48d2-9e06-6fdcf4611362', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:57:32 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-96997177-1ad9-41d0-9c16-574251c8d782 tempest-TestStampPattern-968508865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc95a989-a43c-469a-9c9a-2ca512ccbd54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:57:32 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-96997177-1ad9-41d0-9c16-574251c8d782 tempest-TestStampPattern-968508865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc95a989-a43c-469a-9c9a-2ca512ccbd54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:57:33 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-96997177-1ad9-41d0-9c16-574251c8d782 tempest-TestStampPattern-968508865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f191deb-1b9b-4ab1-bba2-63140f038d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:57:33 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-96997177-1ad9-41d0-9c16-574251c8d782 tempest-TestStampPattern-968508865 None] Volume 0eff559b-29de-48d2-9e06-6fdcf4611362: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0eff559b-29de-48d2-9e06-6fdcf4611362', 'volume_size': 1} Sep 25 11:57:33 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-96997177-1ad9-41d0-9c16-574251c8d782 tempest-TestStampPattern-968508865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:57:33 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-96997177-1ad9-41d0-9c16-574251c8d782 tempest-TestStampPattern-968508865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:57:33 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-96997177-1ad9-41d0-9c16-574251c8d782 tempest-TestStampPattern-968508865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:57:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-82207455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0eff559b-29de-48d2-9e06-6fdcf4611362,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9f5c02d110445069c29c21fed1071a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:57:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:57:33Z,use_quota=True,user_id='1f1df0de6007425a87e40bf8cffd3f90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:57:33 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-96997177-1ad9-41d0-9c16-574251c8d782 tempest-TestStampPattern-968508865 None] Creating volume 0eff559b-29de-48d2-9e06-6fdcf4611362 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:57:33 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-96997177-1ad9-41d0-9c16-574251c8d782 tempest-TestStampPattern-968508865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:57:33 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-96997177-1ad9-41d0-9c16-574251c8d782 tempest-TestStampPattern-968508865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:57:33 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-96997177-1ad9-41d0-9c16-574251c8d782 tempest-TestStampPattern-968508865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:57:33 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-96997177-1ad9-41d0-9c16-574251c8d782 tempest-TestStampPattern-968508865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:57:33 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-96997177-1ad9-41d0-9c16-574251c8d782 tempest-TestStampPattern-968508865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:57:33 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-96997177-1ad9-41d0-9c16-574251c8d782 tempest-TestStampPattern-968508865 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:57:33 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-96997177-1ad9-41d0-9c16-574251c8d782 tempest-TestStampPattern-968508865 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:57:33 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-96997177-1ad9-41d0-9c16-574251c8d782 tempest-TestStampPattern-968508865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0eff559b-29de-48d2-9e06-6fdcf4611362 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:57:33 devstack sudo[104020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0eff559b-29de-48d2-9e06-6fdcf4611362 1073741824 Sep 25 11:57:33 devstack sudo[104020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:57:33 devstack sudo[104020]: pam_unix(sudo:session): session closed for user root Sep 25 11:57:33 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-96997177-1ad9-41d0-9c16-574251c8d782 tempest-TestStampPattern-968508865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0eff559b-29de-48d2-9e06-6fdcf4611362 1073741824" returned: 0 in 0.707s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:57:33 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-96997177-1ad9-41d0-9c16-574251c8d782 tempest-TestStampPattern-968508865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0eff559b-29de-48d2-9e06-6fdcf4611362 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:57:33 devstack sudo[104035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0eff559b-29de-48d2-9e06-6fdcf4611362 Sep 25 11:57:33 devstack sudo[104035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:57:33 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-54025b95-3e11-4f94-89a7-caebd61175ed req-5e9b3a98-cf7d-4c4a-a3cb-a9a5d99388fa tempest-TestInstancesWithCinderVolumes-1743152953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:57:34 devstack sudo[104035]: pam_unix(sudo:session): session closed for user root Sep 25 11:57:34 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-96997177-1ad9-41d0-9c16-574251c8d782 tempest-TestStampPattern-968508865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0eff559b-29de-48d2-9e06-6fdcf4611362" returned: 0 in 0.307s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:57:34 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-96997177-1ad9-41d0-9c16-574251c8d782 tempest-TestStampPattern-968508865 None] <== create_volume: return (1099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:57:34 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-96997177-1ad9-41d0-9c16-574251c8d782 tempest-TestStampPattern-968508865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:57:34 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-54025b95-3e11-4f94-89a7-caebd61175ed req-5e9b3a98-cf7d-4c4a-a3cb-a9a5d99388fa tempest-TestInstancesWithCinderVolumes-1743152953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.137s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:57:34 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-96997177-1ad9-41d0-9c16-574251c8d782 tempest-TestStampPattern-968508865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f191deb-1b9b-4ab1-bba2-63140f038d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0eff559b-29de-48d2-9e06-6fdcf4611362', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:57:34 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-96997177-1ad9-41d0-9c16-574251c8d782 tempest-TestStampPattern-968508865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7065e5a-e0f8-415e-b9ae-e57107c694df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:57:34 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-54025b95-3e11-4f94-89a7-caebd61175ed req-5e9b3a98-cf7d-4c4a-a3cb-a9a5d99388fa tempest-TestInstancesWithCinderVolumes-1743152953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.049s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:57:34 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-96997177-1ad9-41d0-9c16-574251c8d782 tempest-TestStampPattern-968508865 None] Volume volume-0eff559b-29de-48d2-9e06-6fdcf4611362 (0eff559b-29de-48d2-9e06-6fdcf4611362): created successfully Sep 25 11:57:34 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-96997177-1ad9-41d0-9c16-574251c8d782 tempest-TestStampPattern-968508865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7065e5a-e0f8-415e-b9ae-e57107c694df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:57:34 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-96997177-1ad9-41d0-9c16-574251c8d782 tempest-TestStampPattern-968508865 None] Flow 'volume_create_manager' (863a21f1-e908-471f-8009-564aa7c15d0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:57:34 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-96997177-1ad9-41d0-9c16-574251c8d782 tempest-TestStampPattern-968508865 None] Created volume successfully. Sep 25 11:57:34 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [req-54025b95-3e11-4f94-89a7-caebd61175ed req-5e9b3a98-cf7d-4c4a-a3cb-a9a5d99388fa tempest-TestInstancesWithCinderVolumes-1743152953 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba', 'name': 'volume-0fca96b2-0b3a-4db9-9af4-f894b392a561', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '937d67a2-2a61-4046-bc33-b877d6e61aab', 'enforce_multipath': True} {{(pid=86984) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 11:57:34 devstack cinder-volume[86984]: INFO cinder.volume.manager [req-54025b95-3e11-4f94-89a7-caebd61175ed req-5e9b3a98-cf7d-4c4a-a3cb-a9a5d99388fa tempest-TestInstancesWithCinderVolumes-1743152953 None] attachment_update completed successfully. Sep 25 11:57:38 devstack cinder-volume[86984]: DEBUG oslo_service.periodic_task [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:57:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:57:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:57:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:57:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:57:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:57:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:57:38 devstack sudo[104072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:57:38 devstack sudo[104072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:57:39 devstack sudo[104072]: pam_unix(sudo:session): session closed for user root Sep 25 11:57:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.452s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:57:39 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:57:39 devstack cinder-volume[86984]: DEBUG oslo_service.periodic_task [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running periodic task VolumeManager._thread_info {{(pid=86984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:57:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] thread count: 28 {{(pid=86984) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 11:57:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] thread info: [<_MainThread(MainThread, started 132046492332160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86984) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 11:57:42 devstack cinder-volume[86984]: INFO cinder.volume.manager [req-fff0a0ec-aba2-46e6-a5dc-02473db3fd89 req-2ce63c13-11be-4245-a218-4fca0bb0c608 tempest-TestInstancesWithCinderVolumes-1743152953 None] Terminate volume connection completed successfully. Sep 25 11:57:42 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [req-fff0a0ec-aba2-46e6-a5dc-02473db3fd89 req-2ce63c13-11be-4245-a218-4fca0bb0c608 tempest-TestInstancesWithCinderVolumes-1743152953 None] Deleting attachment 2fe4b80e-b967-486e-8c62-6126e43394a5. {{(pid=86984) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 11:57:42 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f97c808f-b84e-4f32-8bb7-dc66bda89519 tempest-TestInstancesWithCinderVolumes-1743152953 None] Acquiring lock "cinder-9cb44c34-0495-4416-9baa-ea11d68e0505-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:57:42 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f97c808f-b84e-4f32-8bb7-dc66bda89519 tempest-TestInstancesWithCinderVolumes-1743152953 None] Lock "cinder-9cb44c34-0495-4416-9baa-ea11d68e0505-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:57:42 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f97c808f-b84e-4f32-8bb7-dc66bda89519 tempest-TestInstancesWithCinderVolumes-1743152953 None] Acquiring lock "cinder-quobyte-9cb44c34-0495-4416-9baa-ea11d68e0505" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:57:42 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f97c808f-b84e-4f32-8bb7-dc66bda89519 tempest-TestInstancesWithCinderVolumes-1743152953 None] Lock "cinder-quobyte-9cb44c34-0495-4416-9baa-ea11d68e0505" acquired by "delete_volume" :: waited 0.024s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:57:42 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a17d49-7f8a-46ff-8b60-bbea9ae50ea4]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:57:42 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f97c808f-b84e-4f32-8bb7-dc66bda89519 tempest-TestInstancesWithCinderVolumes-1743152953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9cb44c34-0495-4416-9baa-ea11d68e0505 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:57:42 devstack sudo[104196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9cb44c34-0495-4416-9baa-ea11d68e0505 Sep 25 11:57:42 devstack sudo[104196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:57:43 devstack sudo[104196]: pam_unix(sudo:session): session closed for user root Sep 25 11:57:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f97c808f-b84e-4f32-8bb7-dc66bda89519 tempest-TestInstancesWithCinderVolumes-1743152953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9cb44c34-0495-4416-9baa-ea11d68e0505" returned: 0 in 0.479s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:57:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f97c808f-b84e-4f32-8bb7-dc66bda89519 tempest-TestInstancesWithCinderVolumes-1743152953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9cb44c34-0495-4416-9baa-ea11d68e0505 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:57:43 devstack sudo[104202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9cb44c34-0495-4416-9baa-ea11d68e0505 Sep 25 11:57:43 devstack sudo[104202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:57:43 devstack sudo[104202]: pam_unix(sudo:session): session closed for user root Sep 25 11:57:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f97c808f-b84e-4f32-8bb7-dc66bda89519 tempest-TestInstancesWithCinderVolumes-1743152953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9cb44c34-0495-4416-9baa-ea11d68e0505" returned: 0 in 0.444s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:57:43 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f97c808f-b84e-4f32-8bb7-dc66bda89519 tempest-TestInstancesWithCinderVolumes-1743152953 None] Lock "cinder-quobyte-9cb44c34-0495-4416-9baa-ea11d68e0505" released by "delete_volume" :: held 1.004s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:57:43 devstack cinder-volume[86984]: WARNING cinder.quota [None req-f97c808f-b84e-4f32-8bb7-dc66bda89519 tempest-TestInstancesWithCinderVolumes-1743152953 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1068847795-580068103 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1068847795-580068103, it is now deprecated. Please use the default quota class for default quota. Sep 25 11:57:43 devstack cinder-volume[86984]: WARNING cinder.quota [None req-f97c808f-b84e-4f32-8bb7-dc66bda89519 tempest-TestInstancesWithCinderVolumes-1743152953 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1068847795-580068103 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1068847795-580068103, it is now deprecated. Please use the default quota class for default quota. Sep 25 11:57:43 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-f97c808f-b84e-4f32-8bb7-dc66bda89519 tempest-TestInstancesWithCinderVolumes-1743152953 None] Created reservations ['40ebbb89-5317-4ba7-8c72-483f5c6acc8f', 'b4486030-4c7a-4497-b965-98cb8029c67d', 'd459e052-d706-4b8f-978c-63069262dcad', '0d04220f-3b98-4b32-bfdd-f34af5c9974d'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:57:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f97c808f-b84e-4f32-8bb7-dc66bda89519 tempest-TestInstancesWithCinderVolumes-1743152953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:57:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f97c808f-b84e-4f32-8bb7-dc66bda89519 tempest-TestInstancesWithCinderVolumes-1743152953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:57:44 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-f97c808f-b84e-4f32-8bb7-dc66bda89519 tempest-TestInstancesWithCinderVolumes-1743152953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:57:44 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-f97c808f-b84e-4f32-8bb7-dc66bda89519 tempest-TestInstancesWithCinderVolumes-1743152953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:57:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f97c808f-b84e-4f32-8bb7-dc66bda89519 tempest-TestInstancesWithCinderVolumes-1743152953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:57:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f97c808f-b84e-4f32-8bb7-dc66bda89519 tempest-TestInstancesWithCinderVolumes-1743152953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:57:44 devstack sudo[104207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:57:44 devstack sudo[104207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:57:44 devstack sudo[104207]: pam_unix(sudo:session): session closed for user root Sep 25 11:57:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f97c808f-b84e-4f32-8bb7-dc66bda89519 tempest-TestInstancesWithCinderVolumes-1743152953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.344s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:57:44 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-f97c808f-b84e-4f32-8bb7-dc66bda89519 tempest-TestInstancesWithCinderVolumes-1743152953 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:57:44 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-f97c808f-b84e-4f32-8bb7-dc66bda89519 tempest-TestInstancesWithCinderVolumes-1743152953 None] Deleted volume successfully. Sep 25 11:57:44 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f97c808f-b84e-4f32-8bb7-dc66bda89519 tempest-TestInstancesWithCinderVolumes-1743152953 None] Lock "cinder-9cb44c34-0495-4416-9baa-ea11d68e0505-delete_volume" released by "delete_volume" :: held 1.765s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:57:48 devstack cinder-volume[86984]: INFO cinder.volume.manager [req-f9c91ec2-30e2-4c65-9d2c-8bad45532958 req-52651dbc-b463-4e40-8a36-b23d51810275 tempest-TestInstancesWithCinderVolumes-1743152953 None] Terminate volume connection completed successfully. Sep 25 11:57:48 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [req-f9c91ec2-30e2-4c65-9d2c-8bad45532958 req-52651dbc-b463-4e40-8a36-b23d51810275 tempest-TestInstancesWithCinderVolumes-1743152953 None] Deleting attachment 937d67a2-2a61-4046-bc33-b877d6e61aab. {{(pid=86984) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 11:57:49 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-1873dfaf-019c-4606-b4d6-dc75c03a842c tempest-TestInstancesWithCinderVolumes-1743152953 None] Acquiring lock "cinder-0fca96b2-0b3a-4db9-9af4-f894b392a561-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:57:49 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-1873dfaf-019c-4606-b4d6-dc75c03a842c tempest-TestInstancesWithCinderVolumes-1743152953 None] Lock "cinder-0fca96b2-0b3a-4db9-9af4-f894b392a561-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:57:49 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-1873dfaf-019c-4606-b4d6-dc75c03a842c tempest-TestInstancesWithCinderVolumes-1743152953 None] Acquiring lock "cinder-quobyte-0fca96b2-0b3a-4db9-9af4-f894b392a561" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:57:49 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-1873dfaf-019c-4606-b4d6-dc75c03a842c tempest-TestInstancesWithCinderVolumes-1743152953 None] Lock "cinder-quobyte-0fca96b2-0b3a-4db9-9af4-f894b392a561" acquired by "delete_volume" :: waited 0.029s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:57:49 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da43c88-c1dc-4a99-a742-13cc7380be22]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:57:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-1873dfaf-019c-4606-b4d6-dc75c03a842c tempest-TestInstancesWithCinderVolumes-1743152953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0fca96b2-0b3a-4db9-9af4-f894b392a561 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:57:49 devstack sudo[104236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0fca96b2-0b3a-4db9-9af4-f894b392a561 Sep 25 11:57:49 devstack sudo[104236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:57:49 devstack sudo[104236]: pam_unix(sudo:session): session closed for user root Sep 25 11:57:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-1873dfaf-019c-4606-b4d6-dc75c03a842c tempest-TestInstancesWithCinderVolumes-1743152953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0fca96b2-0b3a-4db9-9af4-f894b392a561" returned: 0 in 0.625s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:57:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-1873dfaf-019c-4606-b4d6-dc75c03a842c tempest-TestInstancesWithCinderVolumes-1743152953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0fca96b2-0b3a-4db9-9af4-f894b392a561 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:57:49 devstack sudo[104243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0fca96b2-0b3a-4db9-9af4-f894b392a561 Sep 25 11:57:49 devstack sudo[104243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:57:50 devstack sudo[104243]: pam_unix(sudo:session): session closed for user root Sep 25 11:57:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-1873dfaf-019c-4606-b4d6-dc75c03a842c tempest-TestInstancesWithCinderVolumes-1743152953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0fca96b2-0b3a-4db9-9af4-f894b392a561" returned: 0 in 0.333s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:57:50 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-1873dfaf-019c-4606-b4d6-dc75c03a842c tempest-TestInstancesWithCinderVolumes-1743152953 None] Lock "cinder-quobyte-0fca96b2-0b3a-4db9-9af4-f894b392a561" released by "delete_volume" :: held 1.038s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:57:50 devstack cinder-volume[86984]: WARNING cinder.quota [None req-1873dfaf-019c-4606-b4d6-dc75c03a842c tempest-TestInstancesWithCinderVolumes-1743152953 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2056898631-630797948 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2056898631-630797948, it is now deprecated. Please use the default quota class for default quota. Sep 25 11:57:50 devstack cinder-volume[86984]: WARNING cinder.quota [None req-1873dfaf-019c-4606-b4d6-dc75c03a842c tempest-TestInstancesWithCinderVolumes-1743152953 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2056898631-630797948 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2056898631-630797948, it is now deprecated. Please use the default quota class for default quota. Sep 25 11:57:50 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-1873dfaf-019c-4606-b4d6-dc75c03a842c tempest-TestInstancesWithCinderVolumes-1743152953 None] Created reservations ['a5773fe3-2a0a-4f38-93bc-2d71c2f0b226', '16065a4e-57d5-4896-a815-d24ae1b184d9', '0f8bd65f-e945-4023-af58-52ef552d1a6e', 'cbdcbeb4-980f-437a-8f8e-132a67157a04'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:57:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-1873dfaf-019c-4606-b4d6-dc75c03a842c tempest-TestInstancesWithCinderVolumes-1743152953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:57:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-1873dfaf-019c-4606-b4d6-dc75c03a842c tempest-TestInstancesWithCinderVolumes-1743152953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:57:50 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-1873dfaf-019c-4606-b4d6-dc75c03a842c tempest-TestInstancesWithCinderVolumes-1743152953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:57:50 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-1873dfaf-019c-4606-b4d6-dc75c03a842c tempest-TestInstancesWithCinderVolumes-1743152953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:57:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-1873dfaf-019c-4606-b4d6-dc75c03a842c tempest-TestInstancesWithCinderVolumes-1743152953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:57:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-1873dfaf-019c-4606-b4d6-dc75c03a842c tempest-TestInstancesWithCinderVolumes-1743152953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:57:50 devstack sudo[104247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:57:50 devstack sudo[104247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:57:50 devstack sudo[104247]: pam_unix(sudo:session): session closed for user root Sep 25 11:57:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-1873dfaf-019c-4606-b4d6-dc75c03a842c tempest-TestInstancesWithCinderVolumes-1743152953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.418s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:57:50 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-1873dfaf-019c-4606-b4d6-dc75c03a842c tempest-TestInstancesWithCinderVolumes-1743152953 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:57:50 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-1873dfaf-019c-4606-b4d6-dc75c03a842c tempest-TestInstancesWithCinderVolumes-1743152953 None] Deleted volume successfully. Sep 25 11:57:50 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-1873dfaf-019c-4606-b4d6-dc75c03a842c tempest-TestInstancesWithCinderVolumes-1743152953 None] Lock "cinder-0fca96b2-0b3a-4db9-9af4-f894b392a561-delete_volume" released by "delete_volume" :: held 1.871s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:57:55 devstack cinder-volume[86984]: INFO cinder.volume.manager [req-3039ae53-debf-4631-8476-69ee8de9c4a2 req-ef3e2d1b-3ed0-4ec1-bf29-b5861f75597f tempest-TestInstancesWithCinderVolumes-1743152953 None] Terminate volume connection completed successfully. Sep 25 11:57:55 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [req-3039ae53-debf-4631-8476-69ee8de9c4a2 req-ef3e2d1b-3ed0-4ec1-bf29-b5861f75597f tempest-TestInstancesWithCinderVolumes-1743152953 None] Deleting attachment eca0feb6-fd75-4be8-b370-e888a048e8b8. {{(pid=86984) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 11:57:56 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-8169f146-56de-4354-b5e2-4c3074aa78c5 tempest-TestInstancesWithCinderVolumes-1743152953 None] Acquiring lock "cinder-50f5bb77-b8a5-4e1e-b25c-d12019e2cb4b-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:57:56 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-8169f146-56de-4354-b5e2-4c3074aa78c5 tempest-TestInstancesWithCinderVolumes-1743152953 None] Lock "cinder-50f5bb77-b8a5-4e1e-b25c-d12019e2cb4b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:57:56 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-8169f146-56de-4354-b5e2-4c3074aa78c5 tempest-TestInstancesWithCinderVolumes-1743152953 None] Acquiring lock "cinder-quobyte-50f5bb77-b8a5-4e1e-b25c-d12019e2cb4b" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:57:56 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-8169f146-56de-4354-b5e2-4c3074aa78c5 tempest-TestInstancesWithCinderVolumes-1743152953 None] Lock "cinder-quobyte-50f5bb77-b8a5-4e1e-b25c-d12019e2cb4b" acquired by "delete_volume" :: waited 0.025s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:57:56 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd19ae6-65d5-413d-9f1a-ea3a4853560e]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:57:56 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8169f146-56de-4354-b5e2-4c3074aa78c5 tempest-TestInstancesWithCinderVolumes-1743152953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-50f5bb77-b8a5-4e1e-b25c-d12019e2cb4b {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:57:56 devstack sudo[104316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-50f5bb77-b8a5-4e1e-b25c-d12019e2cb4b Sep 25 11:57:56 devstack sudo[104316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:57:57 devstack sudo[104316]: pam_unix(sudo:session): session closed for user root Sep 25 11:57:57 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8169f146-56de-4354-b5e2-4c3074aa78c5 tempest-TestInstancesWithCinderVolumes-1743152953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-50f5bb77-b8a5-4e1e-b25c-d12019e2cb4b" returned: 0 in 0.490s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:57:57 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8169f146-56de-4354-b5e2-4c3074aa78c5 tempest-TestInstancesWithCinderVolumes-1743152953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-50f5bb77-b8a5-4e1e-b25c-d12019e2cb4b {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:57:57 devstack sudo[104321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-50f5bb77-b8a5-4e1e-b25c-d12019e2cb4b Sep 25 11:57:57 devstack sudo[104321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:57:57 devstack sudo[104321]: pam_unix(sudo:session): session closed for user root Sep 25 11:57:57 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8169f146-56de-4354-b5e2-4c3074aa78c5 tempest-TestInstancesWithCinderVolumes-1743152953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-50f5bb77-b8a5-4e1e-b25c-d12019e2cb4b" returned: 0 in 0.363s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:57:57 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-8169f146-56de-4354-b5e2-4c3074aa78c5 tempest-TestInstancesWithCinderVolumes-1743152953 None] Lock "cinder-quobyte-50f5bb77-b8a5-4e1e-b25c-d12019e2cb4b" released by "delete_volume" :: held 0.911s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:57:57 devstack cinder-volume[86984]: WARNING cinder.quota [None req-8169f146-56de-4354-b5e2-4c3074aa78c5 tempest-TestInstancesWithCinderVolumes-1743152953 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1472758286-2040880023 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1472758286-2040880023, it is now deprecated. Please use the default quota class for default quota. Sep 25 11:57:57 devstack cinder-volume[86984]: WARNING cinder.quota [None req-8169f146-56de-4354-b5e2-4c3074aa78c5 tempest-TestInstancesWithCinderVolumes-1743152953 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1472758286-2040880023 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1472758286-2040880023, it is now deprecated. Please use the default quota class for default quota. Sep 25 11:57:57 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-8169f146-56de-4354-b5e2-4c3074aa78c5 tempest-TestInstancesWithCinderVolumes-1743152953 None] Created reservations ['4f7e46f3-5538-4586-a578-adef6798cbf8', '6e2d27c0-c29a-4b50-b0c1-cab5d1055ae8', '747157f2-27e6-41f1-9f13-b5f050d91b65', '7431712d-fe41-40cc-bd8f-b6a42a6b039e'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:57:57 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-8169f146-56de-4354-b5e2-4c3074aa78c5 tempest-TestInstancesWithCinderVolumes-1743152953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:57:57 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-8169f146-56de-4354-b5e2-4c3074aa78c5 tempest-TestInstancesWithCinderVolumes-1743152953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:57:57 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-8169f146-56de-4354-b5e2-4c3074aa78c5 tempest-TestInstancesWithCinderVolumes-1743152953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:57:57 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-8169f146-56de-4354-b5e2-4c3074aa78c5 tempest-TestInstancesWithCinderVolumes-1743152953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:57:57 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-8169f146-56de-4354-b5e2-4c3074aa78c5 tempest-TestInstancesWithCinderVolumes-1743152953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:57:57 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8169f146-56de-4354-b5e2-4c3074aa78c5 tempest-TestInstancesWithCinderVolumes-1743152953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:57:57 devstack sudo[104335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:57:57 devstack sudo[104335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:57:57 devstack sudo[104335]: pam_unix(sudo:session): session closed for user root Sep 25 11:57:57 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8169f146-56de-4354-b5e2-4c3074aa78c5 tempest-TestInstancesWithCinderVolumes-1743152953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.298s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:57:57 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-8169f146-56de-4354-b5e2-4c3074aa78c5 tempest-TestInstancesWithCinderVolumes-1743152953 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:57:57 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-8169f146-56de-4354-b5e2-4c3074aa78c5 tempest-TestInstancesWithCinderVolumes-1743152953 None] Deleted volume successfully. Sep 25 11:57:57 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-8169f146-56de-4354-b5e2-4c3074aa78c5 tempest-TestInstancesWithCinderVolumes-1743152953 None] Lock "cinder-50f5bb77-b8a5-4e1e-b25c-d12019e2cb4b-delete_volume" released by "delete_volume" :: held 1.518s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:58:07 devstack cinder-volume[86984]: DEBUG dbcounter [-] [86984] Writing DB stats cinder:SELECT=35,cinder:UPDATE=31,cinder:INSERT=8,cinder:DELETE=1 {{(pid=86984) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:58:07 devstack cinder-volume[86984]: DEBUG dbcounter [-] [86984] Writing DB stats cinder:SELECT=31,cinder:UPDATE=29,cinder:DELETE=3,cinder:INSERT=5 {{(pid=86984) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:58:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-f15a2f47-2a1f-4877-8448-77a9830a071d req-fddbe71e-039b-4dbb-b740-01b759724df0 tempest-TestStampPattern-968508865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:58:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-f15a2f47-2a1f-4877-8448-77a9830a071d req-fddbe71e-039b-4dbb-b740-01b759724df0 tempest-TestStampPattern-968508865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:58:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-f15a2f47-2a1f-4877-8448-77a9830a071d req-fddbe71e-039b-4dbb-b740-01b759724df0 tempest-TestStampPattern-968508865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:58:11 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [req-f15a2f47-2a1f-4877-8448-77a9830a071d req-fddbe71e-039b-4dbb-b740-01b759724df0 tempest-TestStampPattern-968508865 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba', 'name': 'volume-0eff559b-29de-48d2-9e06-6fdcf4611362', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '837d261c-26e7-4997-a025-373aaafa5d43', 'enforce_multipath': True} {{(pid=86984) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 11:58:11 devstack cinder-volume[86984]: INFO cinder.volume.manager [req-f15a2f47-2a1f-4877-8448-77a9830a071d req-fddbe71e-039b-4dbb-b740-01b759724df0 tempest-TestStampPattern-968508865 None] attachment_update completed successfully. Sep 25 11:58:17 devstack cinder-volume[86984]: INFO cinder.volume.manager [req-1120ff53-f90c-4e1f-8864-865880fa1bd5 req-e7c01379-ff47-4326-86b7-7ec1f668e930 tempest-TestStampPattern-968508865 None] Terminate volume connection completed successfully. Sep 25 11:58:17 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [req-1120ff53-f90c-4e1f-8864-865880fa1bd5 req-e7c01379-ff47-4326-86b7-7ec1f668e930 tempest-TestStampPattern-968508865 None] Deleting attachment 837d261c-26e7-4997-a025-373aaafa5d43. {{(pid=86984) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 11:58:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-9f1aabc8-3dff-4cf6-b5bc-3d7514c8e4aa tempest-TestStampPattern-968508865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:58:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-9f1aabc8-3dff-4cf6-b5bc-3d7514c8e4aa tempest-TestStampPattern-968508865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:58:18 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-9f1aabc8-3dff-4cf6-b5bc-3d7514c8e4aa tempest-TestStampPattern-968508865 None] Creating offline snapshot ac53e658-a24c-4577-88ad-f5f5fc43904e of volume 0eff559b-29de-48d2-9e06-6fdcf4611362 {{(pid=86984) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 11:58:18 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[db384954-80a8-4b41-94b2-ad67cf410dda]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:58:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-9f1aabc8-3dff-4cf6-b5bc-3d7514c8e4aa tempest-TestStampPattern-968508865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0eff559b-29de-48d2-9e06-6fdcf4611362 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:58:18 devstack sudo[104827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0eff559b-29de-48d2-9e06-6fdcf4611362 Sep 25 11:58:18 devstack sudo[104827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:58:19 devstack sudo[104827]: pam_unix(sudo:session): session closed for user root Sep 25 11:58:19 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-9f1aabc8-3dff-4cf6-b5bc-3d7514c8e4aa tempest-TestStampPattern-968508865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0eff559b-29de-48d2-9e06-6fdcf4611362" returned: 0 in 0.568s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:58:19 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-9f1aabc8-3dff-4cf6-b5bc-3d7514c8e4aa tempest-TestStampPattern-968508865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0eff559b-29de-48d2-9e06-6fdcf4611362,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0eff559b-29de-48d2-9e06-6fdcf4611362.ac53e658-a24c-4577-88ad-f5f5fc43904e 1G {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:58:19 devstack sudo[104832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0eff559b-29de-48d2-9e06-6fdcf4611362,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0eff559b-29de-48d2-9e06-6fdcf4611362.ac53e658-a24c-4577-88ad-f5f5fc43904e 1G Sep 25 11:58:19 devstack sudo[104832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:58:19 devstack sudo[104832]: pam_unix(sudo:session): session closed for user root Sep 25 11:58:19 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-9f1aabc8-3dff-4cf6-b5bc-3d7514c8e4aa tempest-TestStampPattern-968508865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0eff559b-29de-48d2-9e06-6fdcf4611362,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0eff559b-29de-48d2-9e06-6fdcf4611362.ac53e658-a24c-4577-88ad-f5f5fc43904e 1G" returned: 0 in 0.735s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:58:19 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-9f1aabc8-3dff-4cf6-b5bc-3d7514c8e4aa tempest-TestStampPattern-968508865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0eff559b-29de-48d2-9e06-6fdcf4611362 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0eff559b-29de-48d2-9e06-6fdcf4611362.ac53e658-a24c-4577-88ad-f5f5fc43904e {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:58:19 devstack sudo[104838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0eff559b-29de-48d2-9e06-6fdcf4611362 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0eff559b-29de-48d2-9e06-6fdcf4611362.ac53e658-a24c-4577-88ad-f5f5fc43904e Sep 25 11:58:19 devstack sudo[104838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:58:20 devstack sudo[104838]: pam_unix(sudo:session): session closed for user root Sep 25 11:58:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-9f1aabc8-3dff-4cf6-b5bc-3d7514c8e4aa tempest-TestStampPattern-968508865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0eff559b-29de-48d2-9e06-6fdcf4611362 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0eff559b-29de-48d2-9e06-6fdcf4611362.ac53e658-a24c-4577-88ad-f5f5fc43904e" returned: 0 in 0.414s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:58:20 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-9f1aabc8-3dff-4cf6-b5bc-3d7514c8e4aa tempest-TestStampPattern-968508865 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0eff559b-29de-48d2-9e06-6fdcf4611362.ac53e658-a24c-4577-88ad-f5f5fc43904e is being set with open permissions: ugo+rw Sep 25 11:58:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-9f1aabc8-3dff-4cf6-b5bc-3d7514c8e4aa tempest-TestStampPattern-968508865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0eff559b-29de-48d2-9e06-6fdcf4611362.ac53e658-a24c-4577-88ad-f5f5fc43904e {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:58:20 devstack sudo[104844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0eff559b-29de-48d2-9e06-6fdcf4611362.ac53e658-a24c-4577-88ad-f5f5fc43904e Sep 25 11:58:20 devstack sudo[104844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:58:20 devstack sudo[104844]: pam_unix(sudo:session): session closed for user root Sep 25 11:58:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-9f1aabc8-3dff-4cf6-b5bc-3d7514c8e4aa tempest-TestStampPattern-968508865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0eff559b-29de-48d2-9e06-6fdcf4611362.ac53e658-a24c-4577-88ad-f5f5fc43904e" returned: 0 in 0.383s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:58:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-9f1aabc8-3dff-4cf6-b5bc-3d7514c8e4aa tempest-TestStampPattern-968508865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0eff559b-29de-48d2-9e06-6fdcf4611362.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:58:20 devstack sudo[104847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0eff559b-29de-48d2-9e06-6fdcf4611362.info Sep 25 11:58:20 devstack sudo[104847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:58:21 devstack sudo[104847]: pam_unix(sudo:session): session closed for user root Sep 25 11:58:21 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-9f1aabc8-3dff-4cf6-b5bc-3d7514c8e4aa tempest-TestStampPattern-968508865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0eff559b-29de-48d2-9e06-6fdcf4611362.info" returned: 0 in 0.311s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:58:21 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-9f1aabc8-3dff-4cf6-b5bc-3d7514c8e4aa tempest-TestStampPattern-968508865 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0eff559b-29de-48d2-9e06-6fdcf4611362.info is being set with open permissions: ugo+rw Sep 25 11:58:21 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-9f1aabc8-3dff-4cf6-b5bc-3d7514c8e4aa tempest-TestStampPattern-968508865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0eff559b-29de-48d2-9e06-6fdcf4611362.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:58:21 devstack sudo[104850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0eff559b-29de-48d2-9e06-6fdcf4611362.info Sep 25 11:58:21 devstack sudo[104850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:58:21 devstack sudo[104850]: pam_unix(sudo:session): session closed for user root Sep 25 11:58:21 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-9f1aabc8-3dff-4cf6-b5bc-3d7514c8e4aa tempest-TestStampPattern-968508865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0eff559b-29de-48d2-9e06-6fdcf4611362.info" returned: 0 in 0.374s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:58:21 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-9f1aabc8-3dff-4cf6-b5bc-3d7514c8e4aa tempest-TestStampPattern-968508865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.950s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:58:21 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-9f1aabc8-3dff-4cf6-b5bc-3d7514c8e4aa tempest-TestStampPattern-968508865 None] Create snapshot completed successfully Sep 25 11:58:30 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-d548238e-6bae-44d6-a7f5-e960aeb7ce1a tempest-TestStampPattern-968508865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:58:30 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d548238e-6bae-44d6-a7f5-e960aeb7ce1a tempest-TestStampPattern-968508865 None] Flow 'volume_create_manager' (1b22f08a-bbeb-4654-bf86-79d851abecac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:58:30 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d548238e-6bae-44d6-a7f5-e960aeb7ce1a tempest-TestStampPattern-968508865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7b8cc98-1139-434c-bb79-c6a012754388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:58:30 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d548238e-6bae-44d6-a7f5-e960aeb7ce1a tempest-TestStampPattern-968508865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7b8cc98-1139-434c-bb79-c6a012754388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:58:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-640897570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e228b9c-6257-451d-8658-1a55d3250732,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9f5c02d110445069c29c21fed1071a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:58:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ac53e658-a24c-4577-88ad-f5f5fc43904e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:58:30Z,use_quota=True,user_id='1f1df0de6007425a87e40bf8cffd3f90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:58:30 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d548238e-6bae-44d6-a7f5-e960aeb7ce1a tempest-TestStampPattern-968508865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8420145-54eb-464c-b3a0-c88245e2f2a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:58:30 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d548238e-6bae-44d6-a7f5-e960aeb7ce1a tempest-TestStampPattern-968508865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8420145-54eb-464c-b3a0-c88245e2f2a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:58:30 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d548238e-6bae-44d6-a7f5-e960aeb7ce1a tempest-TestStampPattern-968508865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97efec01-b948-48bd-a97f-a40be78391b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:58:30 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d548238e-6bae-44d6-a7f5-e960aeb7ce1a tempest-TestStampPattern-968508865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97efec01-b948-48bd-a97f-a40be78391b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9e228b9c-6257-451d-8658-1a55d3250732', 'volume_name': 'volume-9e228b9c-6257-451d-8658-1a55d3250732', 'volume_size': 1, 'snapshot_id': 'ac53e658-a24c-4577-88ad-f5f5fc43904e'}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:58:30 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d548238e-6bae-44d6-a7f5-e960aeb7ce1a tempest-TestStampPattern-968508865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c36b5bc-1a17-45a4-9d23-215119f14d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:58:30 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d548238e-6bae-44d6-a7f5-e960aeb7ce1a tempest-TestStampPattern-968508865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c36b5bc-1a17-45a4-9d23-215119f14d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:58:30 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d548238e-6bae-44d6-a7f5-e960aeb7ce1a tempest-TestStampPattern-968508865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deb8256f-226d-4246-98ed-dfa563c0b5ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:58:30 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-d548238e-6bae-44d6-a7f5-e960aeb7ce1a tempest-TestStampPattern-968508865 None] Volume 9e228b9c-6257-451d-8658-1a55d3250732: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9e228b9c-6257-451d-8658-1a55d3250732', 'volume_size': 1, 'snapshot_id': 'ac53e658-a24c-4577-88ad-f5f5fc43904e'} Sep 25 11:58:30 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d548238e-6bae-44d6-a7f5-e960aeb7ce1a tempest-TestStampPattern-968508865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:58:30 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d548238e-6bae-44d6-a7f5-e960aeb7ce1a tempest-TestStampPattern-968508865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:58:30 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-d548238e-6bae-44d6-a7f5-e960aeb7ce1a tempest-TestStampPattern-968508865 None] Acquiring lock "cinder-quobyte-ac53e658-a24c-4577-88ad-f5f5fc43904e-9e228b9c-6257-451d-8658-1a55d3250732" by "_create_volume_from_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:58:30 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-d548238e-6bae-44d6-a7f5-e960aeb7ce1a tempest-TestStampPattern-968508865 None] Lock "cinder-quobyte-ac53e658-a24c-4577-88ad-f5f5fc43904e-9e228b9c-6257-451d-8658-1a55d3250732" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:58:30 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-d548238e-6bae-44d6-a7f5-e960aeb7ce1a tempest-TestStampPattern-968508865 None] Creating volume 9e228b9c-6257-451d-8658-1a55d3250732 from snapshot ac53e658-a24c-4577-88ad-f5f5fc43904e {{(pid=86984) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 11:58:30 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d548238e-6bae-44d6-a7f5-e960aeb7ce1a tempest-TestStampPattern-968508865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:58:30 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d548238e-6bae-44d6-a7f5-e960aeb7ce1a tempest-TestStampPattern-968508865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:58:30 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-d548238e-6bae-44d6-a7f5-e960aeb7ce1a tempest-TestStampPattern-968508865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:58:30 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-d548238e-6bae-44d6-a7f5-e960aeb7ce1a tempest-TestStampPattern-968508865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:58:30 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d548238e-6bae-44d6-a7f5-e960aeb7ce1a tempest-TestStampPattern-968508865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:58:30 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-d548238e-6bae-44d6-a7f5-e960aeb7ce1a tempest-TestStampPattern-968508865 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:58:30 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-d548238e-6bae-44d6-a7f5-e960aeb7ce1a tempest-TestStampPattern-968508865 None] Acquiring lock "cinder-quobyte-9e228b9c-6257-451d-8658-1a55d3250732" by "_copy_volume_from_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:58:30 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-d548238e-6bae-44d6-a7f5-e960aeb7ce1a tempest-TestStampPattern-968508865 None] Lock "cinder-quobyte-9e228b9c-6257-451d-8658-1a55d3250732" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:58:30 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-d548238e-6bae-44d6-a7f5-e960aeb7ce1a tempest-TestStampPattern-968508865 None] snapshot: ac53e658-a24c-4577-88ad-f5f5fc43904e, volume: 9e228b9c-6257-451d-8658-1a55d3250732, {{(pid=86984) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 11:58:30 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d548238e-6bae-44d6-a7f5-e960aeb7ce1a tempest-TestStampPattern-968508865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:58:30 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d548238e-6bae-44d6-a7f5-e960aeb7ce1a tempest-TestStampPattern-968508865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:58:30 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-d548238e-6bae-44d6-a7f5-e960aeb7ce1a tempest-TestStampPattern-968508865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:58:30 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-d548238e-6bae-44d6-a7f5-e960aeb7ce1a tempest-TestStampPattern-968508865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:58:30 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d548238e-6bae-44d6-a7f5-e960aeb7ce1a tempest-TestStampPattern-968508865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:58:30 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e9f0cc2-af0a-453b-9390-ae7669e221a7]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:58:30 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d548238e-6bae-44d6-a7f5-e960aeb7ce1a tempest-TestStampPattern-968508865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0eff559b-29de-48d2-9e06-6fdcf4611362.ac53e658-a24c-4577-88ad-f5f5fc43904e {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:58:30 devstack sudo[104897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0eff559b-29de-48d2-9e06-6fdcf4611362.ac53e658-a24c-4577-88ad-f5f5fc43904e Sep 25 11:58:30 devstack sudo[104897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:58:31 devstack sudo[104897]: pam_unix(sudo:session): session closed for user root Sep 25 11:58:31 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d548238e-6bae-44d6-a7f5-e960aeb7ce1a tempest-TestStampPattern-968508865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0eff559b-29de-48d2-9e06-6fdcf4611362.ac53e658-a24c-4577-88ad-f5f5fc43904e" returned: 0 in 0.471s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:58:31 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-d548238e-6bae-44d6-a7f5-e960aeb7ce1a tempest-TestStampPattern-968508865 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0eff559b-29de-48d2-9e06-6fdcf4611362(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86984) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:58:31 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e4cd42-ee07-4d7c-860d-1ffe54025669]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:58:31 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d548238e-6bae-44d6-a7f5-e960aeb7ce1a tempest-TestStampPattern-968508865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0eff559b-29de-48d2-9e06-6fdcf4611362 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:58:31 devstack sudo[104902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0eff559b-29de-48d2-9e06-6fdcf4611362 Sep 25 11:58:31 devstack sudo[104902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:58:31 devstack sudo[104902]: pam_unix(sudo:session): session closed for user root Sep 25 11:58:31 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d548238e-6bae-44d6-a7f5-e960aeb7ce1a tempest-TestStampPattern-968508865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0eff559b-29de-48d2-9e06-6fdcf4611362" returned: 0 in 0.512s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:58:31 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-d548238e-6bae-44d6-a7f5-e960aeb7ce1a tempest-TestStampPattern-968508865 None] will copy from snapshot at /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0eff559b-29de-48d2-9e06-6fdcf4611362 {{(pid=86984) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 11:58:31 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-d548238e-6bae-44d6-a7f5-e960aeb7ce1a tempest-TestStampPattern-968508865 None] Creating direct copy from snapshot {{(pid=86984) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 11:58:31 devstack cinder-volume[86984]: DEBUG cinder.utils [None req-d548238e-6bae-44d6-a7f5-e960aeb7ce1a tempest-TestStampPattern-968508865 None] Path /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9e228b9c-6257-451d-8658-1a55d3250732 not found in is_blk_device check {{(pid=86984) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 11:58:31 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d548238e-6bae-44d6-a7f5-e960aeb7ce1a tempest-TestStampPattern-968508865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0eff559b-29de-48d2-9e06-6fdcf4611362 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9e228b9c-6257-451d-8658-1a55d3250732 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:58:31 devstack sudo[104910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0eff559b-29de-48d2-9e06-6fdcf4611362 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9e228b9c-6257-451d-8658-1a55d3250732 Sep 25 11:58:31 devstack sudo[104910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:58:38 devstack cinder-volume[86984]: DEBUG oslo_service.periodic_task [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:58:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:58:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:58:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:58:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:58:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:58:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:58:38 devstack sudo[104929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:58:38 devstack sudo[104929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:58:39 devstack sudo[104929]: pam_unix(sudo:session): session closed for user root Sep 25 11:58:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 1.016s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:58:39 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:58:39 devstack cinder-volume[86984]: DEBUG oslo_service.periodic_task [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running periodic task VolumeManager._thread_info {{(pid=86984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:58:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] thread count: 28 {{(pid=86984) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 11:58:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] thread info: [<_MainThread(MainThread, started 132046492332160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86984) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 11:58:40 devstack cinder-volume[86984]: DEBUG dbcounter [-] [86984] Writing DB stats cinder:SELECT=15,cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86984) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:58:40 devstack cinder-volume[86984]: DEBUG dbcounter [-] [86984] Writing DB stats cinder:SELECT=12,cinder:UPDATE=5 {{(pid=86984) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:58:41 devstack sudo[104910]: pam_unix(sudo:session): session closed for user root Sep 25 11:58:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d548238e-6bae-44d6-a7f5-e960aeb7ce1a tempest-TestStampPattern-968508865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0eff559b-29de-48d2-9e06-6fdcf4611362 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9e228b9c-6257-451d-8658-1a55d3250732" returned: 0 in 9.812s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:58:41 devstack cinder-volume[86984]: DEBUG cinder.image.image_utils [None req-d548238e-6bae-44d6-a7f5-e960aeb7ce1a tempest-TestStampPattern-968508865 None] Image conversion details: src /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0eff559b-29de-48d2-9e06-6fdcf4611362, size 1024.00 MB, duration 9.81 sec, destination /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9e228b9c-6257-451d-8658-1a55d3250732 {{(pid=86984) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 11:58:41 devstack cinder-volume[86984]: INFO cinder.image.image_utils [None req-d548238e-6bae-44d6-a7f5-e960aeb7ce1a tempest-TestStampPattern-968508865 None] Converted 1024.00 MB image at 104.34 MB/s Sep 25 11:58:41 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-d548238e-6bae-44d6-a7f5-e960aeb7ce1a tempest-TestStampPattern-968508865 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9e228b9c-6257-451d-8658-1a55d3250732 is being set with open permissions: ugo+rw Sep 25 11:58:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d548238e-6bae-44d6-a7f5-e960aeb7ce1a tempest-TestStampPattern-968508865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9e228b9c-6257-451d-8658-1a55d3250732 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:58:41 devstack sudo[104960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9e228b9c-6257-451d-8658-1a55d3250732 Sep 25 11:58:41 devstack sudo[104960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:58:41 devstack sudo[104960]: pam_unix(sudo:session): session closed for user root Sep 25 11:58:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d548238e-6bae-44d6-a7f5-e960aeb7ce1a tempest-TestStampPattern-968508865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9e228b9c-6257-451d-8658-1a55d3250732" returned: 0 in 0.386s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:58:41 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-d548238e-6bae-44d6-a7f5-e960aeb7ce1a tempest-TestStampPattern-968508865 None] Lock "cinder-quobyte-9e228b9c-6257-451d-8658-1a55d3250732" released by "_copy_volume_from_snapshot" :: held 11.323s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:58:41 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-d548238e-6bae-44d6-a7f5-e960aeb7ce1a tempest-TestStampPattern-968508865 None] Lock "cinder-quobyte-ac53e658-a24c-4577-88ad-f5f5fc43904e-9e228b9c-6257-451d-8658-1a55d3250732" released by "_create_volume_from_snapshot" :: held 11.420s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:58:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d548238e-6bae-44d6-a7f5-e960aeb7ce1a tempest-TestStampPattern-968508865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.442s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:58:41 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d548238e-6bae-44d6-a7f5-e960aeb7ce1a tempest-TestStampPattern-968508865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deb8256f-226d-4246-98ed-dfa563c0b5ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e228b9c-6257-451d-8658-1a55d3250732', 'volume_size': 1, 'snapshot_id': 'ac53e658-a24c-4577-88ad-f5f5fc43904e'}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:58:41 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d548238e-6bae-44d6-a7f5-e960aeb7ce1a tempest-TestStampPattern-968508865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd47977c-5ea8-4f8e-9747-d8ab66a2091d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:58:41 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-d548238e-6bae-44d6-a7f5-e960aeb7ce1a tempest-TestStampPattern-968508865 None] Volume volume-9e228b9c-6257-451d-8658-1a55d3250732 (9e228b9c-6257-451d-8658-1a55d3250732): created successfully Sep 25 11:58:42 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d548238e-6bae-44d6-a7f5-e960aeb7ce1a tempest-TestStampPattern-968508865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd47977c-5ea8-4f8e-9747-d8ab66a2091d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:58:42 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d548238e-6bae-44d6-a7f5-e960aeb7ce1a tempest-TestStampPattern-968508865 None] Flow 'volume_create_manager' (1b22f08a-bbeb-4654-bf86-79d851abecac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:58:42 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-d548238e-6bae-44d6-a7f5-e960aeb7ce1a tempest-TestStampPattern-968508865 None] Created volume successfully. Sep 25 11:58:52 devstack cinder-volume[86984]: DEBUG dbcounter [-] [86984] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2 {{(pid=86984) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:58:52 devstack cinder-volume[86984]: DEBUG dbcounter [-] [86984] Writing DB stats cinder:SELECT=1,cinder:INSERT=1,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=86984) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:58:57 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a87b6d2-b154-4734-9c8b-66e423b8bfb7 tempest-TestMinimumBasicScenario-21601527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 11:58:57 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-9a87b6d2-b154-4734-9c8b-66e423b8bfb7 tempest-TestMinimumBasicScenario-21601527 None] Flow 'volume_create_manager' (6838c127-c95d-457f-b547-354d889a4cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:58:57 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-9a87b6d2-b154-4734-9c8b-66e423b8bfb7 tempest-TestMinimumBasicScenario-21601527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74099ee6-b546-4f56-8366-25c5674d161b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:58:57 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-9a87b6d2-b154-4734-9c8b-66e423b8bfb7 tempest-TestMinimumBasicScenario-21601527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74099ee6-b546-4f56-8366-25c5674d161b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:58:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1007402012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f93ade87-7624-4c20-80ee-c3c99ad620ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1c74ce5f8fb462b9e9e185fad4ec3f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:58:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:58:58Z,use_quota=True,user_id='fceb8eb099b9499e97b3e687a3ff270b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:58:57 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-9a87b6d2-b154-4734-9c8b-66e423b8bfb7 tempest-TestMinimumBasicScenario-21601527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fda511ab-6a19-4a6e-89c5-1a780e906524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:58:57 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-9a87b6d2-b154-4734-9c8b-66e423b8bfb7 tempest-TestMinimumBasicScenario-21601527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fda511ab-6a19-4a6e-89c5-1a780e906524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:58:57 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-9a87b6d2-b154-4734-9c8b-66e423b8bfb7 tempest-TestMinimumBasicScenario-21601527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96cd6d71-c2af-4e98-8359-9d1575caeea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:58:57 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-9a87b6d2-b154-4734-9c8b-66e423b8bfb7 tempest-TestMinimumBasicScenario-21601527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96cd6d71-c2af-4e98-8359-9d1575caeea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f93ade87-7624-4c20-80ee-c3c99ad620ca', 'volume_name': 'volume-f93ade87-7624-4c20-80ee-c3c99ad620ca', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:58:57 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-9a87b6d2-b154-4734-9c8b-66e423b8bfb7 tempest-TestMinimumBasicScenario-21601527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e32ee788-5c81-4c7b-a57e-af2cb045991d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:58:57 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-9a87b6d2-b154-4734-9c8b-66e423b8bfb7 tempest-TestMinimumBasicScenario-21601527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e32ee788-5c81-4c7b-a57e-af2cb045991d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:58:57 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-9a87b6d2-b154-4734-9c8b-66e423b8bfb7 tempest-TestMinimumBasicScenario-21601527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b1fdac9-bf7b-4248-8085-2521abc950a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:58:57 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-9a87b6d2-b154-4734-9c8b-66e423b8bfb7 tempest-TestMinimumBasicScenario-21601527 None] Volume f93ade87-7624-4c20-80ee-c3c99ad620ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f93ade87-7624-4c20-80ee-c3c99ad620ca', 'volume_size': 1} Sep 25 11:58:57 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-9a87b6d2-b154-4734-9c8b-66e423b8bfb7 tempest-TestMinimumBasicScenario-21601527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:58:57 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-9a87b6d2-b154-4734-9c8b-66e423b8bfb7 tempest-TestMinimumBasicScenario-21601527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:58:57 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-9a87b6d2-b154-4734-9c8b-66e423b8bfb7 tempest-TestMinimumBasicScenario-21601527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T09:58:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1007402012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f93ade87-7624-4c20-80ee-c3c99ad620ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1c74ce5f8fb462b9e9e185fad4ec3f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T09:58:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T09:58:58Z,use_quota=True,user_id='fceb8eb099b9499e97b3e687a3ff270b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 11:58:57 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-9a87b6d2-b154-4734-9c8b-66e423b8bfb7 tempest-TestMinimumBasicScenario-21601527 None] Creating volume f93ade87-7624-4c20-80ee-c3c99ad620ca {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 11:58:57 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-9a87b6d2-b154-4734-9c8b-66e423b8bfb7 tempest-TestMinimumBasicScenario-21601527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:58:57 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-9a87b6d2-b154-4734-9c8b-66e423b8bfb7 tempest-TestMinimumBasicScenario-21601527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:58:57 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-9a87b6d2-b154-4734-9c8b-66e423b8bfb7 tempest-TestMinimumBasicScenario-21601527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:58:57 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-9a87b6d2-b154-4734-9c8b-66e423b8bfb7 tempest-TestMinimumBasicScenario-21601527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:58:57 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-9a87b6d2-b154-4734-9c8b-66e423b8bfb7 tempest-TestMinimumBasicScenario-21601527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:58:57 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-9a87b6d2-b154-4734-9c8b-66e423b8bfb7 tempest-TestMinimumBasicScenario-21601527 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 11:58:57 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-9a87b6d2-b154-4734-9c8b-66e423b8bfb7 tempest-TestMinimumBasicScenario-21601527 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 11:58:57 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-9a87b6d2-b154-4734-9c8b-66e423b8bfb7 tempest-TestMinimumBasicScenario-21601527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f93ade87-7624-4c20-80ee-c3c99ad620ca 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:58:57 devstack sudo[105194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f93ade87-7624-4c20-80ee-c3c99ad620ca 1073741824 Sep 25 11:58:57 devstack sudo[105194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:58:58 devstack sudo[105194]: pam_unix(sudo:session): session closed for user root Sep 25 11:58:58 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-9a87b6d2-b154-4734-9c8b-66e423b8bfb7 tempest-TestMinimumBasicScenario-21601527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f93ade87-7624-4c20-80ee-c3c99ad620ca 1073741824" returned: 0 in 0.565s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:58:58 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-9a87b6d2-b154-4734-9c8b-66e423b8bfb7 tempest-TestMinimumBasicScenario-21601527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f93ade87-7624-4c20-80ee-c3c99ad620ca {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:58:58 devstack sudo[105200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f93ade87-7624-4c20-80ee-c3c99ad620ca Sep 25 11:58:58 devstack sudo[105200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:58:58 devstack sudo[105200]: pam_unix(sudo:session): session closed for user root Sep 25 11:58:58 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-9a87b6d2-b154-4734-9c8b-66e423b8bfb7 tempest-TestMinimumBasicScenario-21601527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f93ade87-7624-4c20-80ee-c3c99ad620ca" returned: 0 in 0.283s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:58:58 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-9a87b6d2-b154-4734-9c8b-66e423b8bfb7 tempest-TestMinimumBasicScenario-21601527 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 11:58:58 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-9a87b6d2-b154-4734-9c8b-66e423b8bfb7 tempest-TestMinimumBasicScenario-21601527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:58:58 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-9a87b6d2-b154-4734-9c8b-66e423b8bfb7 tempest-TestMinimumBasicScenario-21601527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b1fdac9-bf7b-4248-8085-2521abc950a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f93ade87-7624-4c20-80ee-c3c99ad620ca', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:58:58 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-9a87b6d2-b154-4734-9c8b-66e423b8bfb7 tempest-TestMinimumBasicScenario-21601527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83f17f57-5be5-445d-a6aa-be21e1051433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 11:58:58 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-9a87b6d2-b154-4734-9c8b-66e423b8bfb7 tempest-TestMinimumBasicScenario-21601527 None] Volume volume-f93ade87-7624-4c20-80ee-c3c99ad620ca (f93ade87-7624-4c20-80ee-c3c99ad620ca): created successfully Sep 25 11:58:58 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-9a87b6d2-b154-4734-9c8b-66e423b8bfb7 tempest-TestMinimumBasicScenario-21601527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83f17f57-5be5-445d-a6aa-be21e1051433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 11:58:58 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-9a87b6d2-b154-4734-9c8b-66e423b8bfb7 tempest-TestMinimumBasicScenario-21601527 None] Flow 'volume_create_manager' (6838c127-c95d-457f-b547-354d889a4cef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 11:58:58 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-9a87b6d2-b154-4734-9c8b-66e423b8bfb7 tempest-TestMinimumBasicScenario-21601527 None] Created volume successfully. Sep 25 11:59:01 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-f417863f-4030-4d60-bc1c-8ecbeaf03908 req-1b4dc354-2d21-44bb-a54e-0472dfa4cbca tempest-TestMinimumBasicScenario-21601527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:59:01 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-f417863f-4030-4d60-bc1c-8ecbeaf03908 req-1b4dc354-2d21-44bb-a54e-0472dfa4cbca tempest-TestMinimumBasicScenario-21601527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:59:01 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-f417863f-4030-4d60-bc1c-8ecbeaf03908 req-1b4dc354-2d21-44bb-a54e-0472dfa4cbca tempest-TestMinimumBasicScenario-21601527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:59:01 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [req-f417863f-4030-4d60-bc1c-8ecbeaf03908 req-1b4dc354-2d21-44bb-a54e-0472dfa4cbca tempest-TestMinimumBasicScenario-21601527 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba', 'name': 'volume-f93ade87-7624-4c20-80ee-c3c99ad620ca', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1cd2ff4d-405b-4e31-bf57-9260e03e9fe7', 'enforce_multipath': True} {{(pid=86984) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 11:59:01 devstack cinder-volume[86984]: INFO cinder.volume.manager [req-f417863f-4030-4d60-bc1c-8ecbeaf03908 req-1b4dc354-2d21-44bb-a54e-0472dfa4cbca tempest-TestMinimumBasicScenario-21601527 None] attachment_update completed successfully. Sep 25 11:59:11 devstack cinder-volume[86984]: DEBUG dbcounter [-] [86984] Writing DB stats cinder:SELECT=8,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=86984) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:59:11 devstack cinder-volume[86984]: DEBUG dbcounter [-] [86984] Writing DB stats cinder:SELECT=9,cinder:UPDATE=5,cinder:INSERT=1 {{(pid=86984) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 11:59:26 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-e6f6a2ec-79a0-4e26-b124-049aff743443 req-35f411a1-7bff-4133-8986-74e1b47da82e tempest-TestStampPattern-968508865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:59:26 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-e6f6a2ec-79a0-4e26-b124-049aff743443 req-35f411a1-7bff-4133-8986-74e1b47da82e tempest-TestStampPattern-968508865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:59:26 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-e6f6a2ec-79a0-4e26-b124-049aff743443 req-35f411a1-7bff-4133-8986-74e1b47da82e tempest-TestStampPattern-968508865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:59:26 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [req-e6f6a2ec-79a0-4e26-b124-049aff743443 req-35f411a1-7bff-4133-8986-74e1b47da82e tempest-TestStampPattern-968508865 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba', 'name': 'volume-9e228b9c-6257-451d-8658-1a55d3250732', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a8084f68-80aa-4572-9d3b-46db4002e311', 'enforce_multipath': True} {{(pid=86984) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 11:59:26 devstack cinder-volume[86984]: INFO cinder.volume.manager [req-e6f6a2ec-79a0-4e26-b124-049aff743443 req-35f411a1-7bff-4133-8986-74e1b47da82e tempest-TestStampPattern-968508865 None] attachment_update completed successfully. Sep 25 11:59:30 devstack cinder-volume[86984]: INFO cinder.volume.manager [req-0e565378-27ba-4cc6-955d-23218229b4a4 req-0ac49980-1f51-4fd7-9e27-7168a4409ed1 tempest-TestStampPattern-968508865 None] Terminate volume connection completed successfully. Sep 25 11:59:30 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [req-0e565378-27ba-4cc6-955d-23218229b4a4 req-0ac49980-1f51-4fd7-9e27-7168a4409ed1 tempest-TestStampPattern-968508865 None] Deleting attachment a8084f68-80aa-4572-9d3b-46db4002e311. {{(pid=86984) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 11:59:35 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-3035d4a3-f026-4f11-a3b2-99e629da0985 tempest-TestStampPattern-968508865 None] Acquiring lock "cinder-9e228b9c-6257-451d-8658-1a55d3250732-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:59:35 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-3035d4a3-f026-4f11-a3b2-99e629da0985 tempest-TestStampPattern-968508865 None] Lock "cinder-9e228b9c-6257-451d-8658-1a55d3250732-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:59:35 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-3035d4a3-f026-4f11-a3b2-99e629da0985 tempest-TestStampPattern-968508865 None] Acquiring lock "cinder-quobyte-9e228b9c-6257-451d-8658-1a55d3250732" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:59:35 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-3035d4a3-f026-4f11-a3b2-99e629da0985 tempest-TestStampPattern-968508865 None] Lock "cinder-quobyte-9e228b9c-6257-451d-8658-1a55d3250732" acquired by "delete_volume" :: waited 0.015s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:59:35 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f84bb1-cbe0-414a-85be-5197270f6538]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:59:35 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3035d4a3-f026-4f11-a3b2-99e629da0985 tempest-TestStampPattern-968508865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9e228b9c-6257-451d-8658-1a55d3250732 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:59:35 devstack sudo[105827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9e228b9c-6257-451d-8658-1a55d3250732 Sep 25 11:59:35 devstack sudo[105827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:59:35 devstack sudo[105827]: pam_unix(sudo:session): session closed for user root Sep 25 11:59:35 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3035d4a3-f026-4f11-a3b2-99e629da0985 tempest-TestStampPattern-968508865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9e228b9c-6257-451d-8658-1a55d3250732" returned: 0 in 0.469s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:59:35 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3035d4a3-f026-4f11-a3b2-99e629da0985 tempest-TestStampPattern-968508865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9e228b9c-6257-451d-8658-1a55d3250732 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:59:35 devstack sudo[105832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9e228b9c-6257-451d-8658-1a55d3250732 Sep 25 11:59:35 devstack sudo[105832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:59:35 devstack sudo[105832]: pam_unix(sudo:session): session closed for user root Sep 25 11:59:35 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3035d4a3-f026-4f11-a3b2-99e629da0985 tempest-TestStampPattern-968508865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9e228b9c-6257-451d-8658-1a55d3250732" returned: 0 in 0.326s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:59:35 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-3035d4a3-f026-4f11-a3b2-99e629da0985 tempest-TestStampPattern-968508865 None] Lock "cinder-quobyte-9e228b9c-6257-451d-8658-1a55d3250732" released by "delete_volume" :: held 0.884s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:59:36 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-3035d4a3-f026-4f11-a3b2-99e629da0985 tempest-TestStampPattern-968508865 None] Created reservations ['17201310-2ba7-4efc-98b3-9fd884021359', 'f3d66836-d0ff-473d-92d1-976d98a768c9', '78a634dd-4154-4a1c-8fc4-0c461c32dd93', '442dc737-1791-4a5d-bd98-c5dc8f688e1a'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:59:36 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3035d4a3-f026-4f11-a3b2-99e629da0985 tempest-TestStampPattern-968508865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:59:36 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3035d4a3-f026-4f11-a3b2-99e629da0985 tempest-TestStampPattern-968508865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:59:36 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3035d4a3-f026-4f11-a3b2-99e629da0985 tempest-TestStampPattern-968508865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:59:36 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3035d4a3-f026-4f11-a3b2-99e629da0985 tempest-TestStampPattern-968508865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:59:36 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3035d4a3-f026-4f11-a3b2-99e629da0985 tempest-TestStampPattern-968508865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:59:36 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3035d4a3-f026-4f11-a3b2-99e629da0985 tempest-TestStampPattern-968508865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:59:36 devstack sudo[105835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:59:36 devstack sudo[105835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:59:36 devstack sudo[105835]: pam_unix(sudo:session): session closed for user root Sep 25 11:59:36 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3035d4a3-f026-4f11-a3b2-99e629da0985 tempest-TestStampPattern-968508865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.400s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:59:36 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-3035d4a3-f026-4f11-a3b2-99e629da0985 tempest-TestStampPattern-968508865 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:59:36 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-3035d4a3-f026-4f11-a3b2-99e629da0985 tempest-TestStampPattern-968508865 None] Deleted volume successfully. Sep 25 11:59:36 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-3035d4a3-f026-4f11-a3b2-99e629da0985 tempest-TestStampPattern-968508865 None] Lock "cinder-9e228b9c-6257-451d-8658-1a55d3250732-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:59:36 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-d979898c-cced-4239-9caf-1b9b026650a0 tempest-TestStampPattern-968508865 None] Acquiring lock "cinder-ac53e658-a24c-4577-88ad-f5f5fc43904e-delete_snapshot" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:59:36 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-d979898c-cced-4239-9caf-1b9b026650a0 tempest-TestStampPattern-968508865 None] Lock "cinder-ac53e658-a24c-4577-88ad-f5f5fc43904e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:59:36 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-d979898c-cced-4239-9caf-1b9b026650a0 tempest-TestStampPattern-968508865 None] Acquiring lock "cinder-quobyte-0eff559b-29de-48d2-9e06-6fdcf4611362" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:59:36 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-d979898c-cced-4239-9caf-1b9b026650a0 tempest-TestStampPattern-968508865 None] Lock "cinder-quobyte-0eff559b-29de-48d2-9e06-6fdcf4611362" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:59:36 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-d979898c-cced-4239-9caf-1b9b026650a0 tempest-TestStampPattern-968508865 None] Acquiring lock "cinder-quobyte-ac53e658-a24c-4577-88ad-f5f5fc43904e" by "_delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:59:36 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-d979898c-cced-4239-9caf-1b9b026650a0 tempest-TestStampPattern-968508865 None] Lock "cinder-quobyte-ac53e658-a24c-4577-88ad-f5f5fc43904e" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:59:36 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-d979898c-cced-4239-9caf-1b9b026650a0 tempest-TestStampPattern-968508865 None] Deleting offline snapshot ac53e658-a24c-4577-88ad-f5f5fc43904e of volume 0eff559b-29de-48d2-9e06-6fdcf4611362 {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 11:59:36 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-d979898c-cced-4239-9caf-1b9b026650a0 tempest-TestStampPattern-968508865 None] snapshot_file for this snap is: volume-0eff559b-29de-48d2-9e06-6fdcf4611362.ac53e658-a24c-4577-88ad-f5f5fc43904e {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 11:59:36 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f31cc0-2cc0-4ec6-b290-d0f09518cc79]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:59:36 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d979898c-cced-4239-9caf-1b9b026650a0 tempest-TestStampPattern-968508865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0eff559b-29de-48d2-9e06-6fdcf4611362.ac53e658-a24c-4577-88ad-f5f5fc43904e {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:59:36 devstack sudo[105838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0eff559b-29de-48d2-9e06-6fdcf4611362.ac53e658-a24c-4577-88ad-f5f5fc43904e Sep 25 11:59:36 devstack sudo[105838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:59:37 devstack sudo[105838]: pam_unix(sudo:session): session closed for user root Sep 25 11:59:37 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d979898c-cced-4239-9caf-1b9b026650a0 tempest-TestStampPattern-968508865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0eff559b-29de-48d2-9e06-6fdcf4611362.ac53e658-a24c-4577-88ad-f5f5fc43904e" returned: 0 in 0.387s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:59:37 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-d979898c-cced-4239-9caf-1b9b026650a0 tempest-TestStampPattern-968508865 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0eff559b-29de-48d2-9e06-6fdcf4611362(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86984) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 11:59:37 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ca3eae-f573-4835-a6dd-b5a462e9d129]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:59:37 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d979898c-cced-4239-9caf-1b9b026650a0 tempest-TestStampPattern-968508865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0eff559b-29de-48d2-9e06-6fdcf4611362 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:59:37 devstack sudo[105843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0eff559b-29de-48d2-9e06-6fdcf4611362 Sep 25 11:59:37 devstack sudo[105843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:59:37 devstack sudo[105843]: pam_unix(sudo:session): session closed for user root Sep 25 11:59:37 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d979898c-cced-4239-9caf-1b9b026650a0 tempest-TestStampPattern-968508865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0eff559b-29de-48d2-9e06-6fdcf4611362" returned: 0 in 0.569s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:59:37 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d979898c-cced-4239-9caf-1b9b026650a0 tempest-TestStampPattern-968508865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0eff559b-29de-48d2-9e06-6fdcf4611362.ac53e658-a24c-4577-88ad-f5f5fc43904e {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:59:37 devstack sudo[105849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0eff559b-29de-48d2-9e06-6fdcf4611362.ac53e658-a24c-4577-88ad-f5f5fc43904e Sep 25 11:59:37 devstack sudo[105849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:59:38 devstack sudo[105849]: pam_unix(sudo:session): session closed for user root Sep 25 11:59:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d979898c-cced-4239-9caf-1b9b026650a0 tempest-TestStampPattern-968508865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0eff559b-29de-48d2-9e06-6fdcf4611362.ac53e658-a24c-4577-88ad-f5f5fc43904e" returned: 0 in 0.366s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:59:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d979898c-cced-4239-9caf-1b9b026650a0 tempest-TestStampPattern-968508865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0eff559b-29de-48d2-9e06-6fdcf4611362.ac53e658-a24c-4577-88ad-f5f5fc43904e {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:59:38 devstack sudo[105854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0eff559b-29de-48d2-9e06-6fdcf4611362.ac53e658-a24c-4577-88ad-f5f5fc43904e Sep 25 11:59:38 devstack sudo[105854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:59:38 devstack sudo[105854]: pam_unix(sudo:session): session closed for user root Sep 25 11:59:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d979898c-cced-4239-9caf-1b9b026650a0 tempest-TestStampPattern-968508865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0eff559b-29de-48d2-9e06-6fdcf4611362.ac53e658-a24c-4577-88ad-f5f5fc43904e" returned: 0 in 0.294s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:59:38 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-d979898c-cced-4239-9caf-1b9b026650a0 tempest-TestStampPattern-968508865 None] Lock "cinder-quobyte-ac53e658-a24c-4577-88ad-f5f5fc43904e" released by "_delete_snapshot" :: held 1.725s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:59:38 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-d979898c-cced-4239-9caf-1b9b026650a0 tempest-TestStampPattern-968508865 None] Lock "cinder-quobyte-0eff559b-29de-48d2-9e06-6fdcf4611362" released by "delete_snapshot" :: held 1.758s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:59:38 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-d979898c-cced-4239-9caf-1b9b026650a0 tempest-TestStampPattern-968508865 None] Created reservations ['162fad4b-c789-4a9a-9a1c-2306bfc4622f', '05be4686-3d10-454a-93ce-6b893507dbd0', '694600ca-c6ef-46ee-8b72-dc52813e3c79', 'dccc2ea8-73be-48e0-8d8c-299ef6515922'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:59:38 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-d979898c-cced-4239-9caf-1b9b026650a0 tempest-TestStampPattern-968508865 None] Delete snapshot completed successfully. Sep 25 11:59:38 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-d979898c-cced-4239-9caf-1b9b026650a0 tempest-TestStampPattern-968508865 None] Lock "cinder-ac53e658-a24c-4577-88ad-f5f5fc43904e-delete_snapshot" released by "delete_snapshot" :: held 1.911s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:59:38 devstack cinder-volume[86984]: DEBUG oslo_service.periodic_task [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:59:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:59:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:59:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:59:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:59:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:59:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:59:38 devstack sudo[105860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:59:38 devstack sudo[105860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:59:38 devstack sudo[105860]: pam_unix(sudo:session): session closed for user root Sep 25 11:59:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.296s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:59:38 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:59:38 devstack cinder-volume[86984]: DEBUG oslo_service.periodic_task [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running periodic task VolumeManager._thread_info {{(pid=86984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 11:59:38 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] thread count: 28 {{(pid=86984) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 11:59:38 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] thread info: [<_MainThread(MainThread, started 132046492332160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86984) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 11:59:42 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-c0648435-6047-4dff-99a4-9b969219d584 tempest-TestStampPattern-968508865 None] Acquiring lock "cinder-0eff559b-29de-48d2-9e06-6fdcf4611362-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:59:42 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-c0648435-6047-4dff-99a4-9b969219d584 tempest-TestStampPattern-968508865 None] Lock "cinder-0eff559b-29de-48d2-9e06-6fdcf4611362-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:59:42 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-c0648435-6047-4dff-99a4-9b969219d584 tempest-TestStampPattern-968508865 None] Acquiring lock "cinder-quobyte-0eff559b-29de-48d2-9e06-6fdcf4611362" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:59:42 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-c0648435-6047-4dff-99a4-9b969219d584 tempest-TestStampPattern-968508865 None] Lock "cinder-quobyte-0eff559b-29de-48d2-9e06-6fdcf4611362" acquired by "delete_volume" :: waited 0.017s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:59:42 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc1f9f31-6a00-4b37-be3e-4486d0a6bebd]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:59:42 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-c0648435-6047-4dff-99a4-9b969219d584 tempest-TestStampPattern-968508865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0eff559b-29de-48d2-9e06-6fdcf4611362 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:59:42 devstack sudo[105900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0eff559b-29de-48d2-9e06-6fdcf4611362 Sep 25 11:59:42 devstack sudo[105900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:59:43 devstack sudo[105900]: pam_unix(sudo:session): session closed for user root Sep 25 11:59:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-c0648435-6047-4dff-99a4-9b969219d584 tempest-TestStampPattern-968508865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0eff559b-29de-48d2-9e06-6fdcf4611362" returned: 0 in 0.387s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:59:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-c0648435-6047-4dff-99a4-9b969219d584 tempest-TestStampPattern-968508865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0eff559b-29de-48d2-9e06-6fdcf4611362 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:59:43 devstack sudo[105905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0eff559b-29de-48d2-9e06-6fdcf4611362 Sep 25 11:59:43 devstack sudo[105905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:59:43 devstack sudo[105905]: pam_unix(sudo:session): session closed for user root Sep 25 11:59:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-c0648435-6047-4dff-99a4-9b969219d584 tempest-TestStampPattern-968508865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0eff559b-29de-48d2-9e06-6fdcf4611362" returned: 0 in 0.260s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:59:43 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-c0648435-6047-4dff-99a4-9b969219d584 tempest-TestStampPattern-968508865 None] Lock "cinder-quobyte-0eff559b-29de-48d2-9e06-6fdcf4611362" released by "delete_volume" :: held 0.721s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:59:43 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-c0648435-6047-4dff-99a4-9b969219d584 tempest-TestStampPattern-968508865 None] Created reservations ['6a50f33a-3eae-4060-acae-20bb991269b5', '245f177f-141d-43f3-9542-d1cee82411ea', '6c68bae1-a9fa-44ed-b407-d7ad4ee16251', 'de3c6d8a-9840-431c-9c93-e349604726ec'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:59:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-c0648435-6047-4dff-99a4-9b969219d584 tempest-TestStampPattern-968508865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:59:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-c0648435-6047-4dff-99a4-9b969219d584 tempest-TestStampPattern-968508865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:59:43 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-c0648435-6047-4dff-99a4-9b969219d584 tempest-TestStampPattern-968508865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:59:43 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-c0648435-6047-4dff-99a4-9b969219d584 tempest-TestStampPattern-968508865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:59:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-c0648435-6047-4dff-99a4-9b969219d584 tempest-TestStampPattern-968508865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:59:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-c0648435-6047-4dff-99a4-9b969219d584 tempest-TestStampPattern-968508865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:59:43 devstack sudo[105908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:59:43 devstack sudo[105908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:59:43 devstack sudo[105908]: pam_unix(sudo:session): session closed for user root Sep 25 11:59:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-c0648435-6047-4dff-99a4-9b969219d584 tempest-TestStampPattern-968508865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.304s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:59:43 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-c0648435-6047-4dff-99a4-9b969219d584 tempest-TestStampPattern-968508865 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:59:43 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-c0648435-6047-4dff-99a4-9b969219d584 tempest-TestStampPattern-968508865 None] Deleted volume successfully. Sep 25 11:59:43 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-c0648435-6047-4dff-99a4-9b969219d584 tempest-TestStampPattern-968508865 None] Lock "cinder-0eff559b-29de-48d2-9e06-6fdcf4611362-delete_volume" released by "delete_volume" :: held 1.284s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:59:52 devstack cinder-volume[86984]: INFO cinder.volume.manager [req-94ddb936-de92-4cf6-bc0d-68a7d64a6eb4 req-1499c16e-4b77-4ede-bd2a-8665f3285385 tempest-TestMinimumBasicScenario-21601527 None] Terminate volume connection completed successfully. Sep 25 11:59:52 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [req-94ddb936-de92-4cf6-bc0d-68a7d64a6eb4 req-1499c16e-4b77-4ede-bd2a-8665f3285385 tempest-TestMinimumBasicScenario-21601527 None] Deleting attachment 1cd2ff4d-405b-4e31-bf57-9260e03e9fe7. {{(pid=86984) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 11:59:52 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ca0ca8d8-7ffc-4737-8a51-b0d2ec9a1972 tempest-TestMinimumBasicScenario-21601527 None] Acquiring lock "cinder-f93ade87-7624-4c20-80ee-c3c99ad620ca-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:59:52 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ca0ca8d8-7ffc-4737-8a51-b0d2ec9a1972 tempest-TestMinimumBasicScenario-21601527 None] Lock "cinder-f93ade87-7624-4c20-80ee-c3c99ad620ca-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:59:52 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ca0ca8d8-7ffc-4737-8a51-b0d2ec9a1972 tempest-TestMinimumBasicScenario-21601527 None] Acquiring lock "cinder-quobyte-f93ade87-7624-4c20-80ee-c3c99ad620ca" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 11:59:52 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ca0ca8d8-7ffc-4737-8a51-b0d2ec9a1972 tempest-TestMinimumBasicScenario-21601527 None] Lock "cinder-quobyte-f93ade87-7624-4c20-80ee-c3c99ad620ca" acquired by "delete_volume" :: waited 0.019s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 11:59:52 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb20cbac-fdbe-46d8-aaf0-c2285db2415d]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 11:59:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ca0ca8d8-7ffc-4737-8a51-b0d2ec9a1972 tempest-TestMinimumBasicScenario-21601527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f93ade87-7624-4c20-80ee-c3c99ad620ca {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:59:53 devstack sudo[105928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f93ade87-7624-4c20-80ee-c3c99ad620ca Sep 25 11:59:53 devstack sudo[105928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:59:53 devstack sudo[105928]: pam_unix(sudo:session): session closed for user root Sep 25 11:59:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ca0ca8d8-7ffc-4737-8a51-b0d2ec9a1972 tempest-TestMinimumBasicScenario-21601527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f93ade87-7624-4c20-80ee-c3c99ad620ca" returned: 0 in 0.489s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:59:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ca0ca8d8-7ffc-4737-8a51-b0d2ec9a1972 tempest-TestMinimumBasicScenario-21601527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f93ade87-7624-4c20-80ee-c3c99ad620ca {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:59:53 devstack sudo[105933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f93ade87-7624-4c20-80ee-c3c99ad620ca Sep 25 11:59:53 devstack sudo[105933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:59:53 devstack sudo[105933]: pam_unix(sudo:session): session closed for user root Sep 25 11:59:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ca0ca8d8-7ffc-4737-8a51-b0d2ec9a1972 tempest-TestMinimumBasicScenario-21601527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f93ade87-7624-4c20-80ee-c3c99ad620ca" returned: 0 in 0.326s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:59:53 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ca0ca8d8-7ffc-4737-8a51-b0d2ec9a1972 tempest-TestMinimumBasicScenario-21601527 None] Lock "cinder-quobyte-f93ade87-7624-4c20-80ee-c3c99ad620ca" released by "delete_volume" :: held 0.878s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 11:59:53 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-ca0ca8d8-7ffc-4737-8a51-b0d2ec9a1972 tempest-TestMinimumBasicScenario-21601527 None] Created reservations ['6266e9dc-6423-42ab-8d53-8e22278aa962', '32472eb2-dd8d-46a0-b880-39574a826d87', 'f932c3ab-258d-454e-af9c-22bd7acf957a', '43caef50-cc9f-43c7-8148-e390cfba8315'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 11:59:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-ca0ca8d8-7ffc-4737-8a51-b0d2ec9a1972 tempest-TestMinimumBasicScenario-21601527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 11:59:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-ca0ca8d8-7ffc-4737-8a51-b0d2ec9a1972 tempest-TestMinimumBasicScenario-21601527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 11:59:54 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-ca0ca8d8-7ffc-4737-8a51-b0d2ec9a1972 tempest-TestMinimumBasicScenario-21601527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 11:59:54 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-ca0ca8d8-7ffc-4737-8a51-b0d2ec9a1972 tempest-TestMinimumBasicScenario-21601527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 11:59:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-ca0ca8d8-7ffc-4737-8a51-b0d2ec9a1972 tempest-TestMinimumBasicScenario-21601527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 11:59:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ca0ca8d8-7ffc-4737-8a51-b0d2ec9a1972 tempest-TestMinimumBasicScenario-21601527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 11:59:54 devstack sudo[105937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 11:59:54 devstack sudo[105937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 11:59:54 devstack sudo[105937]: pam_unix(sudo:session): session closed for user root Sep 25 11:59:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ca0ca8d8-7ffc-4737-8a51-b0d2ec9a1972 tempest-TestMinimumBasicScenario-21601527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.314s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 11:59:54 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-ca0ca8d8-7ffc-4737-8a51-b0d2ec9a1972 tempest-TestMinimumBasicScenario-21601527 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 11:59:54 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-ca0ca8d8-7ffc-4737-8a51-b0d2ec9a1972 tempest-TestMinimumBasicScenario-21601527 None] Deleted volume successfully. Sep 25 11:59:54 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ca0ca8d8-7ffc-4737-8a51-b0d2ec9a1972 tempest-TestMinimumBasicScenario-21601527 None] Lock "cinder-f93ade87-7624-4c20-80ee-c3c99ad620ca-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:00:00 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2debaf8-2a12-4f39-82ad-07686cdf2bdb tempest-CreateVolumesFromImageTest-1350814724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:00:00 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f2debaf8-2a12-4f39-82ad-07686cdf2bdb tempest-CreateVolumesFromImageTest-1350814724 None] Flow 'volume_create_manager' (152d062e-c6ee-44f4-9925-c05fc7e0b0c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:00:00 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f2debaf8-2a12-4f39-82ad-07686cdf2bdb tempest-CreateVolumesFromImageTest-1350814724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e0cbb05-3ed5-4342-8289-0efb14cf689b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:00:00 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f2debaf8-2a12-4f39-82ad-07686cdf2bdb tempest-CreateVolumesFromImageTest-1350814724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e0cbb05-3ed5-4342-8289-0efb14cf689b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:00:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1019353577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f84909f8-45a3-4215-90f3-ae2f13d5c04e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b55709c9d03e426389f10a3ebe854007',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:00:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:00:00Z,use_quota=True,user_id='451347667bf74ebfada9a4630b953ed6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:00:00 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f2debaf8-2a12-4f39-82ad-07686cdf2bdb tempest-CreateVolumesFromImageTest-1350814724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d338813c-aaec-4f42-b8cc-7be90b713d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:00:00 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f2debaf8-2a12-4f39-82ad-07686cdf2bdb tempest-CreateVolumesFromImageTest-1350814724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d338813c-aaec-4f42-b8cc-7be90b713d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:00:00 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f2debaf8-2a12-4f39-82ad-07686cdf2bdb tempest-CreateVolumesFromImageTest-1350814724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2758cef2-eee0-4a32-b37c-7d8906c7bbb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:00:00 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f2debaf8-2a12-4f39-82ad-07686cdf2bdb tempest-CreateVolumesFromImageTest-1350814724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2758cef2-eee0-4a32-b37c-7d8906c7bbb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f84909f8-45a3-4215-90f3-ae2f13d5c04e', 'volume_name': 'volume-f84909f8-45a3-4215-90f3-ae2f13d5c04e', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:00:00 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f2debaf8-2a12-4f39-82ad-07686cdf2bdb tempest-CreateVolumesFromImageTest-1350814724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a64fb2b-dd8e-403d-840e-13d7559ad1e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:00:00 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f2debaf8-2a12-4f39-82ad-07686cdf2bdb tempest-CreateVolumesFromImageTest-1350814724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a64fb2b-dd8e-403d-840e-13d7559ad1e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:00:00 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f2debaf8-2a12-4f39-82ad-07686cdf2bdb tempest-CreateVolumesFromImageTest-1350814724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6da34893-8c64-4bab-b676-53912efe544e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:00:00 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-f2debaf8-2a12-4f39-82ad-07686cdf2bdb tempest-CreateVolumesFromImageTest-1350814724 None] Volume f84909f8-45a3-4215-90f3-ae2f13d5c04e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f84909f8-45a3-4215-90f3-ae2f13d5c04e', 'volume_size': 1} Sep 25 12:00:00 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f2debaf8-2a12-4f39-82ad-07686cdf2bdb tempest-CreateVolumesFromImageTest-1350814724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:00:00 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f2debaf8-2a12-4f39-82ad-07686cdf2bdb tempest-CreateVolumesFromImageTest-1350814724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:00:00 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-f2debaf8-2a12-4f39-82ad-07686cdf2bdb tempest-CreateVolumesFromImageTest-1350814724 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:00:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1019353577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f84909f8-45a3-4215-90f3-ae2f13d5c04e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b55709c9d03e426389f10a3ebe854007',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:00:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:00:00Z,use_quota=True,user_id='451347667bf74ebfada9a4630b953ed6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:00:00 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-f2debaf8-2a12-4f39-82ad-07686cdf2bdb tempest-CreateVolumesFromImageTest-1350814724 None] Creating volume f84909f8-45a3-4215-90f3-ae2f13d5c04e {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:00:00 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f2debaf8-2a12-4f39-82ad-07686cdf2bdb tempest-CreateVolumesFromImageTest-1350814724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:00:00 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f2debaf8-2a12-4f39-82ad-07686cdf2bdb tempest-CreateVolumesFromImageTest-1350814724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:00:00 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-f2debaf8-2a12-4f39-82ad-07686cdf2bdb tempest-CreateVolumesFromImageTest-1350814724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:00:00 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-f2debaf8-2a12-4f39-82ad-07686cdf2bdb tempest-CreateVolumesFromImageTest-1350814724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:00:00 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f2debaf8-2a12-4f39-82ad-07686cdf2bdb tempest-CreateVolumesFromImageTest-1350814724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:00:00 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-f2debaf8-2a12-4f39-82ad-07686cdf2bdb tempest-CreateVolumesFromImageTest-1350814724 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:00:00 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-f2debaf8-2a12-4f39-82ad-07686cdf2bdb tempest-CreateVolumesFromImageTest-1350814724 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 12:00:00 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f2debaf8-2a12-4f39-82ad-07686cdf2bdb tempest-CreateVolumesFromImageTest-1350814724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f84909f8-45a3-4215-90f3-ae2f13d5c04e 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:00:00 devstack sudo[106004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f84909f8-45a3-4215-90f3-ae2f13d5c04e 1073741824 Sep 25 12:00:00 devstack sudo[106004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:00:00 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-28f745fc-c6fb-40e7-9d85-0e639df3176c tempest-CreateVolumesFromImageTest-1350814724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:00:00 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-28f745fc-c6fb-40e7-9d85-0e639df3176c tempest-CreateVolumesFromImageTest-1350814724 None] Flow 'volume_create_manager' (87edbe41-4033-41fc-9ba5-bcf66b80c9ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:00:01 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-28f745fc-c6fb-40e7-9d85-0e639df3176c tempest-CreateVolumesFromImageTest-1350814724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5ad82cb-efcf-423b-9b29-2a0f7d038e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:00:01 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-28f745fc-c6fb-40e7-9d85-0e639df3176c tempest-CreateVolumesFromImageTest-1350814724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5ad82cb-efcf-423b-9b29-2a0f7d038e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:00:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-5185678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23af5b2e-ab1a-48ac-8ea5-4d93908d1914,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b55709c9d03e426389f10a3ebe854007',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:00:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:00:01Z,use_quota=True,user_id='451347667bf74ebfada9a4630b953ed6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:00:01 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-28f745fc-c6fb-40e7-9d85-0e639df3176c tempest-CreateVolumesFromImageTest-1350814724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (841adb8f-f888-4e80-9118-8a03ae2e6451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:00:01 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-28f745fc-c6fb-40e7-9d85-0e639df3176c tempest-CreateVolumesFromImageTest-1350814724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (841adb8f-f888-4e80-9118-8a03ae2e6451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:00:01 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-28f745fc-c6fb-40e7-9d85-0e639df3176c tempest-CreateVolumesFromImageTest-1350814724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7c0348b-7b14-4008-9978-f04dd9964078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:00:01 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-28f745fc-c6fb-40e7-9d85-0e639df3176c tempest-CreateVolumesFromImageTest-1350814724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7c0348b-7b14-4008-9978-f04dd9964078) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23af5b2e-ab1a-48ac-8ea5-4d93908d1914', 'volume_name': 'volume-23af5b2e-ab1a-48ac-8ea5-4d93908d1914', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:00:01 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-28f745fc-c6fb-40e7-9d85-0e639df3176c tempest-CreateVolumesFromImageTest-1350814724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c0752e1-9fa0-4bcd-a4f3-dfa1f28b15b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:00:01 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-28f745fc-c6fb-40e7-9d85-0e639df3176c tempest-CreateVolumesFromImageTest-1350814724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c0752e1-9fa0-4bcd-a4f3-dfa1f28b15b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:00:01 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-28f745fc-c6fb-40e7-9d85-0e639df3176c tempest-CreateVolumesFromImageTest-1350814724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f632fe5a-d979-4ac1-be3e-7b844b3867eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:00:01 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-28f745fc-c6fb-40e7-9d85-0e639df3176c tempest-CreateVolumesFromImageTest-1350814724 None] Volume 23af5b2e-ab1a-48ac-8ea5-4d93908d1914: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23af5b2e-ab1a-48ac-8ea5-4d93908d1914', 'volume_size': 1} Sep 25 12:00:01 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-28f745fc-c6fb-40e7-9d85-0e639df3176c tempest-CreateVolumesFromImageTest-1350814724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:00:01 devstack sudo[106004]: pam_unix(sudo:session): session closed for user root Sep 25 12:00:01 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f2debaf8-2a12-4f39-82ad-07686cdf2bdb tempest-CreateVolumesFromImageTest-1350814724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f84909f8-45a3-4215-90f3-ae2f13d5c04e 1073741824" returned: 0 in 0.723s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:00:01 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f2debaf8-2a12-4f39-82ad-07686cdf2bdb tempest-CreateVolumesFromImageTest-1350814724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f84909f8-45a3-4215-90f3-ae2f13d5c04e {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:00:01 devstack sudo[106011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f84909f8-45a3-4215-90f3-ae2f13d5c04e Sep 25 12:00:01 devstack sudo[106011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:00:01 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9b69a10-6f6d-4ff3-913b-f9f0cd664c58 tempest-CreateVolumesFromImageTest-1350814724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:00:01 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-c9b69a10-6f6d-4ff3-913b-f9f0cd664c58 tempest-CreateVolumesFromImageTest-1350814724 None] Flow 'volume_create_manager' (9a82db21-9e4d-415b-ba22-f2902b1c9db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:00:01 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-c9b69a10-6f6d-4ff3-913b-f9f0cd664c58 tempest-CreateVolumesFromImageTest-1350814724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bfe6e57-3632-4b7e-b2bd-a9170faa45a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:00:01 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-c9b69a10-6f6d-4ff3-913b-f9f0cd664c58 tempest-CreateVolumesFromImageTest-1350814724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bfe6e57-3632-4b7e-b2bd-a9170faa45a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:00:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1730907516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=394e208f-c77d-4919-a21b-5a30ce866bca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b55709c9d03e426389f10a3ebe854007',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:00:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:00:01Z,use_quota=True,user_id='451347667bf74ebfada9a4630b953ed6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:00:01 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-c9b69a10-6f6d-4ff3-913b-f9f0cd664c58 tempest-CreateVolumesFromImageTest-1350814724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faec8300-00c6-46ea-81c5-4df48f7d8bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:00:01 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-c9b69a10-6f6d-4ff3-913b-f9f0cd664c58 tempest-CreateVolumesFromImageTest-1350814724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faec8300-00c6-46ea-81c5-4df48f7d8bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:00:01 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-c9b69a10-6f6d-4ff3-913b-f9f0cd664c58 tempest-CreateVolumesFromImageTest-1350814724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a56fe49-8773-4f2d-a2ad-51eca96a0870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:00:01 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-c9b69a10-6f6d-4ff3-913b-f9f0cd664c58 tempest-CreateVolumesFromImageTest-1350814724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a56fe49-8773-4f2d-a2ad-51eca96a0870) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '394e208f-c77d-4919-a21b-5a30ce866bca', 'volume_name': 'volume-394e208f-c77d-4919-a21b-5a30ce866bca', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:00:01 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-c9b69a10-6f6d-4ff3-913b-f9f0cd664c58 tempest-CreateVolumesFromImageTest-1350814724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f62d695e-0f2c-4241-86be-f47d7e07d36f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:00:01 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-c9b69a10-6f6d-4ff3-913b-f9f0cd664c58 tempest-CreateVolumesFromImageTest-1350814724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f62d695e-0f2c-4241-86be-f47d7e07d36f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:00:01 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-c9b69a10-6f6d-4ff3-913b-f9f0cd664c58 tempest-CreateVolumesFromImageTest-1350814724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9929b4b-54d2-4526-9a2f-ad9de2de74e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:00:01 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-c9b69a10-6f6d-4ff3-913b-f9f0cd664c58 tempest-CreateVolumesFromImageTest-1350814724 None] Volume 394e208f-c77d-4919-a21b-5a30ce866bca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-394e208f-c77d-4919-a21b-5a30ce866bca', 'volume_size': 1} Sep 25 12:00:01 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-c9b69a10-6f6d-4ff3-913b-f9f0cd664c58 tempest-CreateVolumesFromImageTest-1350814724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:00:01 devstack sudo[106011]: pam_unix(sudo:session): session closed for user root Sep 25 12:00:01 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f2debaf8-2a12-4f39-82ad-07686cdf2bdb tempest-CreateVolumesFromImageTest-1350814724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f84909f8-45a3-4215-90f3-ae2f13d5c04e" returned: 0 in 0.388s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:00:01 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-f2debaf8-2a12-4f39-82ad-07686cdf2bdb tempest-CreateVolumesFromImageTest-1350814724 None] <== create_volume: return (1199ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:00:01 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f2debaf8-2a12-4f39-82ad-07686cdf2bdb tempest-CreateVolumesFromImageTest-1350814724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.204s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:00:01 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-28f745fc-c6fb-40e7-9d85-0e639df3176c tempest-CreateVolumesFromImageTest-1350814724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.593s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:00:01 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-28f745fc-c6fb-40e7-9d85-0e639df3176c tempest-CreateVolumesFromImageTest-1350814724 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:00:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-5185678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23af5b2e-ab1a-48ac-8ea5-4d93908d1914,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b55709c9d03e426389f10a3ebe854007',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:00:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:00:01Z,use_quota=True,user_id='451347667bf74ebfada9a4630b953ed6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:00:01 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-28f745fc-c6fb-40e7-9d85-0e639df3176c tempest-CreateVolumesFromImageTest-1350814724 None] Creating volume 23af5b2e-ab1a-48ac-8ea5-4d93908d1914 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:00:01 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-28f745fc-c6fb-40e7-9d85-0e639df3176c tempest-CreateVolumesFromImageTest-1350814724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:00:01 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-28f745fc-c6fb-40e7-9d85-0e639df3176c tempest-CreateVolumesFromImageTest-1350814724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:00:01 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-28f745fc-c6fb-40e7-9d85-0e639df3176c tempest-CreateVolumesFromImageTest-1350814724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:00:01 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-28f745fc-c6fb-40e7-9d85-0e639df3176c tempest-CreateVolumesFromImageTest-1350814724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:00:01 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-28f745fc-c6fb-40e7-9d85-0e639df3176c tempest-CreateVolumesFromImageTest-1350814724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:00:01 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-28f745fc-c6fb-40e7-9d85-0e639df3176c tempest-CreateVolumesFromImageTest-1350814724 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:00:01 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-28f745fc-c6fb-40e7-9d85-0e639df3176c tempest-CreateVolumesFromImageTest-1350814724 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 12:00:01 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-28f745fc-c6fb-40e7-9d85-0e639df3176c tempest-CreateVolumesFromImageTest-1350814724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23af5b2e-ab1a-48ac-8ea5-4d93908d1914 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:00:01 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f2debaf8-2a12-4f39-82ad-07686cdf2bdb tempest-CreateVolumesFromImageTest-1350814724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6da34893-8c64-4bab-b676-53912efe544e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f84909f8-45a3-4215-90f3-ae2f13d5c04e', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:00:01 devstack sudo[106014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23af5b2e-ab1a-48ac-8ea5-4d93908d1914 1073741824 Sep 25 12:00:01 devstack sudo[106014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:00:01 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f2debaf8-2a12-4f39-82ad-07686cdf2bdb tempest-CreateVolumesFromImageTest-1350814724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5a23e64-97f4-4720-86d8-83c887696553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:00:01 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-f2debaf8-2a12-4f39-82ad-07686cdf2bdb tempest-CreateVolumesFromImageTest-1350814724 None] Volume volume-f84909f8-45a3-4215-90f3-ae2f13d5c04e (f84909f8-45a3-4215-90f3-ae2f13d5c04e): created successfully Sep 25 12:00:01 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f2debaf8-2a12-4f39-82ad-07686cdf2bdb tempest-CreateVolumesFromImageTest-1350814724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5a23e64-97f4-4720-86d8-83c887696553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:00:01 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f2debaf8-2a12-4f39-82ad-07686cdf2bdb tempest-CreateVolumesFromImageTest-1350814724 None] Flow 'volume_create_manager' (152d062e-c6ee-44f4-9925-c05fc7e0b0c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:00:01 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-f2debaf8-2a12-4f39-82ad-07686cdf2bdb tempest-CreateVolumesFromImageTest-1350814724 None] Created volume successfully. Sep 25 12:00:01 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-3889d2eb-a5ca-4995-a00e-4d1aca094c3b tempest-CreateVolumesFromImageTest-1350814724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:00:02 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3889d2eb-a5ca-4995-a00e-4d1aca094c3b tempest-CreateVolumesFromImageTest-1350814724 None] Flow 'volume_create_manager' (0bdcac7e-dcd9-46b6-b3b9-705360b924c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:00:02 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3889d2eb-a5ca-4995-a00e-4d1aca094c3b tempest-CreateVolumesFromImageTest-1350814724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4417694-5978-43b8-a906-a18fc1cde83d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:00:02 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3889d2eb-a5ca-4995-a00e-4d1aca094c3b tempest-CreateVolumesFromImageTest-1350814724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4417694-5978-43b8-a906-a18fc1cde83d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:00:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-322101678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b6fe22a-ab19-44d6-88d8-04cde69d2848,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b55709c9d03e426389f10a3ebe854007',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:00:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:00:02Z,use_quota=True,user_id='451347667bf74ebfada9a4630b953ed6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:00:02 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3889d2eb-a5ca-4995-a00e-4d1aca094c3b tempest-CreateVolumesFromImageTest-1350814724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd04484f-f6e8-4fd6-b1b3-7562944f2af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:00:02 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3889d2eb-a5ca-4995-a00e-4d1aca094c3b tempest-CreateVolumesFromImageTest-1350814724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd04484f-f6e8-4fd6-b1b3-7562944f2af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:00:02 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3889d2eb-a5ca-4995-a00e-4d1aca094c3b tempest-CreateVolumesFromImageTest-1350814724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3191efa-4dba-4c96-806a-73f4db16b7d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:00:02 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3889d2eb-a5ca-4995-a00e-4d1aca094c3b tempest-CreateVolumesFromImageTest-1350814724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3191efa-4dba-4c96-806a-73f4db16b7d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b6fe22a-ab19-44d6-88d8-04cde69d2848', 'volume_name': 'volume-0b6fe22a-ab19-44d6-88d8-04cde69d2848', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:00:02 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3889d2eb-a5ca-4995-a00e-4d1aca094c3b tempest-CreateVolumesFromImageTest-1350814724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0678ff6f-7f56-477e-9d52-876c19e1955a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:00:02 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3889d2eb-a5ca-4995-a00e-4d1aca094c3b tempest-CreateVolumesFromImageTest-1350814724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0678ff6f-7f56-477e-9d52-876c19e1955a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:00:02 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3889d2eb-a5ca-4995-a00e-4d1aca094c3b tempest-CreateVolumesFromImageTest-1350814724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4e474cb-5ab5-4bbc-b04a-7fc60643580e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:00:02 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-3889d2eb-a5ca-4995-a00e-4d1aca094c3b tempest-CreateVolumesFromImageTest-1350814724 None] Volume 0b6fe22a-ab19-44d6-88d8-04cde69d2848: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b6fe22a-ab19-44d6-88d8-04cde69d2848', 'volume_size': 1} Sep 25 12:00:02 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3889d2eb-a5ca-4995-a00e-4d1aca094c3b tempest-CreateVolumesFromImageTest-1350814724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:00:02 devstack sudo[106014]: pam_unix(sudo:session): session closed for user root Sep 25 12:00:02 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-28f745fc-c6fb-40e7-9d85-0e639df3176c tempest-CreateVolumesFromImageTest-1350814724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23af5b2e-ab1a-48ac-8ea5-4d93908d1914 1073741824" returned: 0 in 0.722s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:00:02 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-28f745fc-c6fb-40e7-9d85-0e639df3176c tempest-CreateVolumesFromImageTest-1350814724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23af5b2e-ab1a-48ac-8ea5-4d93908d1914 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:00:02 devstack sudo[106020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23af5b2e-ab1a-48ac-8ea5-4d93908d1914 Sep 25 12:00:02 devstack sudo[106020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:00:02 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ff3fa37-5782-4475-a0ff-9a066e8be92e tempest-CreateVolumesFromImageTest-1350814724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:00:02 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6ff3fa37-5782-4475-a0ff-9a066e8be92e tempest-CreateVolumesFromImageTest-1350814724 None] Flow 'volume_create_manager' (44dca5fd-05fb-4be5-bc16-1efc376760e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:00:02 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6ff3fa37-5782-4475-a0ff-9a066e8be92e tempest-CreateVolumesFromImageTest-1350814724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ff2d687-25b9-4446-91ac-baa20af893e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:00:02 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6ff3fa37-5782-4475-a0ff-9a066e8be92e tempest-CreateVolumesFromImageTest-1350814724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ff2d687-25b9-4446-91ac-baa20af893e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:00:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1091254571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67ac80bf-cf89-4020-a656-3380b0c5838e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b55709c9d03e426389f10a3ebe854007',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:00:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:00:03Z,use_quota=True,user_id='451347667bf74ebfada9a4630b953ed6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:00:02 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6ff3fa37-5782-4475-a0ff-9a066e8be92e tempest-CreateVolumesFromImageTest-1350814724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (094005a3-3d65-4a52-88f2-4fa82b26dd47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:00:02 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6ff3fa37-5782-4475-a0ff-9a066e8be92e tempest-CreateVolumesFromImageTest-1350814724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (094005a3-3d65-4a52-88f2-4fa82b26dd47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:00:02 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6ff3fa37-5782-4475-a0ff-9a066e8be92e tempest-CreateVolumesFromImageTest-1350814724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0e96069-19b3-4306-930c-8be01b5c505a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:00:02 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6ff3fa37-5782-4475-a0ff-9a066e8be92e tempest-CreateVolumesFromImageTest-1350814724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0e96069-19b3-4306-930c-8be01b5c505a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67ac80bf-cf89-4020-a656-3380b0c5838e', 'volume_name': 'volume-67ac80bf-cf89-4020-a656-3380b0c5838e', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:00:02 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6ff3fa37-5782-4475-a0ff-9a066e8be92e tempest-CreateVolumesFromImageTest-1350814724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (135aeb71-ad24-4c70-8638-2da89f9b5b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:00:02 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6ff3fa37-5782-4475-a0ff-9a066e8be92e tempest-CreateVolumesFromImageTest-1350814724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (135aeb71-ad24-4c70-8638-2da89f9b5b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:00:02 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6ff3fa37-5782-4475-a0ff-9a066e8be92e tempest-CreateVolumesFromImageTest-1350814724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf179d9b-8ae3-4adb-9295-cef883499be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:00:02 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-6ff3fa37-5782-4475-a0ff-9a066e8be92e tempest-CreateVolumesFromImageTest-1350814724 None] Volume 67ac80bf-cf89-4020-a656-3380b0c5838e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67ac80bf-cf89-4020-a656-3380b0c5838e', 'volume_size': 1} Sep 25 12:00:02 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-6ff3fa37-5782-4475-a0ff-9a066e8be92e tempest-CreateVolumesFromImageTest-1350814724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:00:02 devstack sudo[106020]: pam_unix(sudo:session): session closed for user root Sep 25 12:00:02 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-28f745fc-c6fb-40e7-9d85-0e639df3176c tempest-CreateVolumesFromImageTest-1350814724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23af5b2e-ab1a-48ac-8ea5-4d93908d1914" returned: 0 in 0.306s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:00:02 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-28f745fc-c6fb-40e7-9d85-0e639df3176c tempest-CreateVolumesFromImageTest-1350814724 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:00:02 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-28f745fc-c6fb-40e7-9d85-0e639df3176c tempest-CreateVolumesFromImageTest-1350814724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:00:02 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-c9b69a10-6f6d-4ff3-913b-f9f0cd664c58 tempest-CreateVolumesFromImageTest-1350814724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.206s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:00:02 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-c9b69a10-6f6d-4ff3-913b-f9f0cd664c58 tempest-CreateVolumesFromImageTest-1350814724 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:00:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1730907516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=394e208f-c77d-4919-a21b-5a30ce866bca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b55709c9d03e426389f10a3ebe854007',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:00:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:00:01Z,use_quota=True,user_id='451347667bf74ebfada9a4630b953ed6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:00:02 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-c9b69a10-6f6d-4ff3-913b-f9f0cd664c58 tempest-CreateVolumesFromImageTest-1350814724 None] Creating volume 394e208f-c77d-4919-a21b-5a30ce866bca {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:00:02 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-c9b69a10-6f6d-4ff3-913b-f9f0cd664c58 tempest-CreateVolumesFromImageTest-1350814724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:00:02 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-c9b69a10-6f6d-4ff3-913b-f9f0cd664c58 tempest-CreateVolumesFromImageTest-1350814724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:00:02 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-c9b69a10-6f6d-4ff3-913b-f9f0cd664c58 tempest-CreateVolumesFromImageTest-1350814724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:00:02 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-c9b69a10-6f6d-4ff3-913b-f9f0cd664c58 tempest-CreateVolumesFromImageTest-1350814724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:00:02 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-c9b69a10-6f6d-4ff3-913b-f9f0cd664c58 tempest-CreateVolumesFromImageTest-1350814724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:00:02 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-c9b69a10-6f6d-4ff3-913b-f9f0cd664c58 tempest-CreateVolumesFromImageTest-1350814724 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:00:02 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-c9b69a10-6f6d-4ff3-913b-f9f0cd664c58 tempest-CreateVolumesFromImageTest-1350814724 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 12:00:02 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-c9b69a10-6f6d-4ff3-913b-f9f0cd664c58 tempest-CreateVolumesFromImageTest-1350814724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-394e208f-c77d-4919-a21b-5a30ce866bca 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:00:02 devstack sudo[106023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-394e208f-c77d-4919-a21b-5a30ce866bca 1073741824 Sep 25 12:00:02 devstack sudo[106023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:00:02 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-28f745fc-c6fb-40e7-9d85-0e639df3176c tempest-CreateVolumesFromImageTest-1350814724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f632fe5a-d979-4ac1-be3e-7b844b3867eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23af5b2e-ab1a-48ac-8ea5-4d93908d1914', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:00:02 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-28f745fc-c6fb-40e7-9d85-0e639df3176c tempest-CreateVolumesFromImageTest-1350814724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36652e70-9894-4c3b-81f6-daeef9990f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:00:02 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-28f745fc-c6fb-40e7-9d85-0e639df3176c tempest-CreateVolumesFromImageTest-1350814724 None] Volume volume-23af5b2e-ab1a-48ac-8ea5-4d93908d1914 (23af5b2e-ab1a-48ac-8ea5-4d93908d1914): created successfully Sep 25 12:00:02 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-28f745fc-c6fb-40e7-9d85-0e639df3176c tempest-CreateVolumesFromImageTest-1350814724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36652e70-9894-4c3b-81f6-daeef9990f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:00:02 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-28f745fc-c6fb-40e7-9d85-0e639df3176c tempest-CreateVolumesFromImageTest-1350814724 None] Flow 'volume_create_manager' (87edbe41-4033-41fc-9ba5-bcf66b80c9ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:00:02 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-28f745fc-c6fb-40e7-9d85-0e639df3176c tempest-CreateVolumesFromImageTest-1350814724 None] Created volume successfully. Sep 25 12:00:03 devstack sudo[106023]: pam_unix(sudo:session): session closed for user root Sep 25 12:00:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-c9b69a10-6f6d-4ff3-913b-f9f0cd664c58 tempest-CreateVolumesFromImageTest-1350814724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-394e208f-c77d-4919-a21b-5a30ce866bca 1073741824" returned: 0 in 0.456s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:00:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-c9b69a10-6f6d-4ff3-913b-f9f0cd664c58 tempest-CreateVolumesFromImageTest-1350814724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-394e208f-c77d-4919-a21b-5a30ce866bca {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:00:03 devstack sudo[106028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-394e208f-c77d-4919-a21b-5a30ce866bca Sep 25 12:00:03 devstack sudo[106028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:00:03 devstack sudo[106028]: pam_unix(sudo:session): session closed for user root Sep 25 12:00:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-c9b69a10-6f6d-4ff3-913b-f9f0cd664c58 tempest-CreateVolumesFromImageTest-1350814724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-394e208f-c77d-4919-a21b-5a30ce866bca" returned: 0 in 0.289s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:00:03 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-c9b69a10-6f6d-4ff3-913b-f9f0cd664c58 tempest-CreateVolumesFromImageTest-1350814724 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:00:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-c9b69a10-6f6d-4ff3-913b-f9f0cd664c58 tempest-CreateVolumesFromImageTest-1350814724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:00:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3889d2eb-a5ca-4995-a00e-4d1aca094c3b tempest-CreateVolumesFromImageTest-1350814724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.450s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:00:03 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3889d2eb-a5ca-4995-a00e-4d1aca094c3b tempest-CreateVolumesFromImageTest-1350814724 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:00:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-322101678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b6fe22a-ab19-44d6-88d8-04cde69d2848,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b55709c9d03e426389f10a3ebe854007',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:00:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:00:02Z,use_quota=True,user_id='451347667bf74ebfada9a4630b953ed6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:00:03 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-3889d2eb-a5ca-4995-a00e-4d1aca094c3b tempest-CreateVolumesFromImageTest-1350814724 None] Creating volume 0b6fe22a-ab19-44d6-88d8-04cde69d2848 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:00:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3889d2eb-a5ca-4995-a00e-4d1aca094c3b tempest-CreateVolumesFromImageTest-1350814724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:00:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3889d2eb-a5ca-4995-a00e-4d1aca094c3b tempest-CreateVolumesFromImageTest-1350814724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:00:03 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3889d2eb-a5ca-4995-a00e-4d1aca094c3b tempest-CreateVolumesFromImageTest-1350814724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:00:03 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3889d2eb-a5ca-4995-a00e-4d1aca094c3b tempest-CreateVolumesFromImageTest-1350814724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:00:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3889d2eb-a5ca-4995-a00e-4d1aca094c3b tempest-CreateVolumesFromImageTest-1350814724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:00:03 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3889d2eb-a5ca-4995-a00e-4d1aca094c3b tempest-CreateVolumesFromImageTest-1350814724 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:00:03 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-3889d2eb-a5ca-4995-a00e-4d1aca094c3b tempest-CreateVolumesFromImageTest-1350814724 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 12:00:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3889d2eb-a5ca-4995-a00e-4d1aca094c3b tempest-CreateVolumesFromImageTest-1350814724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0b6fe22a-ab19-44d6-88d8-04cde69d2848 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:00:03 devstack sudo[106031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0b6fe22a-ab19-44d6-88d8-04cde69d2848 1073741824 Sep 25 12:00:03 devstack sudo[106031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:00:03 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-c9b69a10-6f6d-4ff3-913b-f9f0cd664c58 tempest-CreateVolumesFromImageTest-1350814724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9929b4b-54d2-4526-9a2f-ad9de2de74e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-394e208f-c77d-4919-a21b-5a30ce866bca', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:00:03 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-c9b69a10-6f6d-4ff3-913b-f9f0cd664c58 tempest-CreateVolumesFromImageTest-1350814724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdcce0a8-feca-4514-ba10-81f9a527c146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:00:03 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-c9b69a10-6f6d-4ff3-913b-f9f0cd664c58 tempest-CreateVolumesFromImageTest-1350814724 None] Volume volume-394e208f-c77d-4919-a21b-5a30ce866bca (394e208f-c77d-4919-a21b-5a30ce866bca): created successfully Sep 25 12:00:03 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-c9b69a10-6f6d-4ff3-913b-f9f0cd664c58 tempest-CreateVolumesFromImageTest-1350814724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdcce0a8-feca-4514-ba10-81f9a527c146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:00:03 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-c9b69a10-6f6d-4ff3-913b-f9f0cd664c58 tempest-CreateVolumesFromImageTest-1350814724 None] Flow 'volume_create_manager' (9a82db21-9e4d-415b-ba22-f2902b1c9db0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:00:03 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-c9b69a10-6f6d-4ff3-913b-f9f0cd664c58 tempest-CreateVolumesFromImageTest-1350814724 None] Created volume successfully. Sep 25 12:00:04 devstack sudo[106031]: pam_unix(sudo:session): session closed for user root Sep 25 12:00:04 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3889d2eb-a5ca-4995-a00e-4d1aca094c3b tempest-CreateVolumesFromImageTest-1350814724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0b6fe22a-ab19-44d6-88d8-04cde69d2848 1073741824" returned: 0 in 0.569s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:00:04 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3889d2eb-a5ca-4995-a00e-4d1aca094c3b tempest-CreateVolumesFromImageTest-1350814724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0b6fe22a-ab19-44d6-88d8-04cde69d2848 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:00:04 devstack sudo[106038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0b6fe22a-ab19-44d6-88d8-04cde69d2848 Sep 25 12:00:04 devstack sudo[106038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:00:04 devstack sudo[106038]: pam_unix(sudo:session): session closed for user root Sep 25 12:00:04 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3889d2eb-a5ca-4995-a00e-4d1aca094c3b tempest-CreateVolumesFromImageTest-1350814724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0b6fe22a-ab19-44d6-88d8-04cde69d2848" returned: 0 in 0.301s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:00:04 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3889d2eb-a5ca-4995-a00e-4d1aca094c3b tempest-CreateVolumesFromImageTest-1350814724 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:00:04 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3889d2eb-a5ca-4995-a00e-4d1aca094c3b tempest-CreateVolumesFromImageTest-1350814724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:00:04 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-6ff3fa37-5782-4475-a0ff-9a066e8be92e tempest-CreateVolumesFromImageTest-1350814724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.815s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:00:04 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-6ff3fa37-5782-4475-a0ff-9a066e8be92e tempest-CreateVolumesFromImageTest-1350814724 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:00:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1091254571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67ac80bf-cf89-4020-a656-3380b0c5838e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b55709c9d03e426389f10a3ebe854007',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:00:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:00:03Z,use_quota=True,user_id='451347667bf74ebfada9a4630b953ed6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:00:04 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-6ff3fa37-5782-4475-a0ff-9a066e8be92e tempest-CreateVolumesFromImageTest-1350814724 None] Creating volume 67ac80bf-cf89-4020-a656-3380b0c5838e {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:00:04 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-6ff3fa37-5782-4475-a0ff-9a066e8be92e tempest-CreateVolumesFromImageTest-1350814724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:00:04 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-6ff3fa37-5782-4475-a0ff-9a066e8be92e tempest-CreateVolumesFromImageTest-1350814724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:00:04 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-6ff3fa37-5782-4475-a0ff-9a066e8be92e tempest-CreateVolumesFromImageTest-1350814724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:00:04 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-6ff3fa37-5782-4475-a0ff-9a066e8be92e tempest-CreateVolumesFromImageTest-1350814724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:00:04 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-6ff3fa37-5782-4475-a0ff-9a066e8be92e tempest-CreateVolumesFromImageTest-1350814724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:00:04 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-6ff3fa37-5782-4475-a0ff-9a066e8be92e tempest-CreateVolumesFromImageTest-1350814724 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:00:04 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-6ff3fa37-5782-4475-a0ff-9a066e8be92e tempest-CreateVolumesFromImageTest-1350814724 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 12:00:04 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6ff3fa37-5782-4475-a0ff-9a066e8be92e tempest-CreateVolumesFromImageTest-1350814724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-67ac80bf-cf89-4020-a656-3380b0c5838e 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:00:04 devstack sudo[106041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-67ac80bf-cf89-4020-a656-3380b0c5838e 1073741824 Sep 25 12:00:04 devstack sudo[106041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:00:04 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3889d2eb-a5ca-4995-a00e-4d1aca094c3b tempest-CreateVolumesFromImageTest-1350814724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4e474cb-5ab5-4bbc-b04a-7fc60643580e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b6fe22a-ab19-44d6-88d8-04cde69d2848', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:00:04 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3889d2eb-a5ca-4995-a00e-4d1aca094c3b tempest-CreateVolumesFromImageTest-1350814724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47affeb7-e44e-48f6-a3d6-c500e46065d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:00:04 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-3889d2eb-a5ca-4995-a00e-4d1aca094c3b tempest-CreateVolumesFromImageTest-1350814724 None] Volume volume-0b6fe22a-ab19-44d6-88d8-04cde69d2848 (0b6fe22a-ab19-44d6-88d8-04cde69d2848): created successfully Sep 25 12:00:04 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3889d2eb-a5ca-4995-a00e-4d1aca094c3b tempest-CreateVolumesFromImageTest-1350814724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47affeb7-e44e-48f6-a3d6-c500e46065d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:00:04 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3889d2eb-a5ca-4995-a00e-4d1aca094c3b tempest-CreateVolumesFromImageTest-1350814724 None] Flow 'volume_create_manager' (0bdcac7e-dcd9-46b6-b3b9-705360b924c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:00:04 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-3889d2eb-a5ca-4995-a00e-4d1aca094c3b tempest-CreateVolumesFromImageTest-1350814724 None] Created volume successfully. Sep 25 12:00:05 devstack sudo[106041]: pam_unix(sudo:session): session closed for user root Sep 25 12:00:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6ff3fa37-5782-4475-a0ff-9a066e8be92e tempest-CreateVolumesFromImageTest-1350814724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-67ac80bf-cf89-4020-a656-3380b0c5838e 1073741824" returned: 0 in 0.699s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:00:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6ff3fa37-5782-4475-a0ff-9a066e8be92e tempest-CreateVolumesFromImageTest-1350814724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-67ac80bf-cf89-4020-a656-3380b0c5838e {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:00:05 devstack sudo[106049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-67ac80bf-cf89-4020-a656-3380b0c5838e Sep 25 12:00:05 devstack sudo[106049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:00:05 devstack sudo[106049]: pam_unix(sudo:session): session closed for user root Sep 25 12:00:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6ff3fa37-5782-4475-a0ff-9a066e8be92e tempest-CreateVolumesFromImageTest-1350814724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-67ac80bf-cf89-4020-a656-3380b0c5838e" returned: 0 in 0.339s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:00:05 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-6ff3fa37-5782-4475-a0ff-9a066e8be92e tempest-CreateVolumesFromImageTest-1350814724 None] <== create_volume: return (1094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:00:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-6ff3fa37-5782-4475-a0ff-9a066e8be92e tempest-CreateVolumesFromImageTest-1350814724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:00:05 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6ff3fa37-5782-4475-a0ff-9a066e8be92e tempest-CreateVolumesFromImageTest-1350814724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf179d9b-8ae3-4adb-9295-cef883499be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67ac80bf-cf89-4020-a656-3380b0c5838e', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:00:05 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6ff3fa37-5782-4475-a0ff-9a066e8be92e tempest-CreateVolumesFromImageTest-1350814724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1db01003-6d42-4434-a820-34d086029d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:00:05 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-6ff3fa37-5782-4475-a0ff-9a066e8be92e tempest-CreateVolumesFromImageTest-1350814724 None] Volume volume-67ac80bf-cf89-4020-a656-3380b0c5838e (67ac80bf-cf89-4020-a656-3380b0c5838e): created successfully Sep 25 12:00:05 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6ff3fa37-5782-4475-a0ff-9a066e8be92e tempest-CreateVolumesFromImageTest-1350814724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1db01003-6d42-4434-a820-34d086029d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:00:05 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6ff3fa37-5782-4475-a0ff-9a066e8be92e tempest-CreateVolumesFromImageTest-1350814724 None] Flow 'volume_create_manager' (44dca5fd-05fb-4be5-bc16-1efc376760e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:00:05 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-6ff3fa37-5782-4475-a0ff-9a066e8be92e tempest-CreateVolumesFromImageTest-1350814724 None] Created volume successfully. Sep 25 12:00:06 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-7881ae18-272b-4359-8ad3-f84a6b0258f3 tempest-CreateVolumesFromImageTest-1350814724 None] Acquiring lock "cinder-67ac80bf-cf89-4020-a656-3380b0c5838e-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:00:06 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-7881ae18-272b-4359-8ad3-f84a6b0258f3 tempest-CreateVolumesFromImageTest-1350814724 None] Lock "cinder-67ac80bf-cf89-4020-a656-3380b0c5838e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:00:06 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-7881ae18-272b-4359-8ad3-f84a6b0258f3 tempest-CreateVolumesFromImageTest-1350814724 None] Acquiring lock "cinder-quobyte-67ac80bf-cf89-4020-a656-3380b0c5838e" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:00:06 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-7881ae18-272b-4359-8ad3-f84a6b0258f3 tempest-CreateVolumesFromImageTest-1350814724 None] Lock "cinder-quobyte-67ac80bf-cf89-4020-a656-3380b0c5838e" acquired by "delete_volume" :: waited 0.018s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:00:06 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b9f7dfc-1a06-4cad-a6bf-1f2e6c014d96]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:00:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7881ae18-272b-4359-8ad3-f84a6b0258f3 tempest-CreateVolumesFromImageTest-1350814724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-67ac80bf-cf89-4020-a656-3380b0c5838e {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:00:06 devstack sudo[106052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-67ac80bf-cf89-4020-a656-3380b0c5838e Sep 25 12:00:06 devstack sudo[106052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:00:06 devstack sudo[106052]: pam_unix(sudo:session): session closed for user root Sep 25 12:00:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7881ae18-272b-4359-8ad3-f84a6b0258f3 tempest-CreateVolumesFromImageTest-1350814724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-67ac80bf-cf89-4020-a656-3380b0c5838e" returned: 0 in 0.443s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:00:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7881ae18-272b-4359-8ad3-f84a6b0258f3 tempest-CreateVolumesFromImageTest-1350814724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-67ac80bf-cf89-4020-a656-3380b0c5838e {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:00:06 devstack sudo[106057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-67ac80bf-cf89-4020-a656-3380b0c5838e Sep 25 12:00:06 devstack sudo[106057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:00:06 devstack sudo[106057]: pam_unix(sudo:session): session closed for user root Sep 25 12:00:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7881ae18-272b-4359-8ad3-f84a6b0258f3 tempest-CreateVolumesFromImageTest-1350814724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-67ac80bf-cf89-4020-a656-3380b0c5838e" returned: 0 in 0.309s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:00:06 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-7881ae18-272b-4359-8ad3-f84a6b0258f3 tempest-CreateVolumesFromImageTest-1350814724 None] Lock "cinder-quobyte-67ac80bf-cf89-4020-a656-3380b0c5838e" released by "delete_volume" :: held 0.809s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:00:07 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-7881ae18-272b-4359-8ad3-f84a6b0258f3 tempest-CreateVolumesFromImageTest-1350814724 None] Created reservations ['fb34de84-fb07-4338-99c8-c5d4d0940fad', '0a3e3ae3-a943-4f7d-ac9d-7a6fb7ce0d48', '27854ab0-759e-4ead-b675-511180ee3ee4', 'ec0009ae-7f67-4ced-a5a6-d57f6ccb553b'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:00:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-7881ae18-272b-4359-8ad3-f84a6b0258f3 tempest-CreateVolumesFromImageTest-1350814724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:00:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-7881ae18-272b-4359-8ad3-f84a6b0258f3 tempest-CreateVolumesFromImageTest-1350814724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:00:07 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-7881ae18-272b-4359-8ad3-f84a6b0258f3 tempest-CreateVolumesFromImageTest-1350814724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:00:07 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-7881ae18-272b-4359-8ad3-f84a6b0258f3 tempest-CreateVolumesFromImageTest-1350814724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:00:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-7881ae18-272b-4359-8ad3-f84a6b0258f3 tempest-CreateVolumesFromImageTest-1350814724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:00:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7881ae18-272b-4359-8ad3-f84a6b0258f3 tempest-CreateVolumesFromImageTest-1350814724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:00:07 devstack sudo[106061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 12:00:07 devstack sudo[106061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:00:07 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e04b8411-719e-4739-b82b-dda0b65a9ea0 tempest-CreateVolumesFromImageTest-1350814724 None] Acquiring lock "cinder-0b6fe22a-ab19-44d6-88d8-04cde69d2848-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:00:07 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e04b8411-719e-4739-b82b-dda0b65a9ea0 tempest-CreateVolumesFromImageTest-1350814724 None] Lock "cinder-0b6fe22a-ab19-44d6-88d8-04cde69d2848-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:00:07 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e04b8411-719e-4739-b82b-dda0b65a9ea0 tempest-CreateVolumesFromImageTest-1350814724 None] Acquiring lock "cinder-quobyte-0b6fe22a-ab19-44d6-88d8-04cde69d2848" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:00:07 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e04b8411-719e-4739-b82b-dda0b65a9ea0 tempest-CreateVolumesFromImageTest-1350814724 None] Lock "cinder-quobyte-0b6fe22a-ab19-44d6-88d8-04cde69d2848" acquired by "delete_volume" :: waited 0.023s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:00:07 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed58ced-2b4d-4f5c-a49d-b0ac49bff1fc]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:00:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e04b8411-719e-4739-b82b-dda0b65a9ea0 tempest-CreateVolumesFromImageTest-1350814724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0b6fe22a-ab19-44d6-88d8-04cde69d2848 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:00:07 devstack sudo[106061]: pam_unix(sudo:session): session closed for user root Sep 25 12:00:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7881ae18-272b-4359-8ad3-f84a6b0258f3 tempest-CreateVolumesFromImageTest-1350814724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.321s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:00:07 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-7881ae18-272b-4359-8ad3-f84a6b0258f3 tempest-CreateVolumesFromImageTest-1350814724 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:00:07 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-7881ae18-272b-4359-8ad3-f84a6b0258f3 tempest-CreateVolumesFromImageTest-1350814724 None] Deleted volume successfully. Sep 25 12:00:07 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-7881ae18-272b-4359-8ad3-f84a6b0258f3 tempest-CreateVolumesFromImageTest-1350814724 None] Lock "cinder-67ac80bf-cf89-4020-a656-3380b0c5838e-delete_volume" released by "delete_volume" :: held 1.436s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:00:07 devstack sudo[106063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0b6fe22a-ab19-44d6-88d8-04cde69d2848 Sep 25 12:00:07 devstack sudo[106063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:00:07 devstack sudo[106063]: pam_unix(sudo:session): session closed for user root Sep 25 12:00:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e04b8411-719e-4739-b82b-dda0b65a9ea0 tempest-CreateVolumesFromImageTest-1350814724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0b6fe22a-ab19-44d6-88d8-04cde69d2848" returned: 0 in 0.429s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:00:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e04b8411-719e-4739-b82b-dda0b65a9ea0 tempest-CreateVolumesFromImageTest-1350814724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0b6fe22a-ab19-44d6-88d8-04cde69d2848 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:00:07 devstack sudo[106069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0b6fe22a-ab19-44d6-88d8-04cde69d2848 Sep 25 12:00:07 devstack sudo[106069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:00:08 devstack sudo[106069]: pam_unix(sudo:session): session closed for user root Sep 25 12:00:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e04b8411-719e-4739-b82b-dda0b65a9ea0 tempest-CreateVolumesFromImageTest-1350814724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0b6fe22a-ab19-44d6-88d8-04cde69d2848" returned: 0 in 0.264s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:00:08 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e04b8411-719e-4739-b82b-dda0b65a9ea0 tempest-CreateVolumesFromImageTest-1350814724 None] Lock "cinder-quobyte-0b6fe22a-ab19-44d6-88d8-04cde69d2848" released by "delete_volume" :: held 0.753s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:00:08 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-e04b8411-719e-4739-b82b-dda0b65a9ea0 tempest-CreateVolumesFromImageTest-1350814724 None] Created reservations ['e368bc6c-4276-4327-95f0-c85f9fc4f9d2', '645d6347-b67d-47d5-b872-641c99036851', 'cb501525-3629-46ac-bf0e-414285d830b2', '4c032b67-a13a-4c6c-b8ed-a2fdbcbf17fc'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:00:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-e04b8411-719e-4739-b82b-dda0b65a9ea0 tempest-CreateVolumesFromImageTest-1350814724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:00:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-e04b8411-719e-4739-b82b-dda0b65a9ea0 tempest-CreateVolumesFromImageTest-1350814724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:00:08 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-e04b8411-719e-4739-b82b-dda0b65a9ea0 tempest-CreateVolumesFromImageTest-1350814724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:00:08 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-e04b8411-719e-4739-b82b-dda0b65a9ea0 tempest-CreateVolumesFromImageTest-1350814724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:00:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-e04b8411-719e-4739-b82b-dda0b65a9ea0 tempest-CreateVolumesFromImageTest-1350814724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:00:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e04b8411-719e-4739-b82b-dda0b65a9ea0 tempest-CreateVolumesFromImageTest-1350814724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:00:08 devstack sudo[106072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 12:00:08 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:00:08 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-8fd30df3-fee1-404d-a49b-51db090603ae tempest-CreateVolumesFromImageTest-1350814724 None] Acquiring lock "cinder-394e208f-c77d-4919-a21b-5a30ce866bca-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:00:08 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-8fd30df3-fee1-404d-a49b-51db090603ae tempest-CreateVolumesFromImageTest-1350814724 None] Lock "cinder-394e208f-c77d-4919-a21b-5a30ce866bca-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:00:08 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-8fd30df3-fee1-404d-a49b-51db090603ae tempest-CreateVolumesFromImageTest-1350814724 None] Acquiring lock "cinder-quobyte-394e208f-c77d-4919-a21b-5a30ce866bca" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:00:08 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-8fd30df3-fee1-404d-a49b-51db090603ae tempest-CreateVolumesFromImageTest-1350814724 None] Lock "cinder-quobyte-394e208f-c77d-4919-a21b-5a30ce866bca" acquired by "delete_volume" :: waited 0.022s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:00:08 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ee5afb-912d-4b1b-aea9-bc0c7d8ca2b6]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:00:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8fd30df3-fee1-404d-a49b-51db090603ae tempest-CreateVolumesFromImageTest-1350814724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-394e208f-c77d-4919-a21b-5a30ce866bca {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:00:08 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root Sep 25 12:00:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e04b8411-719e-4739-b82b-dda0b65a9ea0 tempest-CreateVolumesFromImageTest-1350814724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.361s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:00:08 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-e04b8411-719e-4739-b82b-dda0b65a9ea0 tempest-CreateVolumesFromImageTest-1350814724 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:00:08 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-e04b8411-719e-4739-b82b-dda0b65a9ea0 tempest-CreateVolumesFromImageTest-1350814724 None] Deleted volume successfully. Sep 25 12:00:08 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e04b8411-719e-4739-b82b-dda0b65a9ea0 tempest-CreateVolumesFromImageTest-1350814724 None] Lock "cinder-0b6fe22a-ab19-44d6-88d8-04cde69d2848-delete_volume" released by "delete_volume" :: held 1.438s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:00:08 devstack sudo[106075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-394e208f-c77d-4919-a21b-5a30ce866bca Sep 25 12:00:08 devstack sudo[106075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:00:09 devstack sudo[106075]: pam_unix(sudo:session): session closed for user root Sep 25 12:00:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8fd30df3-fee1-404d-a49b-51db090603ae tempest-CreateVolumesFromImageTest-1350814724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-394e208f-c77d-4919-a21b-5a30ce866bca" returned: 0 in 0.425s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:00:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8fd30df3-fee1-404d-a49b-51db090603ae tempest-CreateVolumesFromImageTest-1350814724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-394e208f-c77d-4919-a21b-5a30ce866bca {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:00:09 devstack sudo[106083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-394e208f-c77d-4919-a21b-5a30ce866bca Sep 25 12:00:09 devstack sudo[106083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:00:09 devstack sudo[106083]: pam_unix(sudo:session): session closed for user root Sep 25 12:00:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8fd30df3-fee1-404d-a49b-51db090603ae tempest-CreateVolumesFromImageTest-1350814724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-394e208f-c77d-4919-a21b-5a30ce866bca" returned: 0 in 0.312s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:00:09 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-8fd30df3-fee1-404d-a49b-51db090603ae tempest-CreateVolumesFromImageTest-1350814724 None] Lock "cinder-quobyte-394e208f-c77d-4919-a21b-5a30ce866bca" released by "delete_volume" :: held 0.797s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:00:09 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-8fd30df3-fee1-404d-a49b-51db090603ae tempest-CreateVolumesFromImageTest-1350814724 None] Created reservations ['cecfdbf5-21a7-45dc-87ec-d461362f5ab3', 'c7c981bd-5a39-4862-9c84-81a3df6e0f8d', '672bef2f-403e-43aa-8ff2-b6e27115458e', '63aee1a6-ae41-4d44-a02e-91c9b6f0777a'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:00:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-8fd30df3-fee1-404d-a49b-51db090603ae tempest-CreateVolumesFromImageTest-1350814724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:00:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-8fd30df3-fee1-404d-a49b-51db090603ae tempest-CreateVolumesFromImageTest-1350814724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:00:09 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-8fd30df3-fee1-404d-a49b-51db090603ae tempest-CreateVolumesFromImageTest-1350814724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:00:09 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-8fd30df3-fee1-404d-a49b-51db090603ae tempest-CreateVolumesFromImageTest-1350814724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:00:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-8fd30df3-fee1-404d-a49b-51db090603ae tempest-CreateVolumesFromImageTest-1350814724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:00:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8fd30df3-fee1-404d-a49b-51db090603ae tempest-CreateVolumesFromImageTest-1350814724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:00:09 devstack sudo[106086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 12:00:09 devstack sudo[106086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:00:09 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-27dd6a48-2d2d-4b23-97f7-2a5ebd05b2a3 tempest-CreateVolumesFromImageTest-1350814724 None] Acquiring lock "cinder-23af5b2e-ab1a-48ac-8ea5-4d93908d1914-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:00:09 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-27dd6a48-2d2d-4b23-97f7-2a5ebd05b2a3 tempest-CreateVolumesFromImageTest-1350814724 None] Lock "cinder-23af5b2e-ab1a-48ac-8ea5-4d93908d1914-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:00:09 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-27dd6a48-2d2d-4b23-97f7-2a5ebd05b2a3 tempest-CreateVolumesFromImageTest-1350814724 None] Acquiring lock "cinder-quobyte-23af5b2e-ab1a-48ac-8ea5-4d93908d1914" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:00:09 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-27dd6a48-2d2d-4b23-97f7-2a5ebd05b2a3 tempest-CreateVolumesFromImageTest-1350814724 None] Lock "cinder-quobyte-23af5b2e-ab1a-48ac-8ea5-4d93908d1914" acquired by "delete_volume" :: waited 0.017s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:00:09 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[80860c4c-4751-4de4-b38e-f32b84bb0513]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:00:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-27dd6a48-2d2d-4b23-97f7-2a5ebd05b2a3 tempest-CreateVolumesFromImageTest-1350814724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23af5b2e-ab1a-48ac-8ea5-4d93908d1914 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:00:09 devstack sudo[106086]: pam_unix(sudo:session): session closed for user root Sep 25 12:00:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8fd30df3-fee1-404d-a49b-51db090603ae tempest-CreateVolumesFromImageTest-1350814724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.307s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:00:09 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-8fd30df3-fee1-404d-a49b-51db090603ae tempest-CreateVolumesFromImageTest-1350814724 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:00:09 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-8fd30df3-fee1-404d-a49b-51db090603ae tempest-CreateVolumesFromImageTest-1350814724 None] Deleted volume successfully. Sep 25 12:00:09 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-8fd30df3-fee1-404d-a49b-51db090603ae tempest-CreateVolumesFromImageTest-1350814724 None] Lock "cinder-394e208f-c77d-4919-a21b-5a30ce866bca-delete_volume" released by "delete_volume" :: held 1.375s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:00:09 devstack sudo[106088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23af5b2e-ab1a-48ac-8ea5-4d93908d1914 Sep 25 12:00:09 devstack sudo[106088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:00:10 devstack sudo[106088]: pam_unix(sudo:session): session closed for user root Sep 25 12:00:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-27dd6a48-2d2d-4b23-97f7-2a5ebd05b2a3 tempest-CreateVolumesFromImageTest-1350814724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23af5b2e-ab1a-48ac-8ea5-4d93908d1914" returned: 0 in 0.505s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:00:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-27dd6a48-2d2d-4b23-97f7-2a5ebd05b2a3 tempest-CreateVolumesFromImageTest-1350814724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23af5b2e-ab1a-48ac-8ea5-4d93908d1914 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:00:10 devstack sudo[106094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23af5b2e-ab1a-48ac-8ea5-4d93908d1914 Sep 25 12:00:10 devstack sudo[106094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:00:10 devstack sudo[106094]: pam_unix(sudo:session): session closed for user root Sep 25 12:00:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-27dd6a48-2d2d-4b23-97f7-2a5ebd05b2a3 tempest-CreateVolumesFromImageTest-1350814724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23af5b2e-ab1a-48ac-8ea5-4d93908d1914" returned: 0 in 0.345s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:00:10 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-27dd6a48-2d2d-4b23-97f7-2a5ebd05b2a3 tempest-CreateVolumesFromImageTest-1350814724 None] Lock "cinder-quobyte-23af5b2e-ab1a-48ac-8ea5-4d93908d1914" released by "delete_volume" :: held 0.902s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:00:10 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-27dd6a48-2d2d-4b23-97f7-2a5ebd05b2a3 tempest-CreateVolumesFromImageTest-1350814724 None] Created reservations ['3cc33fb1-5f19-473f-a559-6d1eaa4399b4', '21cceef6-f992-4012-9340-78a2278e1512', '950bff5c-5684-49c2-b6f2-ff073d1d4ca4', '841783dd-7891-489c-bdf4-39525e22a681'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:00:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-27dd6a48-2d2d-4b23-97f7-2a5ebd05b2a3 tempest-CreateVolumesFromImageTest-1350814724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:00:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-27dd6a48-2d2d-4b23-97f7-2a5ebd05b2a3 tempest-CreateVolumesFromImageTest-1350814724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:00:10 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-27dd6a48-2d2d-4b23-97f7-2a5ebd05b2a3 tempest-CreateVolumesFromImageTest-1350814724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:00:10 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-27dd6a48-2d2d-4b23-97f7-2a5ebd05b2a3 tempest-CreateVolumesFromImageTest-1350814724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:00:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-27dd6a48-2d2d-4b23-97f7-2a5ebd05b2a3 tempest-CreateVolumesFromImageTest-1350814724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:00:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-27dd6a48-2d2d-4b23-97f7-2a5ebd05b2a3 tempest-CreateVolumesFromImageTest-1350814724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:00:10 devstack sudo[106097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 12:00:10 devstack sudo[106097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:00:10 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ffb54538-38ec-4574-8c72-3616ea4e3bd0 tempest-CreateVolumesFromImageTest-1350814724 None] Acquiring lock "cinder-f84909f8-45a3-4215-90f3-ae2f13d5c04e-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:00:10 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ffb54538-38ec-4574-8c72-3616ea4e3bd0 tempest-CreateVolumesFromImageTest-1350814724 None] Lock "cinder-f84909f8-45a3-4215-90f3-ae2f13d5c04e-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:00:11 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ffb54538-38ec-4574-8c72-3616ea4e3bd0 tempest-CreateVolumesFromImageTest-1350814724 None] Acquiring lock "cinder-quobyte-f84909f8-45a3-4215-90f3-ae2f13d5c04e" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:00:11 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ffb54538-38ec-4574-8c72-3616ea4e3bd0 tempest-CreateVolumesFromImageTest-1350814724 None] Lock "cinder-quobyte-f84909f8-45a3-4215-90f3-ae2f13d5c04e" acquired by "delete_volume" :: waited 0.031s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:00:11 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[6061ca8d-33fb-4d31-a7b6-f1cc5cf88bf9]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:00:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ffb54538-38ec-4574-8c72-3616ea4e3bd0 tempest-CreateVolumesFromImageTest-1350814724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f84909f8-45a3-4215-90f3-ae2f13d5c04e {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:00:11 devstack sudo[106097]: pam_unix(sudo:session): session closed for user root Sep 25 12:00:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-27dd6a48-2d2d-4b23-97f7-2a5ebd05b2a3 tempest-CreateVolumesFromImageTest-1350814724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.320s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:00:11 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-27dd6a48-2d2d-4b23-97f7-2a5ebd05b2a3 tempest-CreateVolumesFromImageTest-1350814724 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:00:11 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-27dd6a48-2d2d-4b23-97f7-2a5ebd05b2a3 tempest-CreateVolumesFromImageTest-1350814724 None] Deleted volume successfully. Sep 25 12:00:11 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-27dd6a48-2d2d-4b23-97f7-2a5ebd05b2a3 tempest-CreateVolumesFromImageTest-1350814724 None] Lock "cinder-23af5b2e-ab1a-48ac-8ea5-4d93908d1914-delete_volume" released by "delete_volume" :: held 1.468s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:00:11 devstack sudo[106100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f84909f8-45a3-4215-90f3-ae2f13d5c04e Sep 25 12:00:11 devstack sudo[106100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:00:11 devstack sudo[106100]: pam_unix(sudo:session): session closed for user root Sep 25 12:00:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ffb54538-38ec-4574-8c72-3616ea4e3bd0 tempest-CreateVolumesFromImageTest-1350814724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f84909f8-45a3-4215-90f3-ae2f13d5c04e" returned: 0 in 0.512s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:00:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ffb54538-38ec-4574-8c72-3616ea4e3bd0 tempest-CreateVolumesFromImageTest-1350814724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f84909f8-45a3-4215-90f3-ae2f13d5c04e {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:00:11 devstack sudo[106106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f84909f8-45a3-4215-90f3-ae2f13d5c04e Sep 25 12:00:11 devstack sudo[106106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:00:11 devstack sudo[106106]: pam_unix(sudo:session): session closed for user root Sep 25 12:00:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ffb54538-38ec-4574-8c72-3616ea4e3bd0 tempest-CreateVolumesFromImageTest-1350814724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f84909f8-45a3-4215-90f3-ae2f13d5c04e" returned: 0 in 0.309s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:00:11 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ffb54538-38ec-4574-8c72-3616ea4e3bd0 tempest-CreateVolumesFromImageTest-1350814724 None] Lock "cinder-quobyte-f84909f8-45a3-4215-90f3-ae2f13d5c04e" released by "delete_volume" :: held 0.897s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:00:12 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-ffb54538-38ec-4574-8c72-3616ea4e3bd0 tempest-CreateVolumesFromImageTest-1350814724 None] Created reservations ['4d8735c9-722c-437e-97c3-57ae513f184e', 'ddd645b8-feb2-4f38-8e1e-24d8bb7e5846', 'e058fb84-fc98-49db-881a-f466fe22e25b', 'fcb2a3ff-ad27-4093-bf38-e949c5fe5186'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:00:12 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-ffb54538-38ec-4574-8c72-3616ea4e3bd0 tempest-CreateVolumesFromImageTest-1350814724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:00:12 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-ffb54538-38ec-4574-8c72-3616ea4e3bd0 tempest-CreateVolumesFromImageTest-1350814724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:00:12 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-ffb54538-38ec-4574-8c72-3616ea4e3bd0 tempest-CreateVolumesFromImageTest-1350814724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:00:12 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-ffb54538-38ec-4574-8c72-3616ea4e3bd0 tempest-CreateVolumesFromImageTest-1350814724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:00:12 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-ffb54538-38ec-4574-8c72-3616ea4e3bd0 tempest-CreateVolumesFromImageTest-1350814724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:00:12 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ffb54538-38ec-4574-8c72-3616ea4e3bd0 tempest-CreateVolumesFromImageTest-1350814724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:00:12 devstack sudo[106109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 12:00:12 devstack sudo[106109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:00:12 devstack sudo[106109]: pam_unix(sudo:session): session closed for user root Sep 25 12:00:12 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ffb54538-38ec-4574-8c72-3616ea4e3bd0 tempest-CreateVolumesFromImageTest-1350814724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.371s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:00:12 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-ffb54538-38ec-4574-8c72-3616ea4e3bd0 tempest-CreateVolumesFromImageTest-1350814724 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:00:12 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-ffb54538-38ec-4574-8c72-3616ea4e3bd0 tempest-CreateVolumesFromImageTest-1350814724 None] Deleted volume successfully. Sep 25 12:00:12 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ffb54538-38ec-4574-8c72-3616ea4e3bd0 tempest-CreateVolumesFromImageTest-1350814724 None] Lock "cinder-f84909f8-45a3-4215-90f3-ae2f13d5c04e-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:00:16 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bdc1513-1d86-4b03-b91b-92d72611ee0a tempest-CinderUnicodeTest-1155416848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:00:16 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8bdc1513-1d86-4b03-b91b-92d72611ee0a tempest-CinderUnicodeTest-1155416848 None] Flow 'volume_create_manager' (09cc20f0-1386-4152-8f0f-d564e060edd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:00:16 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8bdc1513-1d86-4b03-b91b-92d72611ee0a tempest-CinderUnicodeTest-1155416848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30657b49-1ce8-4754-8828-ddea2f6223af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:00:16 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8bdc1513-1d86-4b03-b91b-92d72611ee0a tempest-CinderUnicodeTest-1155416848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30657b49-1ce8-4754-8828-ddea2f6223af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:00:16Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a01ed3bc-72c0-4bae-8278-359eefd4fcf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1519f63298da456f9b0b4ef571c7ddc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:00:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:00:16Z,use_quota=True,user_id='65067923d8dd44a997eb0d1de46719a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:00:16 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8bdc1513-1d86-4b03-b91b-92d72611ee0a tempest-CinderUnicodeTest-1155416848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8c7d150-6a2b-48e1-a112-d7f38f4a31e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:00:16 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8bdc1513-1d86-4b03-b91b-92d72611ee0a tempest-CinderUnicodeTest-1155416848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8c7d150-6a2b-48e1-a112-d7f38f4a31e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:00:16 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8bdc1513-1d86-4b03-b91b-92d72611ee0a tempest-CinderUnicodeTest-1155416848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82fad0d0-60ad-4e83-8ab6-283bf612e0c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:00:16 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8bdc1513-1d86-4b03-b91b-92d72611ee0a tempest-CinderUnicodeTest-1155416848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82fad0d0-60ad-4e83-8ab6-283bf612e0c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a01ed3bc-72c0-4bae-8278-359eefd4fcf7', 'volume_name': 'volume-a01ed3bc-72c0-4bae-8278-359eefd4fcf7', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:00:16 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8bdc1513-1d86-4b03-b91b-92d72611ee0a tempest-CinderUnicodeTest-1155416848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61bed72c-e891-42ac-8596-d200ab93bee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:00:16 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8bdc1513-1d86-4b03-b91b-92d72611ee0a tempest-CinderUnicodeTest-1155416848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61bed72c-e891-42ac-8596-d200ab93bee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:00:16 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8bdc1513-1d86-4b03-b91b-92d72611ee0a tempest-CinderUnicodeTest-1155416848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c90724f7-f8b0-452f-84d3-ec26929e809f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:00:16 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-8bdc1513-1d86-4b03-b91b-92d72611ee0a tempest-CinderUnicodeTest-1155416848 None] Volume a01ed3bc-72c0-4bae-8278-359eefd4fcf7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a01ed3bc-72c0-4bae-8278-359eefd4fcf7', 'volume_size': 1} Sep 25 12:00:16 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-8bdc1513-1d86-4b03-b91b-92d72611ee0a tempest-CinderUnicodeTest-1155416848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:00:16 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-8bdc1513-1d86-4b03-b91b-92d72611ee0a tempest-CinderUnicodeTest-1155416848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:00:16 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-8bdc1513-1d86-4b03-b91b-92d72611ee0a tempest-CinderUnicodeTest-1155416848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:00:16Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a01ed3bc-72c0-4bae-8278-359eefd4fcf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1519f63298da456f9b0b4ef571c7ddc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:00:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:00:16Z,use_quota=True,user_id='65067923d8dd44a997eb0d1de46719a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:00:16 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-8bdc1513-1d86-4b03-b91b-92d72611ee0a tempest-CinderUnicodeTest-1155416848 None] Creating volume a01ed3bc-72c0-4bae-8278-359eefd4fcf7 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:00:16 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-8bdc1513-1d86-4b03-b91b-92d72611ee0a tempest-CinderUnicodeTest-1155416848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:00:16 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-8bdc1513-1d86-4b03-b91b-92d72611ee0a tempest-CinderUnicodeTest-1155416848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:00:16 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-8bdc1513-1d86-4b03-b91b-92d72611ee0a tempest-CinderUnicodeTest-1155416848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:00:16 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-8bdc1513-1d86-4b03-b91b-92d72611ee0a tempest-CinderUnicodeTest-1155416848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:00:16 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-8bdc1513-1d86-4b03-b91b-92d72611ee0a tempest-CinderUnicodeTest-1155416848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:00:16 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-8bdc1513-1d86-4b03-b91b-92d72611ee0a tempest-CinderUnicodeTest-1155416848 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:00:16 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-8bdc1513-1d86-4b03-b91b-92d72611ee0a tempest-CinderUnicodeTest-1155416848 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 12:00:16 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8bdc1513-1d86-4b03-b91b-92d72611ee0a tempest-CinderUnicodeTest-1155416848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a01ed3bc-72c0-4bae-8278-359eefd4fcf7 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:00:16 devstack sudo[106113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a01ed3bc-72c0-4bae-8278-359eefd4fcf7 1073741824 Sep 25 12:00:16 devstack sudo[106113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:00:16 devstack sudo[106113]: pam_unix(sudo:session): session closed for user root Sep 25 12:00:16 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8bdc1513-1d86-4b03-b91b-92d72611ee0a tempest-CinderUnicodeTest-1155416848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a01ed3bc-72c0-4bae-8278-359eefd4fcf7 1073741824" returned: 0 in 0.518s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:00:16 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8bdc1513-1d86-4b03-b91b-92d72611ee0a tempest-CinderUnicodeTest-1155416848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a01ed3bc-72c0-4bae-8278-359eefd4fcf7 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:00:16 devstack sudo[106118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a01ed3bc-72c0-4bae-8278-359eefd4fcf7 Sep 25 12:00:16 devstack sudo[106118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:00:16 devstack sudo[106118]: pam_unix(sudo:session): session closed for user root Sep 25 12:00:16 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8bdc1513-1d86-4b03-b91b-92d72611ee0a tempest-CinderUnicodeTest-1155416848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a01ed3bc-72c0-4bae-8278-359eefd4fcf7" returned: 0 in 0.287s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:00:16 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-8bdc1513-1d86-4b03-b91b-92d72611ee0a tempest-CinderUnicodeTest-1155416848 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:00:16 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-8bdc1513-1d86-4b03-b91b-92d72611ee0a tempest-CinderUnicodeTest-1155416848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:00:16 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8bdc1513-1d86-4b03-b91b-92d72611ee0a tempest-CinderUnicodeTest-1155416848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c90724f7-f8b0-452f-84d3-ec26929e809f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a01ed3bc-72c0-4bae-8278-359eefd4fcf7', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:00:16 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8bdc1513-1d86-4b03-b91b-92d72611ee0a tempest-CinderUnicodeTest-1155416848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efe08208-d67d-4449-b413-f1ef7193e2f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:00:16 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-8bdc1513-1d86-4b03-b91b-92d72611ee0a tempest-CinderUnicodeTest-1155416848 None] Volume volume-a01ed3bc-72c0-4bae-8278-359eefd4fcf7 (a01ed3bc-72c0-4bae-8278-359eefd4fcf7): created successfully Sep 25 12:00:16 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8bdc1513-1d86-4b03-b91b-92d72611ee0a tempest-CinderUnicodeTest-1155416848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efe08208-d67d-4449-b413-f1ef7193e2f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:00:16 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8bdc1513-1d86-4b03-b91b-92d72611ee0a tempest-CinderUnicodeTest-1155416848 None] Flow 'volume_create_manager' (09cc20f0-1386-4152-8f0f-d564e060edd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:00:17 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-8bdc1513-1d86-4b03-b91b-92d72611ee0a tempest-CinderUnicodeTest-1155416848 None] Created volume successfully. Sep 25 12:00:18 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-00174aa0-7aaa-4452-9a58-b3543e7ff7a3 tempest-CinderUnicodeTest-1155416848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:00:18 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-00174aa0-7aaa-4452-9a58-b3543e7ff7a3 tempest-CinderUnicodeTest-1155416848 None] Flow 'volume_create_manager' (fcaf874f-f713-496a-82bb-8b1f66ad19c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:00:18 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-00174aa0-7aaa-4452-9a58-b3543e7ff7a3 tempest-CinderUnicodeTest-1155416848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe98c79b-1b76-4ae4-832b-260df84f26be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:00:18 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-00174aa0-7aaa-4452-9a58-b3543e7ff7a3 tempest-CinderUnicodeTest-1155416848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe98c79b-1b76-4ae4-832b-260df84f26be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:00:18Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1422437948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c955841-a7a2-4406-91d7-4bf364599778,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1519f63298da456f9b0b4ef571c7ddc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:00:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:00:19Z,use_quota=True,user_id='65067923d8dd44a997eb0d1de46719a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:00:18 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-00174aa0-7aaa-4452-9a58-b3543e7ff7a3 tempest-CinderUnicodeTest-1155416848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1bf13d9-1bd4-44a9-aa6d-da3ff3f47f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:00:18 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-00174aa0-7aaa-4452-9a58-b3543e7ff7a3 tempest-CinderUnicodeTest-1155416848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1bf13d9-1bd4-44a9-aa6d-da3ff3f47f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:00:18 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-00174aa0-7aaa-4452-9a58-b3543e7ff7a3 tempest-CinderUnicodeTest-1155416848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (970cdcaf-58fa-4a45-8a04-6398329bda52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:00:18 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-00174aa0-7aaa-4452-9a58-b3543e7ff7a3 tempest-CinderUnicodeTest-1155416848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (970cdcaf-58fa-4a45-8a04-6398329bda52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c955841-a7a2-4406-91d7-4bf364599778', 'volume_name': 'volume-6c955841-a7a2-4406-91d7-4bf364599778', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:00:18 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-00174aa0-7aaa-4452-9a58-b3543e7ff7a3 tempest-CinderUnicodeTest-1155416848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4778881-e5ab-49d4-97ab-78f1219f8212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:00:18 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-00174aa0-7aaa-4452-9a58-b3543e7ff7a3 tempest-CinderUnicodeTest-1155416848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4778881-e5ab-49d4-97ab-78f1219f8212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:00:18 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-00174aa0-7aaa-4452-9a58-b3543e7ff7a3 tempest-CinderUnicodeTest-1155416848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58b2a50a-5aaa-45e5-830f-357d6ab63c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:00:18 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-00174aa0-7aaa-4452-9a58-b3543e7ff7a3 tempest-CinderUnicodeTest-1155416848 None] Volume 6c955841-a7a2-4406-91d7-4bf364599778: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c955841-a7a2-4406-91d7-4bf364599778', 'volume_size': 1} Sep 25 12:00:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-00174aa0-7aaa-4452-9a58-b3543e7ff7a3 tempest-CinderUnicodeTest-1155416848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:00:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-00174aa0-7aaa-4452-9a58-b3543e7ff7a3 tempest-CinderUnicodeTest-1155416848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:00:18 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-00174aa0-7aaa-4452-9a58-b3543e7ff7a3 tempest-CinderUnicodeTest-1155416848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:00:18Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1422437948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c955841-a7a2-4406-91d7-4bf364599778,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1519f63298da456f9b0b4ef571c7ddc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:00:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:00:19Z,use_quota=True,user_id='65067923d8dd44a997eb0d1de46719a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:00:18 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-00174aa0-7aaa-4452-9a58-b3543e7ff7a3 tempest-CinderUnicodeTest-1155416848 None] Creating volume 6c955841-a7a2-4406-91d7-4bf364599778 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:00:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-00174aa0-7aaa-4452-9a58-b3543e7ff7a3 tempest-CinderUnicodeTest-1155416848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:00:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-00174aa0-7aaa-4452-9a58-b3543e7ff7a3 tempest-CinderUnicodeTest-1155416848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:00:18 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-00174aa0-7aaa-4452-9a58-b3543e7ff7a3 tempest-CinderUnicodeTest-1155416848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:00:18 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-00174aa0-7aaa-4452-9a58-b3543e7ff7a3 tempest-CinderUnicodeTest-1155416848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:00:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-00174aa0-7aaa-4452-9a58-b3543e7ff7a3 tempest-CinderUnicodeTest-1155416848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:00:18 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-00174aa0-7aaa-4452-9a58-b3543e7ff7a3 tempest-CinderUnicodeTest-1155416848 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:00:18 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-00174aa0-7aaa-4452-9a58-b3543e7ff7a3 tempest-CinderUnicodeTest-1155416848 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 12:00:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-00174aa0-7aaa-4452-9a58-b3543e7ff7a3 tempest-CinderUnicodeTest-1155416848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6c955841-a7a2-4406-91d7-4bf364599778 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:00:18 devstack sudo[106121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6c955841-a7a2-4406-91d7-4bf364599778 1073741824 Sep 25 12:00:18 devstack sudo[106121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:00:19 devstack sudo[106121]: pam_unix(sudo:session): session closed for user root Sep 25 12:00:19 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-00174aa0-7aaa-4452-9a58-b3543e7ff7a3 tempest-CinderUnicodeTest-1155416848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6c955841-a7a2-4406-91d7-4bf364599778 1073741824" returned: 0 in 0.497s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:00:19 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-00174aa0-7aaa-4452-9a58-b3543e7ff7a3 tempest-CinderUnicodeTest-1155416848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6c955841-a7a2-4406-91d7-4bf364599778 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:00:19 devstack sudo[106127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6c955841-a7a2-4406-91d7-4bf364599778 Sep 25 12:00:19 devstack sudo[106127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:00:19 devstack sudo[106127]: pam_unix(sudo:session): session closed for user root Sep 25 12:00:19 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-00174aa0-7aaa-4452-9a58-b3543e7ff7a3 tempest-CinderUnicodeTest-1155416848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6c955841-a7a2-4406-91d7-4bf364599778" returned: 0 in 0.323s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:00:19 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-00174aa0-7aaa-4452-9a58-b3543e7ff7a3 tempest-CinderUnicodeTest-1155416848 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:00:19 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-00174aa0-7aaa-4452-9a58-b3543e7ff7a3 tempest-CinderUnicodeTest-1155416848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:00:19 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-00174aa0-7aaa-4452-9a58-b3543e7ff7a3 tempest-CinderUnicodeTest-1155416848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58b2a50a-5aaa-45e5-830f-357d6ab63c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c955841-a7a2-4406-91d7-4bf364599778', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:00:19 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-00174aa0-7aaa-4452-9a58-b3543e7ff7a3 tempest-CinderUnicodeTest-1155416848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab803f9f-3b2e-41a4-9490-e0ce43e11bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:00:19 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-00174aa0-7aaa-4452-9a58-b3543e7ff7a3 tempest-CinderUnicodeTest-1155416848 None] Volume volume-6c955841-a7a2-4406-91d7-4bf364599778 (6c955841-a7a2-4406-91d7-4bf364599778): created successfully Sep 25 12:00:19 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-00174aa0-7aaa-4452-9a58-b3543e7ff7a3 tempest-CinderUnicodeTest-1155416848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab803f9f-3b2e-41a4-9490-e0ce43e11bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:00:19 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-00174aa0-7aaa-4452-9a58-b3543e7ff7a3 tempest-CinderUnicodeTest-1155416848 None] Flow 'volume_create_manager' (fcaf874f-f713-496a-82bb-8b1f66ad19c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:00:19 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-00174aa0-7aaa-4452-9a58-b3543e7ff7a3 tempest-CinderUnicodeTest-1155416848 None] Created volume successfully. Sep 25 12:00:21 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-601a5b6b-54b9-4924-b747-a6e91e1376e5 tempest-CinderUnicodeTest-1155416848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:00:21 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-601a5b6b-54b9-4924-b747-a6e91e1376e5 tempest-CinderUnicodeTest-1155416848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:00:21 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-601a5b6b-54b9-4924-b747-a6e91e1376e5 tempest-CinderUnicodeTest-1155416848 None] Creating offline snapshot 424e1fbc-ed9a-4a44-ab33-491aee755795 of volume 6c955841-a7a2-4406-91d7-4bf364599778 {{(pid=86984) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 12:00:21 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a656dd-dcdb-4ee9-a804-b516e6da9243]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:00:21 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-601a5b6b-54b9-4924-b747-a6e91e1376e5 tempest-CinderUnicodeTest-1155416848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6c955841-a7a2-4406-91d7-4bf364599778 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:00:21 devstack sudo[106130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6c955841-a7a2-4406-91d7-4bf364599778 Sep 25 12:00:21 devstack sudo[106130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:00:21 devstack sudo[106130]: pam_unix(sudo:session): session closed for user root Sep 25 12:00:21 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-601a5b6b-54b9-4924-b747-a6e91e1376e5 tempest-CinderUnicodeTest-1155416848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6c955841-a7a2-4406-91d7-4bf364599778" returned: 0 in 0.535s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:00:21 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-601a5b6b-54b9-4924-b747-a6e91e1376e5 tempest-CinderUnicodeTest-1155416848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6c955841-a7a2-4406-91d7-4bf364599778,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6c955841-a7a2-4406-91d7-4bf364599778.424e1fbc-ed9a-4a44-ab33-491aee755795 1G {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:00:21 devstack sudo[106135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6c955841-a7a2-4406-91d7-4bf364599778,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6c955841-a7a2-4406-91d7-4bf364599778.424e1fbc-ed9a-4a44-ab33-491aee755795 1G Sep 25 12:00:21 devstack sudo[106135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:00:22 devstack sudo[106135]: pam_unix(sudo:session): session closed for user root Sep 25 12:00:22 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-601a5b6b-54b9-4924-b747-a6e91e1376e5 tempest-CinderUnicodeTest-1155416848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6c955841-a7a2-4406-91d7-4bf364599778,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6c955841-a7a2-4406-91d7-4bf364599778.424e1fbc-ed9a-4a44-ab33-491aee755795 1G" returned: 0 in 0.539s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:00:22 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-601a5b6b-54b9-4924-b747-a6e91e1376e5 tempest-CinderUnicodeTest-1155416848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c955841-a7a2-4406-91d7-4bf364599778 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6c955841-a7a2-4406-91d7-4bf364599778.424e1fbc-ed9a-4a44-ab33-491aee755795 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:00:22 devstack sudo[106140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c955841-a7a2-4406-91d7-4bf364599778 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6c955841-a7a2-4406-91d7-4bf364599778.424e1fbc-ed9a-4a44-ab33-491aee755795 Sep 25 12:00:22 devstack sudo[106140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:00:22 devstack sudo[106140]: pam_unix(sudo:session): session closed for user root Sep 25 12:00:22 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-601a5b6b-54b9-4924-b747-a6e91e1376e5 tempest-CinderUnicodeTest-1155416848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c955841-a7a2-4406-91d7-4bf364599778 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6c955841-a7a2-4406-91d7-4bf364599778.424e1fbc-ed9a-4a44-ab33-491aee755795" returned: 0 in 0.399s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:00:22 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-601a5b6b-54b9-4924-b747-a6e91e1376e5 tempest-CinderUnicodeTest-1155416848 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6c955841-a7a2-4406-91d7-4bf364599778.424e1fbc-ed9a-4a44-ab33-491aee755795 is being set with open permissions: ugo+rw Sep 25 12:00:22 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-601a5b6b-54b9-4924-b747-a6e91e1376e5 tempest-CinderUnicodeTest-1155416848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6c955841-a7a2-4406-91d7-4bf364599778.424e1fbc-ed9a-4a44-ab33-491aee755795 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:00:22 devstack sudo[106146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6c955841-a7a2-4406-91d7-4bf364599778.424e1fbc-ed9a-4a44-ab33-491aee755795 Sep 25 12:00:22 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:00:23 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root Sep 25 12:00:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-601a5b6b-54b9-4924-b747-a6e91e1376e5 tempest-CinderUnicodeTest-1155416848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6c955841-a7a2-4406-91d7-4bf364599778.424e1fbc-ed9a-4a44-ab33-491aee755795" returned: 0 in 0.294s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:00:23 devstack cinder-volume[86984]: DEBUG dbcounter [-] [86984] Writing DB stats cinder:SELECT=73,cinder:INSERT=20,cinder:UPDATE=98,cinder:DELETE=7 {{(pid=86984) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:00:23 devstack cinder-volume[86984]: DEBUG dbcounter [-] [86984] Writing DB stats cinder:SELECT=68,cinder:UPDATE=88,cinder:INSERT=23,cinder:DELETE=8 {{(pid=86984) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:00:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-601a5b6b-54b9-4924-b747-a6e91e1376e5 tempest-CinderUnicodeTest-1155416848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6c955841-a7a2-4406-91d7-4bf364599778.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:00:23 devstack sudo[106149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6c955841-a7a2-4406-91d7-4bf364599778.info Sep 25 12:00:23 devstack sudo[106149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:00:23 devstack sudo[106149]: pam_unix(sudo:session): session closed for user root Sep 25 12:00:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-601a5b6b-54b9-4924-b747-a6e91e1376e5 tempest-CinderUnicodeTest-1155416848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6c955841-a7a2-4406-91d7-4bf364599778.info" returned: 0 in 0.360s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:00:23 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-601a5b6b-54b9-4924-b747-a6e91e1376e5 tempest-CinderUnicodeTest-1155416848 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6c955841-a7a2-4406-91d7-4bf364599778.info is being set with open permissions: ugo+rw Sep 25 12:00:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-601a5b6b-54b9-4924-b747-a6e91e1376e5 tempest-CinderUnicodeTest-1155416848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6c955841-a7a2-4406-91d7-4bf364599778.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:00:23 devstack sudo[106152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6c955841-a7a2-4406-91d7-4bf364599778.info Sep 25 12:00:23 devstack sudo[106152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:00:23 devstack sudo[106152]: pam_unix(sudo:session): session closed for user root Sep 25 12:00:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-601a5b6b-54b9-4924-b747-a6e91e1376e5 tempest-CinderUnicodeTest-1155416848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6c955841-a7a2-4406-91d7-4bf364599778.info" returned: 0 in 0.324s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:00:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-601a5b6b-54b9-4924-b747-a6e91e1376e5 tempest-CinderUnicodeTest-1155416848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.610s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:00:23 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-601a5b6b-54b9-4924-b747-a6e91e1376e5 tempest-CinderUnicodeTest-1155416848 None] Create snapshot completed successfully Sep 25 12:00:24 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ad080a11-c2cb-43a9-9083-490f45dc1c8f tempest-CinderUnicodeTest-1155416848 None] Acquiring lock "cinder-424e1fbc-ed9a-4a44-ab33-491aee755795-delete_snapshot" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:00:24 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ad080a11-c2cb-43a9-9083-490f45dc1c8f tempest-CinderUnicodeTest-1155416848 None] Lock "cinder-424e1fbc-ed9a-4a44-ab33-491aee755795-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:00:24 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ad080a11-c2cb-43a9-9083-490f45dc1c8f tempest-CinderUnicodeTest-1155416848 None] Acquiring lock "cinder-quobyte-6c955841-a7a2-4406-91d7-4bf364599778" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:00:24 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ad080a11-c2cb-43a9-9083-490f45dc1c8f tempest-CinderUnicodeTest-1155416848 None] Lock "cinder-quobyte-6c955841-a7a2-4406-91d7-4bf364599778" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:00:24 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ad080a11-c2cb-43a9-9083-490f45dc1c8f tempest-CinderUnicodeTest-1155416848 None] Acquiring lock "cinder-quobyte-424e1fbc-ed9a-4a44-ab33-491aee755795" by "_delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:00:24 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ad080a11-c2cb-43a9-9083-490f45dc1c8f tempest-CinderUnicodeTest-1155416848 None] Lock "cinder-quobyte-424e1fbc-ed9a-4a44-ab33-491aee755795" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:00:24 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-ad080a11-c2cb-43a9-9083-490f45dc1c8f tempest-CinderUnicodeTest-1155416848 None] Deleting offline snapshot 424e1fbc-ed9a-4a44-ab33-491aee755795 of volume 6c955841-a7a2-4406-91d7-4bf364599778 {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 12:00:24 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-ad080a11-c2cb-43a9-9083-490f45dc1c8f tempest-CinderUnicodeTest-1155416848 None] snapshot_file for this snap is: volume-6c955841-a7a2-4406-91d7-4bf364599778.424e1fbc-ed9a-4a44-ab33-491aee755795 {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 12:00:24 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[14daf6ab-abd7-43f5-9443-80eb9248b4bb]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:00:24 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ad080a11-c2cb-43a9-9083-490f45dc1c8f tempest-CinderUnicodeTest-1155416848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6c955841-a7a2-4406-91d7-4bf364599778.424e1fbc-ed9a-4a44-ab33-491aee755795 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:00:24 devstack sudo[106156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6c955841-a7a2-4406-91d7-4bf364599778.424e1fbc-ed9a-4a44-ab33-491aee755795 Sep 25 12:00:24 devstack sudo[106156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:00:24 devstack sudo[106156]: pam_unix(sudo:session): session closed for user root Sep 25 12:00:24 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ad080a11-c2cb-43a9-9083-490f45dc1c8f tempest-CinderUnicodeTest-1155416848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6c955841-a7a2-4406-91d7-4bf364599778.424e1fbc-ed9a-4a44-ab33-491aee755795" returned: 0 in 0.449s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:00:24 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-ad080a11-c2cb-43a9-9083-490f45dc1c8f tempest-CinderUnicodeTest-1155416848 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c955841-a7a2-4406-91d7-4bf364599778(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86984) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:00:25 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d41433-a2a1-4ae0-86bf-b81201017737]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:00:25 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ad080a11-c2cb-43a9-9083-490f45dc1c8f tempest-CinderUnicodeTest-1155416848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6c955841-a7a2-4406-91d7-4bf364599778 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:00:25 devstack sudo[106161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6c955841-a7a2-4406-91d7-4bf364599778 Sep 25 12:00:25 devstack sudo[106161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:00:25 devstack sudo[106161]: pam_unix(sudo:session): session closed for user root Sep 25 12:00:25 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ad080a11-c2cb-43a9-9083-490f45dc1c8f tempest-CinderUnicodeTest-1155416848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6c955841-a7a2-4406-91d7-4bf364599778" returned: 0 in 0.455s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:00:25 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ad080a11-c2cb-43a9-9083-490f45dc1c8f tempest-CinderUnicodeTest-1155416848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6c955841-a7a2-4406-91d7-4bf364599778.424e1fbc-ed9a-4a44-ab33-491aee755795 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:00:25 devstack sudo[106166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6c955841-a7a2-4406-91d7-4bf364599778.424e1fbc-ed9a-4a44-ab33-491aee755795 Sep 25 12:00:25 devstack sudo[106166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:00:25 devstack sudo[106166]: pam_unix(sudo:session): session closed for user root Sep 25 12:00:25 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ad080a11-c2cb-43a9-9083-490f45dc1c8f tempest-CinderUnicodeTest-1155416848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6c955841-a7a2-4406-91d7-4bf364599778.424e1fbc-ed9a-4a44-ab33-491aee755795" returned: 0 in 0.415s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:00:25 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ad080a11-c2cb-43a9-9083-490f45dc1c8f tempest-CinderUnicodeTest-1155416848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6c955841-a7a2-4406-91d7-4bf364599778.424e1fbc-ed9a-4a44-ab33-491aee755795 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:00:25 devstack sudo[106171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6c955841-a7a2-4406-91d7-4bf364599778.424e1fbc-ed9a-4a44-ab33-491aee755795 Sep 25 12:00:25 devstack sudo[106171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:00:26 devstack sudo[106171]: pam_unix(sudo:session): session closed for user root Sep 25 12:00:26 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ad080a11-c2cb-43a9-9083-490f45dc1c8f tempest-CinderUnicodeTest-1155416848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6c955841-a7a2-4406-91d7-4bf364599778.424e1fbc-ed9a-4a44-ab33-491aee755795" returned: 0 in 0.283s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:00:26 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ad080a11-c2cb-43a9-9083-490f45dc1c8f tempest-CinderUnicodeTest-1155416848 None] Lock "cinder-quobyte-424e1fbc-ed9a-4a44-ab33-491aee755795" released by "_delete_snapshot" :: held 1.755s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:00:26 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ad080a11-c2cb-43a9-9083-490f45dc1c8f tempest-CinderUnicodeTest-1155416848 None] Lock "cinder-quobyte-6c955841-a7a2-4406-91d7-4bf364599778" released by "delete_snapshot" :: held 1.779s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:00:26 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-ad080a11-c2cb-43a9-9083-490f45dc1c8f tempest-CinderUnicodeTest-1155416848 None] Created reservations ['64adc6b9-1a2a-4a36-9dff-c06412caa6a2', '91626dd1-4c93-4cbc-b118-53c0aef93822', 'afe4d58e-2e84-4f2c-9f21-47918f47fedb', '2f6b2ae6-6140-4763-8b58-2eded295a6ad'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:00:26 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-ad080a11-c2cb-43a9-9083-490f45dc1c8f tempest-CinderUnicodeTest-1155416848 None] Delete snapshot completed successfully. Sep 25 12:00:26 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ad080a11-c2cb-43a9-9083-490f45dc1c8f tempest-CinderUnicodeTest-1155416848 None] Lock "cinder-424e1fbc-ed9a-4a44-ab33-491aee755795-delete_snapshot" released by "delete_snapshot" :: held 2.039s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:00:26 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-798a2222-25cf-4f2d-a177-2b73549014c2 tempest-CinderUnicodeTest-1155416848 None] Acquiring lock "cinder-6c955841-a7a2-4406-91d7-4bf364599778-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:00:26 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-798a2222-25cf-4f2d-a177-2b73549014c2 tempest-CinderUnicodeTest-1155416848 None] Lock "cinder-6c955841-a7a2-4406-91d7-4bf364599778-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:00:26 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-798a2222-25cf-4f2d-a177-2b73549014c2 tempest-CinderUnicodeTest-1155416848 None] Acquiring lock "cinder-quobyte-6c955841-a7a2-4406-91d7-4bf364599778" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:00:26 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-798a2222-25cf-4f2d-a177-2b73549014c2 tempest-CinderUnicodeTest-1155416848 None] Lock "cinder-quobyte-6c955841-a7a2-4406-91d7-4bf364599778" acquired by "delete_volume" :: waited 0.022s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:00:26 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4af472-dfd5-4ec4-88ff-dca34cf2480a]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:00:26 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-798a2222-25cf-4f2d-a177-2b73549014c2 tempest-CinderUnicodeTest-1155416848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6c955841-a7a2-4406-91d7-4bf364599778 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:00:26 devstack sudo[106174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6c955841-a7a2-4406-91d7-4bf364599778 Sep 25 12:00:26 devstack sudo[106174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:00:27 devstack sudo[106174]: pam_unix(sudo:session): session closed for user root Sep 25 12:00:27 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-798a2222-25cf-4f2d-a177-2b73549014c2 tempest-CinderUnicodeTest-1155416848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6c955841-a7a2-4406-91d7-4bf364599778" returned: 0 in 0.399s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:00:27 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-798a2222-25cf-4f2d-a177-2b73549014c2 tempest-CinderUnicodeTest-1155416848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6c955841-a7a2-4406-91d7-4bf364599778 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:00:27 devstack sudo[106179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6c955841-a7a2-4406-91d7-4bf364599778 Sep 25 12:00:27 devstack sudo[106179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:00:27 devstack sudo[106179]: pam_unix(sudo:session): session closed for user root Sep 25 12:00:27 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-798a2222-25cf-4f2d-a177-2b73549014c2 tempest-CinderUnicodeTest-1155416848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6c955841-a7a2-4406-91d7-4bf364599778" returned: 0 in 0.312s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:00:27 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-798a2222-25cf-4f2d-a177-2b73549014c2 tempest-CinderUnicodeTest-1155416848 None] Lock "cinder-quobyte-6c955841-a7a2-4406-91d7-4bf364599778" released by "delete_volume" :: held 0.786s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:00:27 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-798a2222-25cf-4f2d-a177-2b73549014c2 tempest-CinderUnicodeTest-1155416848 None] Created reservations ['b7be05d6-03c4-4301-abab-3bd190232f38', '4a28752a-49a2-4348-ac64-d91ceea52c4e', 'a7011eb8-bf71-45da-a207-51508a6254c0', '7a6655c0-79ea-47d7-9166-4e4ba3e509ec'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:00:27 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-798a2222-25cf-4f2d-a177-2b73549014c2 tempest-CinderUnicodeTest-1155416848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:00:27 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-798a2222-25cf-4f2d-a177-2b73549014c2 tempest-CinderUnicodeTest-1155416848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:00:27 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-798a2222-25cf-4f2d-a177-2b73549014c2 tempest-CinderUnicodeTest-1155416848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:00:27 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-798a2222-25cf-4f2d-a177-2b73549014c2 tempest-CinderUnicodeTest-1155416848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:00:27 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-798a2222-25cf-4f2d-a177-2b73549014c2 tempest-CinderUnicodeTest-1155416848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:00:27 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-798a2222-25cf-4f2d-a177-2b73549014c2 tempest-CinderUnicodeTest-1155416848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:00:27 devstack sudo[106183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 12:00:27 devstack sudo[106183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:00:27 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-2e37baa9-e6a1-45b4-9915-ab6be7a29547 tempest-CinderUnicodeTest-1155416848 None] Acquiring lock "cinder-a01ed3bc-72c0-4bae-8278-359eefd4fcf7-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:00:27 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-2e37baa9-e6a1-45b4-9915-ab6be7a29547 tempest-CinderUnicodeTest-1155416848 None] Lock "cinder-a01ed3bc-72c0-4bae-8278-359eefd4fcf7-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:00:27 devstack sudo[106183]: pam_unix(sudo:session): session closed for user root Sep 25 12:00:28 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-2e37baa9-e6a1-45b4-9915-ab6be7a29547 tempest-CinderUnicodeTest-1155416848 None] Acquiring lock "cinder-quobyte-a01ed3bc-72c0-4bae-8278-359eefd4fcf7" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:00:28 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-798a2222-25cf-4f2d-a177-2b73549014c2 tempest-CinderUnicodeTest-1155416848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.315s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:00:28 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-798a2222-25cf-4f2d-a177-2b73549014c2 tempest-CinderUnicodeTest-1155416848 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:00:28 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-798a2222-25cf-4f2d-a177-2b73549014c2 tempest-CinderUnicodeTest-1155416848 None] Deleted volume successfully. Sep 25 12:00:28 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-2e37baa9-e6a1-45b4-9915-ab6be7a29547 tempest-CinderUnicodeTest-1155416848 None] Lock "cinder-quobyte-a01ed3bc-72c0-4bae-8278-359eefd4fcf7" acquired by "delete_volume" :: waited 0.029s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:00:28 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-798a2222-25cf-4f2d-a177-2b73549014c2 tempest-CinderUnicodeTest-1155416848 None] Lock "cinder-6c955841-a7a2-4406-91d7-4bf364599778-delete_volume" released by "delete_volume" :: held 1.392s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:00:28 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af57a4c-e57d-4b53-897f-0c25b1ce9c49]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:00:28 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2e37baa9-e6a1-45b4-9915-ab6be7a29547 tempest-CinderUnicodeTest-1155416848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a01ed3bc-72c0-4bae-8278-359eefd4fcf7 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:00:28 devstack sudo[106186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a01ed3bc-72c0-4bae-8278-359eefd4fcf7 Sep 25 12:00:28 devstack sudo[106186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:00:28 devstack sudo[106186]: pam_unix(sudo:session): session closed for user root Sep 25 12:00:28 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2e37baa9-e6a1-45b4-9915-ab6be7a29547 tempest-CinderUnicodeTest-1155416848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a01ed3bc-72c0-4bae-8278-359eefd4fcf7" returned: 0 in 0.478s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:00:28 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2e37baa9-e6a1-45b4-9915-ab6be7a29547 tempest-CinderUnicodeTest-1155416848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a01ed3bc-72c0-4bae-8278-359eefd4fcf7 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:00:28 devstack sudo[106191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a01ed3bc-72c0-4bae-8278-359eefd4fcf7 Sep 25 12:00:28 devstack sudo[106191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:00:28 devstack sudo[106191]: pam_unix(sudo:session): session closed for user root Sep 25 12:00:28 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2e37baa9-e6a1-45b4-9915-ab6be7a29547 tempest-CinderUnicodeTest-1155416848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a01ed3bc-72c0-4bae-8278-359eefd4fcf7" returned: 0 in 0.288s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:00:28 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-2e37baa9-e6a1-45b4-9915-ab6be7a29547 tempest-CinderUnicodeTest-1155416848 None] Lock "cinder-quobyte-a01ed3bc-72c0-4bae-8278-359eefd4fcf7" released by "delete_volume" :: held 0.828s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:00:28 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-2e37baa9-e6a1-45b4-9915-ab6be7a29547 tempest-CinderUnicodeTest-1155416848 None] Created reservations ['e54b3394-32b9-43cd-b2e2-8a1601d4ff31', '11704fe3-8ad7-43c9-9c68-d9f3b7579157', '6171c24f-1af6-4d61-a551-30b3a17973d9', 'b871341d-4afc-4359-9688-1252ec31a7c1'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:00:29 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-2e37baa9-e6a1-45b4-9915-ab6be7a29547 tempest-CinderUnicodeTest-1155416848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:00:29 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-2e37baa9-e6a1-45b4-9915-ab6be7a29547 tempest-CinderUnicodeTest-1155416848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:00:29 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-2e37baa9-e6a1-45b4-9915-ab6be7a29547 tempest-CinderUnicodeTest-1155416848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:00:29 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-2e37baa9-e6a1-45b4-9915-ab6be7a29547 tempest-CinderUnicodeTest-1155416848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:00:29 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-2e37baa9-e6a1-45b4-9915-ab6be7a29547 tempest-CinderUnicodeTest-1155416848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:00:29 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2e37baa9-e6a1-45b4-9915-ab6be7a29547 tempest-CinderUnicodeTest-1155416848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:00:29 devstack sudo[106196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 12:00:29 devstack sudo[106196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:00:29 devstack sudo[106196]: pam_unix(sudo:session): session closed for user root Sep 25 12:00:29 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2e37baa9-e6a1-45b4-9915-ab6be7a29547 tempest-CinderUnicodeTest-1155416848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.344s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:00:29 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-2e37baa9-e6a1-45b4-9915-ab6be7a29547 tempest-CinderUnicodeTest-1155416848 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:00:29 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-2e37baa9-e6a1-45b4-9915-ab6be7a29547 tempest-CinderUnicodeTest-1155416848 None] Deleted volume successfully. Sep 25 12:00:29 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-2e37baa9-e6a1-45b4-9915-ab6be7a29547 tempest-CinderUnicodeTest-1155416848 None] Lock "cinder-a01ed3bc-72c0-4bae-8278-359eefd4fcf7-delete_volume" released by "delete_volume" :: held 1.520s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:00:38 devstack cinder-volume[86984]: DEBUG oslo_service.periodic_task [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:00:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:00:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:00:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:00:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:00:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:00:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:00:38 devstack sudo[106203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 12:00:38 devstack sudo[106203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:00:38 devstack sudo[106203]: pam_unix(sudo:session): session closed for user root Sep 25 12:00:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.313s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:00:38 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:00:38 devstack cinder-volume[86984]: DEBUG dbcounter [-] [86984] Writing DB stats cinder:SELECT=19,cinder:UPDATE=22,cinder:INSERT=7,cinder:DELETE=1 {{(pid=86984) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:00:39 devstack cinder-volume[86984]: DEBUG oslo_service.periodic_task [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running periodic task VolumeManager._thread_info {{(pid=86984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:00:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] thread count: 28 {{(pid=86984) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 12:00:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] thread info: [<_MainThread(MainThread, started 132046492332160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86984) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 12:00:39 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-70a5d810-05c4-43cc-a00d-9bb36344a16a tempest-TestServerVolumeAttachmentScenario-1967901015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:00:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-70a5d810-05c4-43cc-a00d-9bb36344a16a tempest-TestServerVolumeAttachmentScenario-1967901015 None] Flow 'volume_create_manager' (9d5543a0-0f03-4668-9fca-72b184503ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:00:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-70a5d810-05c4-43cc-a00d-9bb36344a16a tempest-TestServerVolumeAttachmentScenario-1967901015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fededc21-3dcb-4689-87dc-60a9af2d98b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:00:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-70a5d810-05c4-43cc-a00d-9bb36344a16a tempest-TestServerVolumeAttachmentScenario-1967901015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fededc21-3dcb-4689-87dc-60a9af2d98b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:00:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1073464550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05172b56-0726-4156-ab7f-9a8d664ab683,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eba3e79c0f49465bb9172c0a101c86c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:00:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:00:39Z,use_quota=True,user_id='4846ce326d6243239612b35b064d8c79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:00:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-70a5d810-05c4-43cc-a00d-9bb36344a16a tempest-TestServerVolumeAttachmentScenario-1967901015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32e5ba0c-f007-44c4-a302-418bb9d45ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:00:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-70a5d810-05c4-43cc-a00d-9bb36344a16a tempest-TestServerVolumeAttachmentScenario-1967901015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32e5ba0c-f007-44c4-a302-418bb9d45ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:00:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-70a5d810-05c4-43cc-a00d-9bb36344a16a tempest-TestServerVolumeAttachmentScenario-1967901015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f09f6925-4fd9-4787-9b0d-657cc75ea938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:00:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-70a5d810-05c4-43cc-a00d-9bb36344a16a tempest-TestServerVolumeAttachmentScenario-1967901015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f09f6925-4fd9-4787-9b0d-657cc75ea938) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05172b56-0726-4156-ab7f-9a8d664ab683', 'volume_name': 'volume-05172b56-0726-4156-ab7f-9a8d664ab683', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:00:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-70a5d810-05c4-43cc-a00d-9bb36344a16a tempest-TestServerVolumeAttachmentScenario-1967901015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b93072e-99a1-426d-ac9f-6bc35d40d773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:00:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-70a5d810-05c4-43cc-a00d-9bb36344a16a tempest-TestServerVolumeAttachmentScenario-1967901015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b93072e-99a1-426d-ac9f-6bc35d40d773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:00:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-70a5d810-05c4-43cc-a00d-9bb36344a16a tempest-TestServerVolumeAttachmentScenario-1967901015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86d132e8-0b21-4768-aaa8-5a1013ce079f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:00:39 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-70a5d810-05c4-43cc-a00d-9bb36344a16a tempest-TestServerVolumeAttachmentScenario-1967901015 None] Volume 05172b56-0726-4156-ab7f-9a8d664ab683: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05172b56-0726-4156-ab7f-9a8d664ab683', 'volume_size': 1} Sep 25 12:00:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-70a5d810-05c4-43cc-a00d-9bb36344a16a tempest-TestServerVolumeAttachmentScenario-1967901015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:00:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-70a5d810-05c4-43cc-a00d-9bb36344a16a tempest-TestServerVolumeAttachmentScenario-1967901015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:00:39 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-70a5d810-05c4-43cc-a00d-9bb36344a16a tempest-TestServerVolumeAttachmentScenario-1967901015 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:00:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1073464550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05172b56-0726-4156-ab7f-9a8d664ab683,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eba3e79c0f49465bb9172c0a101c86c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:00:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:00:39Z,use_quota=True,user_id='4846ce326d6243239612b35b064d8c79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:00:39 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-70a5d810-05c4-43cc-a00d-9bb36344a16a tempest-TestServerVolumeAttachmentScenario-1967901015 None] Creating volume 05172b56-0726-4156-ab7f-9a8d664ab683 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:00:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-70a5d810-05c4-43cc-a00d-9bb36344a16a tempest-TestServerVolumeAttachmentScenario-1967901015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:00:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-70a5d810-05c4-43cc-a00d-9bb36344a16a tempest-TestServerVolumeAttachmentScenario-1967901015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:00:39 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-70a5d810-05c4-43cc-a00d-9bb36344a16a tempest-TestServerVolumeAttachmentScenario-1967901015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:00:39 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-70a5d810-05c4-43cc-a00d-9bb36344a16a tempest-TestServerVolumeAttachmentScenario-1967901015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:00:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-70a5d810-05c4-43cc-a00d-9bb36344a16a tempest-TestServerVolumeAttachmentScenario-1967901015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:00:39 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-70a5d810-05c4-43cc-a00d-9bb36344a16a tempest-TestServerVolumeAttachmentScenario-1967901015 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:00:39 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-70a5d810-05c4-43cc-a00d-9bb36344a16a tempest-TestServerVolumeAttachmentScenario-1967901015 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 12:00:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-70a5d810-05c4-43cc-a00d-9bb36344a16a tempest-TestServerVolumeAttachmentScenario-1967901015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-05172b56-0726-4156-ab7f-9a8d664ab683 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:00:39 devstack sudo[106206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-05172b56-0726-4156-ab7f-9a8d664ab683 1073741824 Sep 25 12:00:39 devstack sudo[106206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:00:39 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f7e710c-3571-4cf8-ad67-e2c573ce6c01 tempest-TestServerVolumeAttachmentScenario-1967901015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:00:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3f7e710c-3571-4cf8-ad67-e2c573ce6c01 tempest-TestServerVolumeAttachmentScenario-1967901015 None] Flow 'volume_create_manager' (d3bc9bf4-a939-4b4f-bc11-018de783378f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:00:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3f7e710c-3571-4cf8-ad67-e2c573ce6c01 tempest-TestServerVolumeAttachmentScenario-1967901015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c111320c-1def-49aa-a569-08d54d9dc4e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:00:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3f7e710c-3571-4cf8-ad67-e2c573ce6c01 tempest-TestServerVolumeAttachmentScenario-1967901015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c111320c-1def-49aa-a569-08d54d9dc4e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:00:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-804818281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfb0233e-27ef-449f-9dae-fa0d4e7304df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eba3e79c0f49465bb9172c0a101c86c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:00:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:00:39Z,use_quota=True,user_id='4846ce326d6243239612b35b064d8c79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:00:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3f7e710c-3571-4cf8-ad67-e2c573ce6c01 tempest-TestServerVolumeAttachmentScenario-1967901015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a83d1155-c380-4389-9995-e3d7bb416273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:00:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3f7e710c-3571-4cf8-ad67-e2c573ce6c01 tempest-TestServerVolumeAttachmentScenario-1967901015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a83d1155-c380-4389-9995-e3d7bb416273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:00:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3f7e710c-3571-4cf8-ad67-e2c573ce6c01 tempest-TestServerVolumeAttachmentScenario-1967901015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66dfea3b-5568-49d2-815a-96566d95d809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:00:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3f7e710c-3571-4cf8-ad67-e2c573ce6c01 tempest-TestServerVolumeAttachmentScenario-1967901015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66dfea3b-5568-49d2-815a-96566d95d809) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfb0233e-27ef-449f-9dae-fa0d4e7304df', 'volume_name': 'volume-bfb0233e-27ef-449f-9dae-fa0d4e7304df', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:00:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3f7e710c-3571-4cf8-ad67-e2c573ce6c01 tempest-TestServerVolumeAttachmentScenario-1967901015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ef1d05d-f10a-4b55-916a-f910855f727b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:00:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3f7e710c-3571-4cf8-ad67-e2c573ce6c01 tempest-TestServerVolumeAttachmentScenario-1967901015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ef1d05d-f10a-4b55-916a-f910855f727b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:00:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3f7e710c-3571-4cf8-ad67-e2c573ce6c01 tempest-TestServerVolumeAttachmentScenario-1967901015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28003855-8eb1-4fa9-9618-88d5edf5903b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:00:39 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-3f7e710c-3571-4cf8-ad67-e2c573ce6c01 tempest-TestServerVolumeAttachmentScenario-1967901015 None] Volume bfb0233e-27ef-449f-9dae-fa0d4e7304df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfb0233e-27ef-449f-9dae-fa0d4e7304df', 'volume_size': 1} Sep 25 12:00:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3f7e710c-3571-4cf8-ad67-e2c573ce6c01 tempest-TestServerVolumeAttachmentScenario-1967901015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:00:40 devstack sudo[106206]: pam_unix(sudo:session): session closed for user root Sep 25 12:00:40 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-70a5d810-05c4-43cc-a00d-9bb36344a16a tempest-TestServerVolumeAttachmentScenario-1967901015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-05172b56-0726-4156-ab7f-9a8d664ab683 1073741824" returned: 0 in 0.798s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:00:40 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-70a5d810-05c4-43cc-a00d-9bb36344a16a tempest-TestServerVolumeAttachmentScenario-1967901015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-05172b56-0726-4156-ab7f-9a8d664ab683 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:00:40 devstack sudo[106218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-05172b56-0726-4156-ab7f-9a8d664ab683 Sep 25 12:00:40 devstack sudo[106218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:00:40 devstack sudo[106218]: pam_unix(sudo:session): session closed for user root Sep 25 12:00:40 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-70a5d810-05c4-43cc-a00d-9bb36344a16a tempest-TestServerVolumeAttachmentScenario-1967901015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-05172b56-0726-4156-ab7f-9a8d664ab683" returned: 0 in 0.319s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:00:40 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-70a5d810-05c4-43cc-a00d-9bb36344a16a tempest-TestServerVolumeAttachmentScenario-1967901015 None] <== create_volume: return (1172ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:00:40 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-70a5d810-05c4-43cc-a00d-9bb36344a16a tempest-TestServerVolumeAttachmentScenario-1967901015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.175s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:00:40 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3f7e710c-3571-4cf8-ad67-e2c573ce6c01 tempest-TestServerVolumeAttachmentScenario-1967901015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.767s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:00:40 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3f7e710c-3571-4cf8-ad67-e2c573ce6c01 tempest-TestServerVolumeAttachmentScenario-1967901015 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:00:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-804818281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfb0233e-27ef-449f-9dae-fa0d4e7304df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eba3e79c0f49465bb9172c0a101c86c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:00:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:00:39Z,use_quota=True,user_id='4846ce326d6243239612b35b064d8c79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:00:40 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-3f7e710c-3571-4cf8-ad67-e2c573ce6c01 tempest-TestServerVolumeAttachmentScenario-1967901015 None] Creating volume bfb0233e-27ef-449f-9dae-fa0d4e7304df {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:00:40 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3f7e710c-3571-4cf8-ad67-e2c573ce6c01 tempest-TestServerVolumeAttachmentScenario-1967901015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:00:40 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3f7e710c-3571-4cf8-ad67-e2c573ce6c01 tempest-TestServerVolumeAttachmentScenario-1967901015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:00:40 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3f7e710c-3571-4cf8-ad67-e2c573ce6c01 tempest-TestServerVolumeAttachmentScenario-1967901015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:00:40 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3f7e710c-3571-4cf8-ad67-e2c573ce6c01 tempest-TestServerVolumeAttachmentScenario-1967901015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:00:40 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3f7e710c-3571-4cf8-ad67-e2c573ce6c01 tempest-TestServerVolumeAttachmentScenario-1967901015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:00:40 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3f7e710c-3571-4cf8-ad67-e2c573ce6c01 tempest-TestServerVolumeAttachmentScenario-1967901015 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:00:40 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-3f7e710c-3571-4cf8-ad67-e2c573ce6c01 tempest-TestServerVolumeAttachmentScenario-1967901015 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 12:00:40 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3f7e710c-3571-4cf8-ad67-e2c573ce6c01 tempest-TestServerVolumeAttachmentScenario-1967901015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bfb0233e-27ef-449f-9dae-fa0d4e7304df 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:00:40 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-70a5d810-05c4-43cc-a00d-9bb36344a16a tempest-TestServerVolumeAttachmentScenario-1967901015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86d132e8-0b21-4768-aaa8-5a1013ce079f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05172b56-0726-4156-ab7f-9a8d664ab683', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:00:40 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-70a5d810-05c4-43cc-a00d-9bb36344a16a tempest-TestServerVolumeAttachmentScenario-1967901015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fd5b23c-5598-4b98-ad7f-f6223bc4f588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:00:40 devstack sudo[106221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bfb0233e-27ef-449f-9dae-fa0d4e7304df 1073741824 Sep 25 12:00:40 devstack sudo[106221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:00:40 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-70a5d810-05c4-43cc-a00d-9bb36344a16a tempest-TestServerVolumeAttachmentScenario-1967901015 None] Volume volume-05172b56-0726-4156-ab7f-9a8d664ab683 (05172b56-0726-4156-ab7f-9a8d664ab683): created successfully Sep 25 12:00:40 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-70a5d810-05c4-43cc-a00d-9bb36344a16a tempest-TestServerVolumeAttachmentScenario-1967901015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fd5b23c-5598-4b98-ad7f-f6223bc4f588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:00:40 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-70a5d810-05c4-43cc-a00d-9bb36344a16a tempest-TestServerVolumeAttachmentScenario-1967901015 None] Flow 'volume_create_manager' (9d5543a0-0f03-4668-9fca-72b184503ce6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:00:40 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-70a5d810-05c4-43cc-a00d-9bb36344a16a tempest-TestServerVolumeAttachmentScenario-1967901015 None] Created volume successfully. Sep 25 12:00:41 devstack sudo[106221]: pam_unix(sudo:session): session closed for user root Sep 25 12:00:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3f7e710c-3571-4cf8-ad67-e2c573ce6c01 tempest-TestServerVolumeAttachmentScenario-1967901015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bfb0233e-27ef-449f-9dae-fa0d4e7304df 1073741824" returned: 0 in 0.631s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:00:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3f7e710c-3571-4cf8-ad67-e2c573ce6c01 tempest-TestServerVolumeAttachmentScenario-1967901015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bfb0233e-27ef-449f-9dae-fa0d4e7304df {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:00:41 devstack sudo[106227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bfb0233e-27ef-449f-9dae-fa0d4e7304df Sep 25 12:00:41 devstack sudo[106227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:00:41 devstack sudo[106227]: pam_unix(sudo:session): session closed for user root Sep 25 12:00:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3f7e710c-3571-4cf8-ad67-e2c573ce6c01 tempest-TestServerVolumeAttachmentScenario-1967901015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bfb0233e-27ef-449f-9dae-fa0d4e7304df" returned: 0 in 0.309s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:00:41 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3f7e710c-3571-4cf8-ad67-e2c573ce6c01 tempest-TestServerVolumeAttachmentScenario-1967901015 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:00:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3f7e710c-3571-4cf8-ad67-e2c573ce6c01 tempest-TestServerVolumeAttachmentScenario-1967901015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:00:41 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3f7e710c-3571-4cf8-ad67-e2c573ce6c01 tempest-TestServerVolumeAttachmentScenario-1967901015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28003855-8eb1-4fa9-9618-88d5edf5903b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfb0233e-27ef-449f-9dae-fa0d4e7304df', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:00:41 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3f7e710c-3571-4cf8-ad67-e2c573ce6c01 tempest-TestServerVolumeAttachmentScenario-1967901015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (088b2d14-d4eb-48df-9204-f9bd05256639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:00:41 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-3f7e710c-3571-4cf8-ad67-e2c573ce6c01 tempest-TestServerVolumeAttachmentScenario-1967901015 None] Volume volume-bfb0233e-27ef-449f-9dae-fa0d4e7304df (bfb0233e-27ef-449f-9dae-fa0d4e7304df): created successfully Sep 25 12:00:41 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3f7e710c-3571-4cf8-ad67-e2c573ce6c01 tempest-TestServerVolumeAttachmentScenario-1967901015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (088b2d14-d4eb-48df-9204-f9bd05256639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:00:41 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3f7e710c-3571-4cf8-ad67-e2c573ce6c01 tempest-TestServerVolumeAttachmentScenario-1967901015 None] Flow 'volume_create_manager' (d3bc9bf4-a939-4b4f-bc11-018de783378f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:00:41 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-3f7e710c-3571-4cf8-ad67-e2c573ce6c01 tempest-TestServerVolumeAttachmentScenario-1967901015 None] Created volume successfully. Sep 25 12:00:51 devstack cinder-volume[86984]: DEBUG dbcounter [-] [86984] Writing DB stats cinder:SELECT=19,cinder:INSERT=8,cinder:UPDATE=30,cinder:DELETE=3 {{(pid=86984) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:00:51 devstack cinder-volume[86984]: DEBUG dbcounter [-] [86984] Writing DB stats cinder:UPDATE=5,cinder:SELECT=4,cinder:DELETE=1 {{(pid=86984) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:01:14 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-a76de5c0-7e26-4d42-8371-a08b07addbf7 req-74e8ae65-ff42-4e62-a955-2bba42b88199 tempest-TestServerVolumeAttachmentScenario-1967901015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:01:14 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-a76de5c0-7e26-4d42-8371-a08b07addbf7 req-74e8ae65-ff42-4e62-a955-2bba42b88199 tempest-TestServerVolumeAttachmentScenario-1967901015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:01:14 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-a76de5c0-7e26-4d42-8371-a08b07addbf7 req-74e8ae65-ff42-4e62-a955-2bba42b88199 tempest-TestServerVolumeAttachmentScenario-1967901015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:01:14 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [req-a76de5c0-7e26-4d42-8371-a08b07addbf7 req-74e8ae65-ff42-4e62-a955-2bba42b88199 tempest-TestServerVolumeAttachmentScenario-1967901015 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba', 'name': 'volume-05172b56-0726-4156-ab7f-9a8d664ab683', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '89218c4e-d085-407d-8ce2-fbba4bc71a39', 'enforce_multipath': True} {{(pid=86984) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 12:01:14 devstack cinder-volume[86984]: INFO cinder.volume.manager [req-a76de5c0-7e26-4d42-8371-a08b07addbf7 req-74e8ae65-ff42-4e62-a955-2bba42b88199 tempest-TestServerVolumeAttachmentScenario-1967901015 None] attachment_update completed successfully. Sep 25 12:01:19 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-5dcf6fb5-ee8e-4fc9-9771-3a209c5846cf req-eeaa293e-ea09-41b1-ba98-792eff5093db tempest-TestServerVolumeAttachmentScenario-1967901015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:01:19 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-5dcf6fb5-ee8e-4fc9-9771-3a209c5846cf req-eeaa293e-ea09-41b1-ba98-792eff5093db tempest-TestServerVolumeAttachmentScenario-1967901015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:01:19 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [req-5dcf6fb5-ee8e-4fc9-9771-3a209c5846cf req-eeaa293e-ea09-41b1-ba98-792eff5093db tempest-TestServerVolumeAttachmentScenario-1967901015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:01:19 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [req-5dcf6fb5-ee8e-4fc9-9771-3a209c5846cf req-eeaa293e-ea09-41b1-ba98-792eff5093db tempest-TestServerVolumeAttachmentScenario-1967901015 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba', 'name': 'volume-bfb0233e-27ef-449f-9dae-fa0d4e7304df', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '97a4ff45-379d-417f-a7c9-3e821ab2c683', 'enforce_multipath': True} {{(pid=86984) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 12:01:19 devstack cinder-volume[86984]: INFO cinder.volume.manager [req-5dcf6fb5-ee8e-4fc9-9771-3a209c5846cf req-eeaa293e-ea09-41b1-ba98-792eff5093db tempest-TestServerVolumeAttachmentScenario-1967901015 None] attachment_update completed successfully. Sep 25 12:01:20 devstack cinder-volume[86984]: INFO cinder.volume.manager [req-4c42fd51-ae81-4a57-bb6c-0d53d4e789f6 req-93e127dd-5be4-41ee-b3e4-d6f3af9a3cec tempest-TestServerVolumeAttachmentScenario-1967901015 None] Terminate volume connection completed successfully. Sep 25 12:01:20 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [req-4c42fd51-ae81-4a57-bb6c-0d53d4e789f6 req-93e127dd-5be4-41ee-b3e4-d6f3af9a3cec tempest-TestServerVolumeAttachmentScenario-1967901015 None] Deleting attachment 97a4ff45-379d-417f-a7c9-3e821ab2c683. {{(pid=86984) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 12:01:22 devstack cinder-volume[86984]: INFO cinder.volume.manager [req-70bd69da-1b03-454a-a7b1-98bbcdfbc845 req-359aad37-aa66-4c9d-8c6b-eb1079ad64f1 tempest-TestServerVolumeAttachmentScenario-1967901015 None] Terminate volume connection completed successfully. Sep 25 12:01:22 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [req-70bd69da-1b03-454a-a7b1-98bbcdfbc845 req-359aad37-aa66-4c9d-8c6b-eb1079ad64f1 tempest-TestServerVolumeAttachmentScenario-1967901015 None] Deleting attachment 89218c4e-d085-407d-8ce2-fbba4bc71a39. {{(pid=86984) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 12:01:27 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-78cfc92d-8786-4af6-9823-b1cf6b83fe40 tempest-TestServerVolumeAttachmentScenario-1967901015 None] Acquiring lock "cinder-bfb0233e-27ef-449f-9dae-fa0d4e7304df-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:01:27 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-78cfc92d-8786-4af6-9823-b1cf6b83fe40 tempest-TestServerVolumeAttachmentScenario-1967901015 None] Lock "cinder-bfb0233e-27ef-449f-9dae-fa0d4e7304df-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:01:27 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-78cfc92d-8786-4af6-9823-b1cf6b83fe40 tempest-TestServerVolumeAttachmentScenario-1967901015 None] Acquiring lock "cinder-quobyte-bfb0233e-27ef-449f-9dae-fa0d4e7304df" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:01:27 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-78cfc92d-8786-4af6-9823-b1cf6b83fe40 tempest-TestServerVolumeAttachmentScenario-1967901015 None] Lock "cinder-quobyte-bfb0233e-27ef-449f-9dae-fa0d4e7304df" acquired by "delete_volume" :: waited 0.017s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:01:27 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[2477093d-fbfc-4475-afb5-4a5e06897de8]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:01:27 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-78cfc92d-8786-4af6-9823-b1cf6b83fe40 tempest-TestServerVolumeAttachmentScenario-1967901015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bfb0233e-27ef-449f-9dae-fa0d4e7304df {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:01:27 devstack sudo[106900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bfb0233e-27ef-449f-9dae-fa0d4e7304df Sep 25 12:01:27 devstack sudo[106900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:01:27 devstack sudo[106900]: pam_unix(sudo:session): session closed for user root Sep 25 12:01:27 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-78cfc92d-8786-4af6-9823-b1cf6b83fe40 tempest-TestServerVolumeAttachmentScenario-1967901015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bfb0233e-27ef-449f-9dae-fa0d4e7304df" returned: 0 in 0.453s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:01:27 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-78cfc92d-8786-4af6-9823-b1cf6b83fe40 tempest-TestServerVolumeAttachmentScenario-1967901015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bfb0233e-27ef-449f-9dae-fa0d4e7304df {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:01:27 devstack sudo[106906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bfb0233e-27ef-449f-9dae-fa0d4e7304df Sep 25 12:01:27 devstack sudo[106906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:01:27 devstack sudo[106906]: pam_unix(sudo:session): session closed for user root Sep 25 12:01:27 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-78cfc92d-8786-4af6-9823-b1cf6b83fe40 tempest-TestServerVolumeAttachmentScenario-1967901015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bfb0233e-27ef-449f-9dae-fa0d4e7304df" returned: 0 in 0.304s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:01:27 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-78cfc92d-8786-4af6-9823-b1cf6b83fe40 tempest-TestServerVolumeAttachmentScenario-1967901015 None] Lock "cinder-quobyte-bfb0233e-27ef-449f-9dae-fa0d4e7304df" released by "delete_volume" :: held 0.829s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:01:28 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-78cfc92d-8786-4af6-9823-b1cf6b83fe40 tempest-TestServerVolumeAttachmentScenario-1967901015 None] Created reservations ['67b9ef05-df93-4972-902f-0f45dad5e7b3', '70962256-7c23-4f71-9ee0-84a391486004', '9d33dde2-a952-46c1-976f-04067fb418e8', '9690528c-19aa-4d84-874f-ba0f6dd9856a'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:01:28 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-78cfc92d-8786-4af6-9823-b1cf6b83fe40 tempest-TestServerVolumeAttachmentScenario-1967901015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:01:28 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-78cfc92d-8786-4af6-9823-b1cf6b83fe40 tempest-TestServerVolumeAttachmentScenario-1967901015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:01:28 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-78cfc92d-8786-4af6-9823-b1cf6b83fe40 tempest-TestServerVolumeAttachmentScenario-1967901015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:01:28 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-78cfc92d-8786-4af6-9823-b1cf6b83fe40 tempest-TestServerVolumeAttachmentScenario-1967901015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:01:28 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-78cfc92d-8786-4af6-9823-b1cf6b83fe40 tempest-TestServerVolumeAttachmentScenario-1967901015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:01:28 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-78cfc92d-8786-4af6-9823-b1cf6b83fe40 tempest-TestServerVolumeAttachmentScenario-1967901015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:01:28 devstack sudo[106909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 12:01:28 devstack sudo[106909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:01:28 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-fcf7d511-9fc3-4910-8856-80a8cfec602c tempest-TestServerVolumeAttachmentScenario-1967901015 None] Acquiring lock "cinder-05172b56-0726-4156-ab7f-9a8d664ab683-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:01:28 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-fcf7d511-9fc3-4910-8856-80a8cfec602c tempest-TestServerVolumeAttachmentScenario-1967901015 None] Lock "cinder-05172b56-0726-4156-ab7f-9a8d664ab683-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:01:28 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-fcf7d511-9fc3-4910-8856-80a8cfec602c tempest-TestServerVolumeAttachmentScenario-1967901015 None] Acquiring lock "cinder-quobyte-05172b56-0726-4156-ab7f-9a8d664ab683" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:01:28 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-fcf7d511-9fc3-4910-8856-80a8cfec602c tempest-TestServerVolumeAttachmentScenario-1967901015 None] Lock "cinder-quobyte-05172b56-0726-4156-ab7f-9a8d664ab683" acquired by "delete_volume" :: waited 0.019s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:01:28 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5ac004-b2a8-4330-8f29-8393e809b02d]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:01:28 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-fcf7d511-9fc3-4910-8856-80a8cfec602c tempest-TestServerVolumeAttachmentScenario-1967901015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-05172b56-0726-4156-ab7f-9a8d664ab683 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:01:28 devstack sudo[106909]: pam_unix(sudo:session): session closed for user root Sep 25 12:01:28 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-78cfc92d-8786-4af6-9823-b1cf6b83fe40 tempest-TestServerVolumeAttachmentScenario-1967901015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.341s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:01:28 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-78cfc92d-8786-4af6-9823-b1cf6b83fe40 tempest-TestServerVolumeAttachmentScenario-1967901015 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:01:28 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-78cfc92d-8786-4af6-9823-b1cf6b83fe40 tempest-TestServerVolumeAttachmentScenario-1967901015 None] Deleted volume successfully. Sep 25 12:01:28 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-78cfc92d-8786-4af6-9823-b1cf6b83fe40 tempest-TestServerVolumeAttachmentScenario-1967901015 None] Lock "cinder-bfb0233e-27ef-449f-9dae-fa0d4e7304df-delete_volume" released by "delete_volume" :: held 1.479s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:01:28 devstack sudo[106912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-05172b56-0726-4156-ab7f-9a8d664ab683 Sep 25 12:01:28 devstack sudo[106912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:01:28 devstack sudo[106912]: pam_unix(sudo:session): session closed for user root Sep 25 12:01:28 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-fcf7d511-9fc3-4910-8856-80a8cfec602c tempest-TestServerVolumeAttachmentScenario-1967901015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-05172b56-0726-4156-ab7f-9a8d664ab683" returned: 0 in 0.427s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:01:28 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-fcf7d511-9fc3-4910-8856-80a8cfec602c tempest-TestServerVolumeAttachmentScenario-1967901015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-05172b56-0726-4156-ab7f-9a8d664ab683 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:01:28 devstack sudo[106917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-05172b56-0726-4156-ab7f-9a8d664ab683 Sep 25 12:01:28 devstack sudo[106917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:01:29 devstack sudo[106917]: pam_unix(sudo:session): session closed for user root Sep 25 12:01:29 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-fcf7d511-9fc3-4910-8856-80a8cfec602c tempest-TestServerVolumeAttachmentScenario-1967901015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-05172b56-0726-4156-ab7f-9a8d664ab683" returned: 0 in 0.263s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:01:29 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-fcf7d511-9fc3-4910-8856-80a8cfec602c tempest-TestServerVolumeAttachmentScenario-1967901015 None] Lock "cinder-quobyte-05172b56-0726-4156-ab7f-9a8d664ab683" released by "delete_volume" :: held 0.751s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:01:29 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-fcf7d511-9fc3-4910-8856-80a8cfec602c tempest-TestServerVolumeAttachmentScenario-1967901015 None] Created reservations ['6b8ec0e0-81e6-46e4-ab19-6ebf21f18908', '5180e95a-c9c0-42a7-a376-099dccf9b5d5', '1f073ee7-4c93-4b0f-914b-3f0b56a708d0', '57f6b9a5-2505-45d2-a743-6fc347c91c1e'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:01:29 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-fcf7d511-9fc3-4910-8856-80a8cfec602c tempest-TestServerVolumeAttachmentScenario-1967901015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:01:29 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-fcf7d511-9fc3-4910-8856-80a8cfec602c tempest-TestServerVolumeAttachmentScenario-1967901015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:01:29 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-fcf7d511-9fc3-4910-8856-80a8cfec602c tempest-TestServerVolumeAttachmentScenario-1967901015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:01:29 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-fcf7d511-9fc3-4910-8856-80a8cfec602c tempest-TestServerVolumeAttachmentScenario-1967901015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:01:29 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-fcf7d511-9fc3-4910-8856-80a8cfec602c tempest-TestServerVolumeAttachmentScenario-1967901015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:01:29 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-fcf7d511-9fc3-4910-8856-80a8cfec602c tempest-TestServerVolumeAttachmentScenario-1967901015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:01:29 devstack sudo[106920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 12:01:29 devstack sudo[106920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:01:29 devstack sudo[106920]: pam_unix(sudo:session): session closed for user root Sep 25 12:01:29 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-fcf7d511-9fc3-4910-8856-80a8cfec602c tempest-TestServerVolumeAttachmentScenario-1967901015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.305s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:01:29 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-fcf7d511-9fc3-4910-8856-80a8cfec602c tempest-TestServerVolumeAttachmentScenario-1967901015 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:01:29 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-fcf7d511-9fc3-4910-8856-80a8cfec602c tempest-TestServerVolumeAttachmentScenario-1967901015 None] Deleted volume successfully. Sep 25 12:01:29 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-fcf7d511-9fc3-4910-8856-80a8cfec602c tempest-TestServerVolumeAttachmentScenario-1967901015 None] Lock "cinder-05172b56-0726-4156-ab7f-9a8d664ab683-delete_volume" released by "delete_volume" :: held 1.302s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:01:38 devstack cinder-volume[86984]: DEBUG oslo_service.periodic_task [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:01:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:01:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:01:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:01:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:01:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:01:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:01:38 devstack sudo[106933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 12:01:38 devstack sudo[106933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:01:38 devstack sudo[106933]: pam_unix(sudo:session): session closed for user root Sep 25 12:01:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.304s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:01:38 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:01:39 devstack cinder-volume[86984]: DEBUG oslo_service.periodic_task [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running periodic task VolumeManager._thread_info {{(pid=86984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:01:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] thread count: 28 {{(pid=86984) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 12:01:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] thread info: [<_MainThread(MainThread, started 132046492332160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86984) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 12:01:39 devstack cinder-volume[86984]: DEBUG dbcounter [-] [86984] Writing DB stats cinder:SELECT=27,cinder:UPDATE=19,cinder:INSERT=4 {{(pid=86984) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:01:39 devstack cinder-volume[86984]: DEBUG dbcounter [-] [86984] Writing DB stats cinder:SELECT=23,cinder:UPDATE=19,cinder:INSERT=4,cinder:DELETE=2 {{(pid=86984) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:01:41 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c7ab1ec-c19d-4619-8a27-c2d796cfee5b tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:01:41 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7c7ab1ec-c19d-4619-8a27-c2d796cfee5b tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Flow 'volume_create_manager' (c16eda40-f826-49c4-b11e-04d165ab658e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:01:41 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7c7ab1ec-c19d-4619-8a27-c2d796cfee5b tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b5cf408-6775-4360-a999-cb230dacf0d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:01:41 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7c7ab1ec-c19d-4619-8a27-c2d796cfee5b tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b5cf408-6775-4360-a999-cb230dacf0d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:01:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-688493581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=befb1b0c-43ed-41cd-8912-d9c26aaf9d29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6808e490e9f46038e91d36c27c495dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:01:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:01:42Z,use_quota=True,user_id='4c36fe96dfb6442da4dca5fcc48e2349',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:01:41 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7c7ab1ec-c19d-4619-8a27-c2d796cfee5b tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (890135fc-e3c6-4d88-9cb4-425bb0baea3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:01:41 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7c7ab1ec-c19d-4619-8a27-c2d796cfee5b tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (890135fc-e3c6-4d88-9cb4-425bb0baea3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:01:41 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7c7ab1ec-c19d-4619-8a27-c2d796cfee5b tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd04d7a2-40ed-4472-9817-682b5b1ee328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:01:41 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7c7ab1ec-c19d-4619-8a27-c2d796cfee5b tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd04d7a2-40ed-4472-9817-682b5b1ee328) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'befb1b0c-43ed-41cd-8912-d9c26aaf9d29', 'volume_name': 'volume-befb1b0c-43ed-41cd-8912-d9c26aaf9d29', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:01:41 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7c7ab1ec-c19d-4619-8a27-c2d796cfee5b tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63195ba1-b47d-47b2-aa5c-99a7b47d6a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:01:41 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7c7ab1ec-c19d-4619-8a27-c2d796cfee5b tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63195ba1-b47d-47b2-aa5c-99a7b47d6a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:01:41 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7c7ab1ec-c19d-4619-8a27-c2d796cfee5b tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f70635a1-43ce-40d6-8412-4b686dae2526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:01:41 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-7c7ab1ec-c19d-4619-8a27-c2d796cfee5b tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Volume befb1b0c-43ed-41cd-8912-d9c26aaf9d29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-befb1b0c-43ed-41cd-8912-d9c26aaf9d29', 'volume_size': 1} Sep 25 12:01:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-7c7ab1ec-c19d-4619-8a27-c2d796cfee5b tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:01:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-7c7ab1ec-c19d-4619-8a27-c2d796cfee5b tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:01:41 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-7c7ab1ec-c19d-4619-8a27-c2d796cfee5b tempest-CreateVolumesFromSourceVolumeTest-37317698 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:01:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-688493581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=befb1b0c-43ed-41cd-8912-d9c26aaf9d29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6808e490e9f46038e91d36c27c495dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:01:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:01:42Z,use_quota=True,user_id='4c36fe96dfb6442da4dca5fcc48e2349',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:01:41 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-7c7ab1ec-c19d-4619-8a27-c2d796cfee5b tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Creating volume befb1b0c-43ed-41cd-8912-d9c26aaf9d29 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:01:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-7c7ab1ec-c19d-4619-8a27-c2d796cfee5b tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:01:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-7c7ab1ec-c19d-4619-8a27-c2d796cfee5b tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:01:41 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-7c7ab1ec-c19d-4619-8a27-c2d796cfee5b tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:01:41 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-7c7ab1ec-c19d-4619-8a27-c2d796cfee5b tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:01:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-7c7ab1ec-c19d-4619-8a27-c2d796cfee5b tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:01:41 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-7c7ab1ec-c19d-4619-8a27-c2d796cfee5b tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:01:41 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-7c7ab1ec-c19d-4619-8a27-c2d796cfee5b tempest-CreateVolumesFromSourceVolumeTest-37317698 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 12:01:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7c7ab1ec-c19d-4619-8a27-c2d796cfee5b tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-befb1b0c-43ed-41cd-8912-d9c26aaf9d29 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:01:42 devstack sudo[106942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-befb1b0c-43ed-41cd-8912-d9c26aaf9d29 1073741824 Sep 25 12:01:42 devstack sudo[106942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:01:42 devstack sudo[106942]: pam_unix(sudo:session): session closed for user root Sep 25 12:01:42 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7c7ab1ec-c19d-4619-8a27-c2d796cfee5b tempest-CreateVolumesFromSourceVolumeTest-37317698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-befb1b0c-43ed-41cd-8912-d9c26aaf9d29 1073741824" returned: 0 in 0.492s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:01:42 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7c7ab1ec-c19d-4619-8a27-c2d796cfee5b tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-befb1b0c-43ed-41cd-8912-d9c26aaf9d29 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:01:42 devstack sudo[106947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-befb1b0c-43ed-41cd-8912-d9c26aaf9d29 Sep 25 12:01:42 devstack sudo[106947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:01:42 devstack sudo[106947]: pam_unix(sudo:session): session closed for user root Sep 25 12:01:42 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7c7ab1ec-c19d-4619-8a27-c2d796cfee5b tempest-CreateVolumesFromSourceVolumeTest-37317698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-befb1b0c-43ed-41cd-8912-d9c26aaf9d29" returned: 0 in 0.259s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:01:42 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-7c7ab1ec-c19d-4619-8a27-c2d796cfee5b tempest-CreateVolumesFromSourceVolumeTest-37317698 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:01:42 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-7c7ab1ec-c19d-4619-8a27-c2d796cfee5b tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:01:42 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7c7ab1ec-c19d-4619-8a27-c2d796cfee5b tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f70635a1-43ce-40d6-8412-4b686dae2526) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-befb1b0c-43ed-41cd-8912-d9c26aaf9d29', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:01:42 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7c7ab1ec-c19d-4619-8a27-c2d796cfee5b tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3810b87a-d571-4f5f-803a-02001bce2967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:01:42 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-7c7ab1ec-c19d-4619-8a27-c2d796cfee5b tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Volume volume-befb1b0c-43ed-41cd-8912-d9c26aaf9d29 (befb1b0c-43ed-41cd-8912-d9c26aaf9d29): created successfully Sep 25 12:01:42 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7c7ab1ec-c19d-4619-8a27-c2d796cfee5b tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3810b87a-d571-4f5f-803a-02001bce2967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:01:42 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7c7ab1ec-c19d-4619-8a27-c2d796cfee5b tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Flow 'volume_create_manager' (c16eda40-f826-49c4-b11e-04d165ab658e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:01:42 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-7c7ab1ec-c19d-4619-8a27-c2d796cfee5b tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Created volume successfully. Sep 25 12:01:44 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f3c7991-910e-455b-9634-5de60cbba862 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:01:44 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6f3c7991-910e-455b-9634-5de60cbba862 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Flow 'volume_create_manager' (a7b4dffe-5df6-4a96-9047-1fdff543ce4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:01:44 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6f3c7991-910e-455b-9634-5de60cbba862 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edecb41b-3dfc-4697-8d10-1c5609a39061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:01:44 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6f3c7991-910e-455b-9634-5de60cbba862 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edecb41b-3dfc-4697-8d10-1c5609a39061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:01:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1631111559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f363fd7-d6ba-4b09-bf46-aaa8a8aa9828,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6808e490e9f46038e91d36c27c495dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:01:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:01:44Z,use_quota=True,user_id='4c36fe96dfb6442da4dca5fcc48e2349',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:01:44 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6f3c7991-910e-455b-9634-5de60cbba862 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a014ce3a-254d-48cd-84c5-18fa73315d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:01:44 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6f3c7991-910e-455b-9634-5de60cbba862 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a014ce3a-254d-48cd-84c5-18fa73315d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:01:44 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6f3c7991-910e-455b-9634-5de60cbba862 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (118595b2-c62f-44c5-9966-3d53791ad1fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:01:44 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6f3c7991-910e-455b-9634-5de60cbba862 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (118595b2-c62f-44c5-9966-3d53791ad1fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f363fd7-d6ba-4b09-bf46-aaa8a8aa9828', 'volume_name': 'volume-0f363fd7-d6ba-4b09-bf46-aaa8a8aa9828', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:01:44 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6f3c7991-910e-455b-9634-5de60cbba862 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bac216b6-6165-4a0b-95a6-4c673b907822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:01:44 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6f3c7991-910e-455b-9634-5de60cbba862 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bac216b6-6165-4a0b-95a6-4c673b907822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:01:44 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6f3c7991-910e-455b-9634-5de60cbba862 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fc65ed5-d37e-4d99-b9cc-b10f2df43364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:01:44 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-6f3c7991-910e-455b-9634-5de60cbba862 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Volume 0f363fd7-d6ba-4b09-bf46-aaa8a8aa9828: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f363fd7-d6ba-4b09-bf46-aaa8a8aa9828', 'volume_size': 1} Sep 25 12:01:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-6f3c7991-910e-455b-9634-5de60cbba862 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:01:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-6f3c7991-910e-455b-9634-5de60cbba862 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:01:44 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-6f3c7991-910e-455b-9634-5de60cbba862 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:01:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1631111559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f363fd7-d6ba-4b09-bf46-aaa8a8aa9828,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6808e490e9f46038e91d36c27c495dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:01:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:01:44Z,use_quota=True,user_id='4c36fe96dfb6442da4dca5fcc48e2349',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:01:44 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-6f3c7991-910e-455b-9634-5de60cbba862 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Creating volume 0f363fd7-d6ba-4b09-bf46-aaa8a8aa9828 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:01:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-6f3c7991-910e-455b-9634-5de60cbba862 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:01:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-6f3c7991-910e-455b-9634-5de60cbba862 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:01:44 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-6f3c7991-910e-455b-9634-5de60cbba862 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:01:44 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-6f3c7991-910e-455b-9634-5de60cbba862 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:01:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-6f3c7991-910e-455b-9634-5de60cbba862 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:01:44 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-6f3c7991-910e-455b-9634-5de60cbba862 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:01:44 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-6f3c7991-910e-455b-9634-5de60cbba862 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 12:01:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6f3c7991-910e-455b-9634-5de60cbba862 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0f363fd7-d6ba-4b09-bf46-aaa8a8aa9828 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:01:44 devstack sudo[106951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0f363fd7-d6ba-4b09-bf46-aaa8a8aa9828 1073741824 Sep 25 12:01:44 devstack sudo[106951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:01:44 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-b19ad276-f218-4877-ad68-c950f40396d0 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:01:44 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b19ad276-f218-4877-ad68-c950f40396d0 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Flow 'volume_create_manager' (11d16057-f60c-42cb-8516-846a69fc430e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:01:44 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b19ad276-f218-4877-ad68-c950f40396d0 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1908dda-935d-4bba-89fd-ddee23e7e070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:01:44 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b19ad276-f218-4877-ad68-c950f40396d0 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1908dda-935d-4bba-89fd-ddee23e7e070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:01:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1684599456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17defa5d-9586-4427-80e7-af00181ef400,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6808e490e9f46038e91d36c27c495dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:01:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:01:45Z,use_quota=True,user_id='4c36fe96dfb6442da4dca5fcc48e2349',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:01:44 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b19ad276-f218-4877-ad68-c950f40396d0 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (271c1c39-9001-4162-9629-27cf3fcbd328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:01:44 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b19ad276-f218-4877-ad68-c950f40396d0 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (271c1c39-9001-4162-9629-27cf3fcbd328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:01:44 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b19ad276-f218-4877-ad68-c950f40396d0 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (889f4a69-6772-46f3-8fd3-91cd4cb22e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:01:44 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b19ad276-f218-4877-ad68-c950f40396d0 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (889f4a69-6772-46f3-8fd3-91cd4cb22e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17defa5d-9586-4427-80e7-af00181ef400', 'volume_name': 'volume-17defa5d-9586-4427-80e7-af00181ef400', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:01:44 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b19ad276-f218-4877-ad68-c950f40396d0 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33134099-d369-463a-94c8-53227394bd87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:01:44 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b19ad276-f218-4877-ad68-c950f40396d0 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33134099-d369-463a-94c8-53227394bd87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:01:44 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b19ad276-f218-4877-ad68-c950f40396d0 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa4b88e5-7276-44b6-a981-3935e3bdf1d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:01:44 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-b19ad276-f218-4877-ad68-c950f40396d0 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Volume 17defa5d-9586-4427-80e7-af00181ef400: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17defa5d-9586-4427-80e7-af00181ef400', 'volume_size': 1} Sep 25 12:01:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-b19ad276-f218-4877-ad68-c950f40396d0 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:01:45 devstack sudo[106951]: pam_unix(sudo:session): session closed for user root Sep 25 12:01:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6f3c7991-910e-455b-9634-5de60cbba862 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0f363fd7-d6ba-4b09-bf46-aaa8a8aa9828 1073741824" returned: 0 in 0.565s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:01:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6f3c7991-910e-455b-9634-5de60cbba862 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0f363fd7-d6ba-4b09-bf46-aaa8a8aa9828 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:01:45 devstack sudo[106957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0f363fd7-d6ba-4b09-bf46-aaa8a8aa9828 Sep 25 12:01:45 devstack sudo[106957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:01:45 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a557f68-2ec1-4f65-9201-73f6465914ee tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:01:45 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4a557f68-2ec1-4f65-9201-73f6465914ee tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Flow 'volume_create_manager' (29aad65d-9e8e-4249-93f4-792ffce68173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:01:45 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4a557f68-2ec1-4f65-9201-73f6465914ee tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adf336fb-8cdf-40c4-a6f6-30f30fd9c158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:01:45 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4a557f68-2ec1-4f65-9201-73f6465914ee tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adf336fb-8cdf-40c4-a6f6-30f30fd9c158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:01:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1403001449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3f90671-bcdb-4f62-b113-477dec2e028a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6808e490e9f46038e91d36c27c495dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:01:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:01:45Z,use_quota=True,user_id='4c36fe96dfb6442da4dca5fcc48e2349',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:01:45 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4a557f68-2ec1-4f65-9201-73f6465914ee tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df287a4b-f352-4a62-ad7b-0b7646e0c8e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:01:45 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4a557f68-2ec1-4f65-9201-73f6465914ee tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df287a4b-f352-4a62-ad7b-0b7646e0c8e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:01:45 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4a557f68-2ec1-4f65-9201-73f6465914ee tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11f1651e-151e-4b9b-a551-cc7d3a6e180e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:01:45 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4a557f68-2ec1-4f65-9201-73f6465914ee tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11f1651e-151e-4b9b-a551-cc7d3a6e180e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3f90671-bcdb-4f62-b113-477dec2e028a', 'volume_name': 'volume-e3f90671-bcdb-4f62-b113-477dec2e028a', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:01:45 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4a557f68-2ec1-4f65-9201-73f6465914ee tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a84c9e6-65bd-4c89-b8fe-2301daa4b0da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:01:45 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4a557f68-2ec1-4f65-9201-73f6465914ee tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a84c9e6-65bd-4c89-b8fe-2301daa4b0da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:01:45 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4a557f68-2ec1-4f65-9201-73f6465914ee tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aecb8cd7-009b-465d-a0ba-014045fba3f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:01:45 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-4a557f68-2ec1-4f65-9201-73f6465914ee tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Volume e3f90671-bcdb-4f62-b113-477dec2e028a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3f90671-bcdb-4f62-b113-477dec2e028a', 'volume_size': 1} Sep 25 12:01:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-4a557f68-2ec1-4f65-9201-73f6465914ee tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:01:45 devstack sudo[106957]: pam_unix(sudo:session): session closed for user root Sep 25 12:01:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6f3c7991-910e-455b-9634-5de60cbba862 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0f363fd7-d6ba-4b09-bf46-aaa8a8aa9828" returned: 0 in 0.340s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:01:45 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-6f3c7991-910e-455b-9634-5de60cbba862 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:01:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-6f3c7991-910e-455b-9634-5de60cbba862 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:01:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-b19ad276-f218-4877-ad68-c950f40396d0 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.523s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:01:45 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-b19ad276-f218-4877-ad68-c950f40396d0 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:01:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1684599456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17defa5d-9586-4427-80e7-af00181ef400,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6808e490e9f46038e91d36c27c495dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:01:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:01:45Z,use_quota=True,user_id='4c36fe96dfb6442da4dca5fcc48e2349',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:01:45 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-b19ad276-f218-4877-ad68-c950f40396d0 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Creating volume 17defa5d-9586-4427-80e7-af00181ef400 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:01:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-b19ad276-f218-4877-ad68-c950f40396d0 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:01:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-b19ad276-f218-4877-ad68-c950f40396d0 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:01:45 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-b19ad276-f218-4877-ad68-c950f40396d0 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:01:45 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-b19ad276-f218-4877-ad68-c950f40396d0 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:01:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-b19ad276-f218-4877-ad68-c950f40396d0 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:01:45 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-b19ad276-f218-4877-ad68-c950f40396d0 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:01:45 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-b19ad276-f218-4877-ad68-c950f40396d0 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 12:01:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-b19ad276-f218-4877-ad68-c950f40396d0 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-17defa5d-9586-4427-80e7-af00181ef400 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:01:45 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6f3c7991-910e-455b-9634-5de60cbba862 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fc65ed5-d37e-4d99-b9cc-b10f2df43364) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f363fd7-d6ba-4b09-bf46-aaa8a8aa9828', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:01:45 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6f3c7991-910e-455b-9634-5de60cbba862 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (435cf1ae-1f3d-4e45-924d-b52a4d9cd50c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:01:45 devstack sudo[106960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-17defa5d-9586-4427-80e7-af00181ef400 1073741824 Sep 25 12:01:45 devstack sudo[106960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:01:45 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-6f3c7991-910e-455b-9634-5de60cbba862 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Volume volume-0f363fd7-d6ba-4b09-bf46-aaa8a8aa9828 (0f363fd7-d6ba-4b09-bf46-aaa8a8aa9828): created successfully Sep 25 12:01:45 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6f3c7991-910e-455b-9634-5de60cbba862 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (435cf1ae-1f3d-4e45-924d-b52a4d9cd50c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:01:45 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6f3c7991-910e-455b-9634-5de60cbba862 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Flow 'volume_create_manager' (a7b4dffe-5df6-4a96-9047-1fdff543ce4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:01:45 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-6f3c7991-910e-455b-9634-5de60cbba862 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Created volume successfully. Sep 25 12:01:45 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a7c6e12-6791-4281-885e-652d1d9be535 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:01:45 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2a7c6e12-6791-4281-885e-652d1d9be535 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Flow 'volume_create_manager' (4035a35d-22a6-425e-b87b-fa8175705b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:01:45 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2a7c6e12-6791-4281-885e-652d1d9be535 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54678302-756c-4727-83a4-bd3e9fa932be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:01:45 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2a7c6e12-6791-4281-885e-652d1d9be535 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54678302-756c-4727-83a4-bd3e9fa932be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:01:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1519103712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb131ceb-3f62-4953-9d1b-b85589c7b750,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6808e490e9f46038e91d36c27c495dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:01:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:01:46Z,use_quota=True,user_id='4c36fe96dfb6442da4dca5fcc48e2349',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:01:45 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2a7c6e12-6791-4281-885e-652d1d9be535 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9be3c997-8246-494c-ad96-3e406ff2ca45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:01:45 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2a7c6e12-6791-4281-885e-652d1d9be535 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9be3c997-8246-494c-ad96-3e406ff2ca45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:01:45 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2a7c6e12-6791-4281-885e-652d1d9be535 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29272505-be3f-4595-a80b-227453d1fa21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:01:45 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2a7c6e12-6791-4281-885e-652d1d9be535 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29272505-be3f-4595-a80b-227453d1fa21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb131ceb-3f62-4953-9d1b-b85589c7b750', 'volume_name': 'volume-cb131ceb-3f62-4953-9d1b-b85589c7b750', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:01:45 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2a7c6e12-6791-4281-885e-652d1d9be535 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58d6d698-51ad-494e-a5ee-1d67e86ea1b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:01:45 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2a7c6e12-6791-4281-885e-652d1d9be535 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58d6d698-51ad-494e-a5ee-1d67e86ea1b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:01:45 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2a7c6e12-6791-4281-885e-652d1d9be535 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8960d4ff-2d42-4190-87f1-e8ff412cc78b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:01:45 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-2a7c6e12-6791-4281-885e-652d1d9be535 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Volume cb131ceb-3f62-4953-9d1b-b85589c7b750: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb131ceb-3f62-4953-9d1b-b85589c7b750', 'volume_size': 1} Sep 25 12:01:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-2a7c6e12-6791-4281-885e-652d1d9be535 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:01:46 devstack sudo[106960]: pam_unix(sudo:session): session closed for user root Sep 25 12:01:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-b19ad276-f218-4877-ad68-c950f40396d0 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-17defa5d-9586-4427-80e7-af00181ef400 1073741824" returned: 0 in 0.633s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:01:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-b19ad276-f218-4877-ad68-c950f40396d0 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-17defa5d-9586-4427-80e7-af00181ef400 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:01:46 devstack sudo[106966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-17defa5d-9586-4427-80e7-af00181ef400 Sep 25 12:01:46 devstack sudo[106966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:01:46 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-16bf9cbf-49e7-49f0-8a16-f73ce7586ad1 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:01:46 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-16bf9cbf-49e7-49f0-8a16-f73ce7586ad1 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Flow 'volume_create_manager' (cb379c84-4fba-4d8d-ba14-ccb3dc5badc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:01:46 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-16bf9cbf-49e7-49f0-8a16-f73ce7586ad1 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60e8ee0c-c173-4db0-8b1d-aa8d886dfd61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:01:46 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-16bf9cbf-49e7-49f0-8a16-f73ce7586ad1 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60e8ee0c-c173-4db0-8b1d-aa8d886dfd61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:01:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1708172179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f9b4311-56ec-442c-bfbf-e7031cb5d655,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6808e490e9f46038e91d36c27c495dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:01:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:01:46Z,use_quota=True,user_id='4c36fe96dfb6442da4dca5fcc48e2349',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:01:46 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-16bf9cbf-49e7-49f0-8a16-f73ce7586ad1 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7ccebb2-add6-49d8-a1ac-34cdc09ba51c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:01:46 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-16bf9cbf-49e7-49f0-8a16-f73ce7586ad1 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7ccebb2-add6-49d8-a1ac-34cdc09ba51c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:01:46 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-16bf9cbf-49e7-49f0-8a16-f73ce7586ad1 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1d1dfc1-4f52-4ca5-9dad-7a546c9773d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:01:46 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-16bf9cbf-49e7-49f0-8a16-f73ce7586ad1 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1d1dfc1-4f52-4ca5-9dad-7a546c9773d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f9b4311-56ec-442c-bfbf-e7031cb5d655', 'volume_name': 'volume-6f9b4311-56ec-442c-bfbf-e7031cb5d655', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:01:46 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-16bf9cbf-49e7-49f0-8a16-f73ce7586ad1 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6876006d-369b-4137-80bd-cc167b3e034b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:01:46 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-16bf9cbf-49e7-49f0-8a16-f73ce7586ad1 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6876006d-369b-4137-80bd-cc167b3e034b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:01:46 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-16bf9cbf-49e7-49f0-8a16-f73ce7586ad1 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98be813d-a822-4489-aac3-c1583e8c085b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:01:46 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-16bf9cbf-49e7-49f0-8a16-f73ce7586ad1 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Volume 6f9b4311-56ec-442c-bfbf-e7031cb5d655: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f9b4311-56ec-442c-bfbf-e7031cb5d655', 'volume_size': 1} Sep 25 12:01:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-16bf9cbf-49e7-49f0-8a16-f73ce7586ad1 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:01:46 devstack sudo[106966]: pam_unix(sudo:session): session closed for user root Sep 25 12:01:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-b19ad276-f218-4877-ad68-c950f40396d0 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-17defa5d-9586-4427-80e7-af00181ef400" returned: 0 in 0.350s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:01:46 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-b19ad276-f218-4877-ad68-c950f40396d0 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:01:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-b19ad276-f218-4877-ad68-c950f40396d0 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:01:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-4a557f68-2ec1-4f65-9201-73f6465914ee tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.115s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:01:46 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-4a557f68-2ec1-4f65-9201-73f6465914ee tempest-CreateVolumesFromSourceVolumeTest-37317698 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:01:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1403001449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3f90671-bcdb-4f62-b113-477dec2e028a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6808e490e9f46038e91d36c27c495dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:01:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:01:45Z,use_quota=True,user_id='4c36fe96dfb6442da4dca5fcc48e2349',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:01:46 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-4a557f68-2ec1-4f65-9201-73f6465914ee tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Creating volume e3f90671-bcdb-4f62-b113-477dec2e028a {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:01:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-4a557f68-2ec1-4f65-9201-73f6465914ee tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:01:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-4a557f68-2ec1-4f65-9201-73f6465914ee tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:01:46 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-4a557f68-2ec1-4f65-9201-73f6465914ee tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:01:46 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-4a557f68-2ec1-4f65-9201-73f6465914ee tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:01:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-4a557f68-2ec1-4f65-9201-73f6465914ee tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:01:46 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-4a557f68-2ec1-4f65-9201-73f6465914ee tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:01:46 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-4a557f68-2ec1-4f65-9201-73f6465914ee tempest-CreateVolumesFromSourceVolumeTest-37317698 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 12:01:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-4a557f68-2ec1-4f65-9201-73f6465914ee tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-e3f90671-bcdb-4f62-b113-477dec2e028a 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:01:46 devstack sudo[106969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-e3f90671-bcdb-4f62-b113-477dec2e028a 1073741824 Sep 25 12:01:46 devstack sudo[106969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:01:46 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b19ad276-f218-4877-ad68-c950f40396d0 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa4b88e5-7276-44b6-a981-3935e3bdf1d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17defa5d-9586-4427-80e7-af00181ef400', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:01:46 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b19ad276-f218-4877-ad68-c950f40396d0 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a22d9e8-8563-4ab6-8398-75f1bfbadefa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:01:46 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-b19ad276-f218-4877-ad68-c950f40396d0 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Volume volume-17defa5d-9586-4427-80e7-af00181ef400 (17defa5d-9586-4427-80e7-af00181ef400): created successfully Sep 25 12:01:46 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b19ad276-f218-4877-ad68-c950f40396d0 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a22d9e8-8563-4ab6-8398-75f1bfbadefa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:01:46 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b19ad276-f218-4877-ad68-c950f40396d0 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Flow 'volume_create_manager' (11d16057-f60c-42cb-8516-846a69fc430e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:01:46 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-b19ad276-f218-4877-ad68-c950f40396d0 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Created volume successfully. Sep 25 12:01:47 devstack sudo[106969]: pam_unix(sudo:session): session closed for user root Sep 25 12:01:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-4a557f68-2ec1-4f65-9201-73f6465914ee tempest-CreateVolumesFromSourceVolumeTest-37317698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-e3f90671-bcdb-4f62-b113-477dec2e028a 1073741824" returned: 0 in 0.503s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:01:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-4a557f68-2ec1-4f65-9201-73f6465914ee tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-e3f90671-bcdb-4f62-b113-477dec2e028a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:01:47 devstack sudo[106975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-e3f90671-bcdb-4f62-b113-477dec2e028a Sep 25 12:01:47 devstack sudo[106975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:01:47 devstack sudo[106975]: pam_unix(sudo:session): session closed for user root Sep 25 12:01:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-4a557f68-2ec1-4f65-9201-73f6465914ee tempest-CreateVolumesFromSourceVolumeTest-37317698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-e3f90671-bcdb-4f62-b113-477dec2e028a" returned: 0 in 0.314s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:01:47 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-4a557f68-2ec1-4f65-9201-73f6465914ee tempest-CreateVolumesFromSourceVolumeTest-37317698 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:01:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-4a557f68-2ec1-4f65-9201-73f6465914ee tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:01:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-2a7c6e12-6791-4281-885e-652d1d9be535 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.536s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:01:47 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-2a7c6e12-6791-4281-885e-652d1d9be535 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:01:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1519103712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb131ceb-3f62-4953-9d1b-b85589c7b750,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6808e490e9f46038e91d36c27c495dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:01:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:01:46Z,use_quota=True,user_id='4c36fe96dfb6442da4dca5fcc48e2349',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:01:47 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-2a7c6e12-6791-4281-885e-652d1d9be535 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Creating volume cb131ceb-3f62-4953-9d1b-b85589c7b750 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:01:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-2a7c6e12-6791-4281-885e-652d1d9be535 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:01:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-2a7c6e12-6791-4281-885e-652d1d9be535 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:01:47 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-2a7c6e12-6791-4281-885e-652d1d9be535 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:01:47 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-2a7c6e12-6791-4281-885e-652d1d9be535 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:01:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-2a7c6e12-6791-4281-885e-652d1d9be535 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:01:47 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-2a7c6e12-6791-4281-885e-652d1d9be535 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:01:47 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-2a7c6e12-6791-4281-885e-652d1d9be535 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 12:01:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2a7c6e12-6791-4281-885e-652d1d9be535 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-cb131ceb-3f62-4953-9d1b-b85589c7b750 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:01:47 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4a557f68-2ec1-4f65-9201-73f6465914ee tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aecb8cd7-009b-465d-a0ba-014045fba3f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3f90671-bcdb-4f62-b113-477dec2e028a', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:01:47 devstack sudo[106978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-cb131ceb-3f62-4953-9d1b-b85589c7b750 1073741824 Sep 25 12:01:47 devstack sudo[106978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:01:47 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4a557f68-2ec1-4f65-9201-73f6465914ee tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60741041-b7c6-4ced-9430-863181a2d953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:01:47 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-4a557f68-2ec1-4f65-9201-73f6465914ee tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Volume volume-e3f90671-bcdb-4f62-b113-477dec2e028a (e3f90671-bcdb-4f62-b113-477dec2e028a): created successfully Sep 25 12:01:47 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4a557f68-2ec1-4f65-9201-73f6465914ee tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60741041-b7c6-4ced-9430-863181a2d953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:01:47 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4a557f68-2ec1-4f65-9201-73f6465914ee tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Flow 'volume_create_manager' (29aad65d-9e8e-4249-93f4-792ffce68173) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:01:47 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-4a557f68-2ec1-4f65-9201-73f6465914ee tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Created volume successfully. Sep 25 12:01:47 devstack sudo[106978]: pam_unix(sudo:session): session closed for user root Sep 25 12:01:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2a7c6e12-6791-4281-885e-652d1d9be535 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-cb131ceb-3f62-4953-9d1b-b85589c7b750 1073741824" returned: 0 in 0.534s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:01:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2a7c6e12-6791-4281-885e-652d1d9be535 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-cb131ceb-3f62-4953-9d1b-b85589c7b750 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:01:48 devstack sudo[106983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-cb131ceb-3f62-4953-9d1b-b85589c7b750 Sep 25 12:01:48 devstack sudo[106983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:01:48 devstack sudo[106983]: pam_unix(sudo:session): session closed for user root Sep 25 12:01:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2a7c6e12-6791-4281-885e-652d1d9be535 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-cb131ceb-3f62-4953-9d1b-b85589c7b750" returned: 0 in 0.318s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:01:48 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-2a7c6e12-6791-4281-885e-652d1d9be535 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:01:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-2a7c6e12-6791-4281-885e-652d1d9be535 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:01:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-16bf9cbf-49e7-49f0-8a16-f73ce7586ad1 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.971s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:01:48 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-16bf9cbf-49e7-49f0-8a16-f73ce7586ad1 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:01:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1708172179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f9b4311-56ec-442c-bfbf-e7031cb5d655,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6808e490e9f46038e91d36c27c495dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:01:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:01:46Z,use_quota=True,user_id='4c36fe96dfb6442da4dca5fcc48e2349',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:01:48 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-16bf9cbf-49e7-49f0-8a16-f73ce7586ad1 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Creating volume 6f9b4311-56ec-442c-bfbf-e7031cb5d655 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:01:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-16bf9cbf-49e7-49f0-8a16-f73ce7586ad1 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:01:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-16bf9cbf-49e7-49f0-8a16-f73ce7586ad1 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:01:48 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-16bf9cbf-49e7-49f0-8a16-f73ce7586ad1 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:01:48 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-16bf9cbf-49e7-49f0-8a16-f73ce7586ad1 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:01:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-16bf9cbf-49e7-49f0-8a16-f73ce7586ad1 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:01:48 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-16bf9cbf-49e7-49f0-8a16-f73ce7586ad1 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:01:48 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-16bf9cbf-49e7-49f0-8a16-f73ce7586ad1 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 12:01:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-16bf9cbf-49e7-49f0-8a16-f73ce7586ad1 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6f9b4311-56ec-442c-bfbf-e7031cb5d655 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:01:48 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2a7c6e12-6791-4281-885e-652d1d9be535 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8960d4ff-2d42-4190-87f1-e8ff412cc78b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb131ceb-3f62-4953-9d1b-b85589c7b750', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:01:48 devstack sudo[106986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6f9b4311-56ec-442c-bfbf-e7031cb5d655 1073741824 Sep 25 12:01:48 devstack sudo[106986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:01:48 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2a7c6e12-6791-4281-885e-652d1d9be535 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f9621a9-29d1-44cd-99c7-b9e2fa41e7ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:01:48 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-2a7c6e12-6791-4281-885e-652d1d9be535 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Volume volume-cb131ceb-3f62-4953-9d1b-b85589c7b750 (cb131ceb-3f62-4953-9d1b-b85589c7b750): created successfully Sep 25 12:01:48 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2a7c6e12-6791-4281-885e-652d1d9be535 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f9621a9-29d1-44cd-99c7-b9e2fa41e7ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:01:48 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2a7c6e12-6791-4281-885e-652d1d9be535 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Flow 'volume_create_manager' (4035a35d-22a6-425e-b87b-fa8175705b02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:01:48 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-2a7c6e12-6791-4281-885e-652d1d9be535 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Created volume successfully. Sep 25 12:01:48 devstack sudo[106986]: pam_unix(sudo:session): session closed for user root Sep 25 12:01:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-16bf9cbf-49e7-49f0-8a16-f73ce7586ad1 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6f9b4311-56ec-442c-bfbf-e7031cb5d655 1073741824" returned: 0 in 0.541s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:01:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-16bf9cbf-49e7-49f0-8a16-f73ce7586ad1 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6f9b4311-56ec-442c-bfbf-e7031cb5d655 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:01:48 devstack sudo[106991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6f9b4311-56ec-442c-bfbf-e7031cb5d655 Sep 25 12:01:48 devstack sudo[106991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:01:49 devstack sudo[106991]: pam_unix(sudo:session): session closed for user root Sep 25 12:01:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-16bf9cbf-49e7-49f0-8a16-f73ce7586ad1 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6f9b4311-56ec-442c-bfbf-e7031cb5d655" returned: 0 in 0.290s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:01:49 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-16bf9cbf-49e7-49f0-8a16-f73ce7586ad1 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:01:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-16bf9cbf-49e7-49f0-8a16-f73ce7586ad1 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:01:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-16bf9cbf-49e7-49f0-8a16-f73ce7586ad1 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98be813d-a822-4489-aac3-c1583e8c085b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f9b4311-56ec-442c-bfbf-e7031cb5d655', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:01:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-16bf9cbf-49e7-49f0-8a16-f73ce7586ad1 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27b15841-f1bb-4b90-967f-b45846c029de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:01:49 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-16bf9cbf-49e7-49f0-8a16-f73ce7586ad1 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Volume volume-6f9b4311-56ec-442c-bfbf-e7031cb5d655 (6f9b4311-56ec-442c-bfbf-e7031cb5d655): created successfully Sep 25 12:01:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-16bf9cbf-49e7-49f0-8a16-f73ce7586ad1 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27b15841-f1bb-4b90-967f-b45846c029de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:01:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-16bf9cbf-49e7-49f0-8a16-f73ce7586ad1 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Flow 'volume_create_manager' (cb379c84-4fba-4d8d-ba14-ccb3dc5badc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:01:49 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-16bf9cbf-49e7-49f0-8a16-f73ce7586ad1 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Created volume successfully. Sep 25 12:01:49 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-1b03680d-421e-4ba1-b4e3-1bb88734abd7 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Acquiring lock "cinder-6f9b4311-56ec-442c-bfbf-e7031cb5d655-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:01:49 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-1b03680d-421e-4ba1-b4e3-1bb88734abd7 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Lock "cinder-6f9b4311-56ec-442c-bfbf-e7031cb5d655-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:01:49 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-1b03680d-421e-4ba1-b4e3-1bb88734abd7 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Acquiring lock "cinder-quobyte-6f9b4311-56ec-442c-bfbf-e7031cb5d655" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:01:49 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-1b03680d-421e-4ba1-b4e3-1bb88734abd7 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Lock "cinder-quobyte-6f9b4311-56ec-442c-bfbf-e7031cb5d655" acquired by "delete_volume" :: waited 0.022s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:01:49 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92e367b-ec74-4cfc-8ad7-6a938b8d132b]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:01:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-1b03680d-421e-4ba1-b4e3-1bb88734abd7 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6f9b4311-56ec-442c-bfbf-e7031cb5d655 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:01:50 devstack sudo[106994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6f9b4311-56ec-442c-bfbf-e7031cb5d655 Sep 25 12:01:50 devstack sudo[106994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:01:50 devstack sudo[106994]: pam_unix(sudo:session): session closed for user root Sep 25 12:01:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-1b03680d-421e-4ba1-b4e3-1bb88734abd7 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6f9b4311-56ec-442c-bfbf-e7031cb5d655" returned: 0 in 0.421s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:01:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-1b03680d-421e-4ba1-b4e3-1bb88734abd7 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6f9b4311-56ec-442c-bfbf-e7031cb5d655 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:01:50 devstack sudo[106999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6f9b4311-56ec-442c-bfbf-e7031cb5d655 Sep 25 12:01:50 devstack sudo[106999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:01:50 devstack sudo[106999]: pam_unix(sudo:session): session closed for user root Sep 25 12:01:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-1b03680d-421e-4ba1-b4e3-1bb88734abd7 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-6f9b4311-56ec-442c-bfbf-e7031cb5d655" returned: 0 in 0.281s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:01:50 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-1b03680d-421e-4ba1-b4e3-1bb88734abd7 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Lock "cinder-quobyte-6f9b4311-56ec-442c-bfbf-e7031cb5d655" released by "delete_volume" :: held 0.758s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:01:50 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-1b03680d-421e-4ba1-b4e3-1bb88734abd7 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Created reservations ['b9891fd5-94e1-44ad-8839-cfabc285dbc2', '9ea777fd-7c32-4fca-87d0-124b7e36048c', 'f9bcc688-85d7-4c28-b476-4671ad166ac1', 'ca9696a5-474a-44cb-b811-a51a70c9d494'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:01:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-1b03680d-421e-4ba1-b4e3-1bb88734abd7 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:01:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-1b03680d-421e-4ba1-b4e3-1bb88734abd7 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:01:50 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-1b03680d-421e-4ba1-b4e3-1bb88734abd7 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:01:50 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-1b03680d-421e-4ba1-b4e3-1bb88734abd7 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:01:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-1b03680d-421e-4ba1-b4e3-1bb88734abd7 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:01:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-1b03680d-421e-4ba1-b4e3-1bb88734abd7 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:01:50 devstack sudo[107002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 12:01:50 devstack sudo[107002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:01:51 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-6f4d44c2-ff61-492d-a7e4-f14302c03869 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Acquiring lock "cinder-cb131ceb-3f62-4953-9d1b-b85589c7b750-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:01:51 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-6f4d44c2-ff61-492d-a7e4-f14302c03869 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Lock "cinder-cb131ceb-3f62-4953-9d1b-b85589c7b750-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:01:51 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-6f4d44c2-ff61-492d-a7e4-f14302c03869 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Acquiring lock "cinder-quobyte-cb131ceb-3f62-4953-9d1b-b85589c7b750" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:01:51 devstack sudo[107002]: pam_unix(sudo:session): session closed for user root Sep 25 12:01:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-1b03680d-421e-4ba1-b4e3-1bb88734abd7 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.310s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:01:51 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-1b03680d-421e-4ba1-b4e3-1bb88734abd7 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:01:51 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-6f4d44c2-ff61-492d-a7e4-f14302c03869 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Lock "cinder-quobyte-cb131ceb-3f62-4953-9d1b-b85589c7b750" acquired by "delete_volume" :: waited 0.021s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:01:51 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-1b03680d-421e-4ba1-b4e3-1bb88734abd7 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Deleted volume successfully. Sep 25 12:01:51 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc58b97-e3fb-497f-8e41-61448b4e5282]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:01:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6f4d44c2-ff61-492d-a7e4-f14302c03869 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-cb131ceb-3f62-4953-9d1b-b85589c7b750 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:01:51 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-1b03680d-421e-4ba1-b4e3-1bb88734abd7 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Lock "cinder-6f9b4311-56ec-442c-bfbf-e7031cb5d655-delete_volume" released by "delete_volume" :: held 1.346s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:01:51 devstack sudo[107005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-cb131ceb-3f62-4953-9d1b-b85589c7b750 Sep 25 12:01:51 devstack sudo[107005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:01:51 devstack sudo[107005]: pam_unix(sudo:session): session closed for user root Sep 25 12:01:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6f4d44c2-ff61-492d-a7e4-f14302c03869 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-cb131ceb-3f62-4953-9d1b-b85589c7b750" returned: 0 in 0.407s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:01:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6f4d44c2-ff61-492d-a7e4-f14302c03869 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-cb131ceb-3f62-4953-9d1b-b85589c7b750 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:01:51 devstack sudo[107010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-cb131ceb-3f62-4953-9d1b-b85589c7b750 Sep 25 12:01:51 devstack sudo[107010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:01:51 devstack sudo[107010]: pam_unix(sudo:session): session closed for user root Sep 25 12:01:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6f4d44c2-ff61-492d-a7e4-f14302c03869 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-cb131ceb-3f62-4953-9d1b-b85589c7b750" returned: 0 in 0.314s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:01:51 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-6f4d44c2-ff61-492d-a7e4-f14302c03869 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Lock "cinder-quobyte-cb131ceb-3f62-4953-9d1b-b85589c7b750" released by "delete_volume" :: held 0.781s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:01:51 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-6f4d44c2-ff61-492d-a7e4-f14302c03869 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Created reservations ['a635cf0a-68f8-47fe-8859-22d14617fd81', '670b9775-7492-4469-8227-766b4415d3af', '49339175-f99d-448c-9f6d-6d666aadb8fe', '5683b1a3-456c-4f29-b24c-90add3188e57'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:01:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-6f4d44c2-ff61-492d-a7e4-f14302c03869 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:01:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-6f4d44c2-ff61-492d-a7e4-f14302c03869 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:01:52 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-6f4d44c2-ff61-492d-a7e4-f14302c03869 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:01:52 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-6f4d44c2-ff61-492d-a7e4-f14302c03869 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:01:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-6f4d44c2-ff61-492d-a7e4-f14302c03869 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:01:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6f4d44c2-ff61-492d-a7e4-f14302c03869 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:01:52 devstack sudo[107013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 12:01:52 devstack sudo[107013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:01:52 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-109161a7-80af-4c7d-af16-be5b2c9a000e tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Acquiring lock "cinder-e3f90671-bcdb-4f62-b113-477dec2e028a-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:01:52 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-109161a7-80af-4c7d-af16-be5b2c9a000e tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Lock "cinder-e3f90671-bcdb-4f62-b113-477dec2e028a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:01:52 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-109161a7-80af-4c7d-af16-be5b2c9a000e tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Acquiring lock "cinder-quobyte-e3f90671-bcdb-4f62-b113-477dec2e028a" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:01:52 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-109161a7-80af-4c7d-af16-be5b2c9a000e tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Lock "cinder-quobyte-e3f90671-bcdb-4f62-b113-477dec2e028a" acquired by "delete_volume" :: waited 0.024s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:01:52 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec1d44c-d5ac-4595-b643-b1face0acc89]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:01:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-109161a7-80af-4c7d-af16-be5b2c9a000e tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-e3f90671-bcdb-4f62-b113-477dec2e028a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:01:52 devstack sudo[107013]: pam_unix(sudo:session): session closed for user root Sep 25 12:01:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6f4d44c2-ff61-492d-a7e4-f14302c03869 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.348s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:01:52 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-6f4d44c2-ff61-492d-a7e4-f14302c03869 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:01:52 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-6f4d44c2-ff61-492d-a7e4-f14302c03869 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Deleted volume successfully. Sep 25 12:01:52 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-6f4d44c2-ff61-492d-a7e4-f14302c03869 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Lock "cinder-cb131ceb-3f62-4953-9d1b-b85589c7b750-delete_volume" released by "delete_volume" :: held 1.395s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:01:52 devstack sudo[107016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-e3f90671-bcdb-4f62-b113-477dec2e028a Sep 25 12:01:52 devstack sudo[107016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:01:52 devstack sudo[107016]: pam_unix(sudo:session): session closed for user root Sep 25 12:01:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-109161a7-80af-4c7d-af16-be5b2c9a000e tempest-CreateVolumesFromSourceVolumeTest-37317698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-e3f90671-bcdb-4f62-b113-477dec2e028a" returned: 0 in 0.521s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:01:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-109161a7-80af-4c7d-af16-be5b2c9a000e tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-e3f90671-bcdb-4f62-b113-477dec2e028a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:01:52 devstack sudo[107021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-e3f90671-bcdb-4f62-b113-477dec2e028a Sep 25 12:01:52 devstack sudo[107021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:01:53 devstack sudo[107021]: pam_unix(sudo:session): session closed for user root Sep 25 12:01:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-109161a7-80af-4c7d-af16-be5b2c9a000e tempest-CreateVolumesFromSourceVolumeTest-37317698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-e3f90671-bcdb-4f62-b113-477dec2e028a" returned: 0 in 0.351s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:01:53 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-109161a7-80af-4c7d-af16-be5b2c9a000e tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Lock "cinder-quobyte-e3f90671-bcdb-4f62-b113-477dec2e028a" released by "delete_volume" :: held 0.934s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:01:53 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-109161a7-80af-4c7d-af16-be5b2c9a000e tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Created reservations ['7d0b3721-dc51-44f6-b34d-69a5b06df2aa', '8c48f394-8cb1-40ea-8495-3b4cbae99cde', '93ff128a-a0a7-4d92-9567-b10dde49e4a0', 'd86514d8-ad2c-46f2-8464-320674b9f154'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:01:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-109161a7-80af-4c7d-af16-be5b2c9a000e tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:01:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-109161a7-80af-4c7d-af16-be5b2c9a000e tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:01:53 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-109161a7-80af-4c7d-af16-be5b2c9a000e tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:01:53 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-109161a7-80af-4c7d-af16-be5b2c9a000e tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:01:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-109161a7-80af-4c7d-af16-be5b2c9a000e tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:01:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-109161a7-80af-4c7d-af16-be5b2c9a000e tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:01:53 devstack sudo[107024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 12:01:53 devstack sudo[107024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:01:53 devstack sudo[107024]: pam_unix(sudo:session): session closed for user root Sep 25 12:01:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-109161a7-80af-4c7d-af16-be5b2c9a000e tempest-CreateVolumesFromSourceVolumeTest-37317698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.280s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:01:53 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-109161a7-80af-4c7d-af16-be5b2c9a000e tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:01:53 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-109161a7-80af-4c7d-af16-be5b2c9a000e tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Deleted volume successfully. Sep 25 12:01:53 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-109161a7-80af-4c7d-af16-be5b2c9a000e tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Lock "cinder-e3f90671-bcdb-4f62-b113-477dec2e028a-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:01:54 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-a3c39740-09ba-4d20-b516-b072380a3054 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Acquiring lock "cinder-17defa5d-9586-4427-80e7-af00181ef400-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:01:54 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-a3c39740-09ba-4d20-b516-b072380a3054 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Lock "cinder-17defa5d-9586-4427-80e7-af00181ef400-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:01:54 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-a3c39740-09ba-4d20-b516-b072380a3054 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Acquiring lock "cinder-quobyte-17defa5d-9586-4427-80e7-af00181ef400" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:01:54 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-a3c39740-09ba-4d20-b516-b072380a3054 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Lock "cinder-quobyte-17defa5d-9586-4427-80e7-af00181ef400" acquired by "delete_volume" :: waited 0.021s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:01:54 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[00957690-83e9-4655-b923-a9665079d756]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:01:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a3c39740-09ba-4d20-b516-b072380a3054 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-17defa5d-9586-4427-80e7-af00181ef400 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:01:54 devstack sudo[107028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-17defa5d-9586-4427-80e7-af00181ef400 Sep 25 12:01:54 devstack sudo[107028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:01:55 devstack sudo[107028]: pam_unix(sudo:session): session closed for user root Sep 25 12:01:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a3c39740-09ba-4d20-b516-b072380a3054 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-17defa5d-9586-4427-80e7-af00181ef400" returned: 0 in 0.431s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:01:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a3c39740-09ba-4d20-b516-b072380a3054 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-17defa5d-9586-4427-80e7-af00181ef400 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:01:55 devstack sudo[107034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-17defa5d-9586-4427-80e7-af00181ef400 Sep 25 12:01:55 devstack sudo[107034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:01:55 devstack sudo[107034]: pam_unix(sudo:session): session closed for user root Sep 25 12:01:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a3c39740-09ba-4d20-b516-b072380a3054 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-17defa5d-9586-4427-80e7-af00181ef400" returned: 0 in 0.291s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:01:55 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-a3c39740-09ba-4d20-b516-b072380a3054 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Lock "cinder-quobyte-17defa5d-9586-4427-80e7-af00181ef400" released by "delete_volume" :: held 0.771s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:01:55 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-a3c39740-09ba-4d20-b516-b072380a3054 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Created reservations ['618f9eda-ce5e-4c5b-92b9-ebd309cf3601', 'e380375b-c294-40ef-ae42-1d229c0bd5bf', '7b4e7207-4c8d-431b-9fd8-4fa3e9cb35e2', '52cda4b5-09c0-47fd-8533-bd3f20a7ab8c'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:01:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-a3c39740-09ba-4d20-b516-b072380a3054 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:01:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-a3c39740-09ba-4d20-b516-b072380a3054 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:01:55 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-a3c39740-09ba-4d20-b516-b072380a3054 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:01:55 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-a3c39740-09ba-4d20-b516-b072380a3054 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:01:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-a3c39740-09ba-4d20-b516-b072380a3054 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:01:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a3c39740-09ba-4d20-b516-b072380a3054 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:01:55 devstack sudo[107037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 12:01:55 devstack sudo[107037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:01:55 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-77f51b04-fdd4-4902-bdb9-c8d51267a1d6 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Acquiring lock "cinder-0f363fd7-d6ba-4b09-bf46-aaa8a8aa9828-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:01:55 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-77f51b04-fdd4-4902-bdb9-c8d51267a1d6 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Lock "cinder-0f363fd7-d6ba-4b09-bf46-aaa8a8aa9828-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:01:55 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-77f51b04-fdd4-4902-bdb9-c8d51267a1d6 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Acquiring lock "cinder-quobyte-0f363fd7-d6ba-4b09-bf46-aaa8a8aa9828" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:01:55 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-77f51b04-fdd4-4902-bdb9-c8d51267a1d6 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Lock "cinder-quobyte-0f363fd7-d6ba-4b09-bf46-aaa8a8aa9828" acquired by "delete_volume" :: waited 0.024s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:01:55 devstack sudo[107037]: pam_unix(sudo:session): session closed for user root Sep 25 12:01:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a3c39740-09ba-4d20-b516-b072380a3054 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.325s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:01:55 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-a3c39740-09ba-4d20-b516-b072380a3054 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:01:55 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-a3c39740-09ba-4d20-b516-b072380a3054 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Deleted volume successfully. Sep 25 12:01:55 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[1870c8e9-73ad-4d8d-84fc-5b4633886a98]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:01:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-77f51b04-fdd4-4902-bdb9-c8d51267a1d6 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0f363fd7-d6ba-4b09-bf46-aaa8a8aa9828 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:01:55 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-a3c39740-09ba-4d20-b516-b072380a3054 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Lock "cinder-17defa5d-9586-4427-80e7-af00181ef400-delete_volume" released by "delete_volume" :: held 1.374s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:01:56 devstack sudo[107040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0f363fd7-d6ba-4b09-bf46-aaa8a8aa9828 Sep 25 12:01:56 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:01:56 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root Sep 25 12:01:56 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-77f51b04-fdd4-4902-bdb9-c8d51267a1d6 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0f363fd7-d6ba-4b09-bf46-aaa8a8aa9828" returned: 0 in 0.497s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:01:56 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-77f51b04-fdd4-4902-bdb9-c8d51267a1d6 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0f363fd7-d6ba-4b09-bf46-aaa8a8aa9828 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:01:56 devstack sudo[107045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0f363fd7-d6ba-4b09-bf46-aaa8a8aa9828 Sep 25 12:01:56 devstack sudo[107045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:01:56 devstack sudo[107045]: pam_unix(sudo:session): session closed for user root Sep 25 12:01:56 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-77f51b04-fdd4-4902-bdb9-c8d51267a1d6 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0f363fd7-d6ba-4b09-bf46-aaa8a8aa9828" returned: 0 in 0.297s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:01:56 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-77f51b04-fdd4-4902-bdb9-c8d51267a1d6 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Lock "cinder-quobyte-0f363fd7-d6ba-4b09-bf46-aaa8a8aa9828" released by "delete_volume" :: held 0.859s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:01:56 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-77f51b04-fdd4-4902-bdb9-c8d51267a1d6 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Created reservations ['10a8b44c-5c18-4df7-8c1d-f5a38e7789f3', '3ced43b0-4783-4eb0-a725-81038950f6ea', '08e10f98-28b5-453c-8f35-10041cf594d3', '9f6d4070-2f00-408a-8475-270b276d288b'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:01:56 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-77f51b04-fdd4-4902-bdb9-c8d51267a1d6 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:01:56 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-77f51b04-fdd4-4902-bdb9-c8d51267a1d6 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:01:56 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-77f51b04-fdd4-4902-bdb9-c8d51267a1d6 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:01:56 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-77f51b04-fdd4-4902-bdb9-c8d51267a1d6 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:01:56 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-77f51b04-fdd4-4902-bdb9-c8d51267a1d6 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:01:56 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-77f51b04-fdd4-4902-bdb9-c8d51267a1d6 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:01:56 devstack sudo[107058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 12:01:56 devstack sudo[107058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:01:57 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-577f4bcb-be39-4cf0-b63b-0f3d39339f77 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Acquiring lock "cinder-befb1b0c-43ed-41cd-8912-d9c26aaf9d29-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:01:57 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-577f4bcb-be39-4cf0-b63b-0f3d39339f77 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Lock "cinder-befb1b0c-43ed-41cd-8912-d9c26aaf9d29-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:01:57 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-577f4bcb-be39-4cf0-b63b-0f3d39339f77 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Acquiring lock "cinder-quobyte-befb1b0c-43ed-41cd-8912-d9c26aaf9d29" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:01:57 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-577f4bcb-be39-4cf0-b63b-0f3d39339f77 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Lock "cinder-quobyte-befb1b0c-43ed-41cd-8912-d9c26aaf9d29" acquired by "delete_volume" :: waited 0.029s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:01:57 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e7e0ff-f996-4974-b392-24156b07b476]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:01:57 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-577f4bcb-be39-4cf0-b63b-0f3d39339f77 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-befb1b0c-43ed-41cd-8912-d9c26aaf9d29 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:01:57 devstack sudo[107058]: pam_unix(sudo:session): session closed for user root Sep 25 12:01:57 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-77f51b04-fdd4-4902-bdb9-c8d51267a1d6 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.366s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:01:57 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-77f51b04-fdd4-4902-bdb9-c8d51267a1d6 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:01:57 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-77f51b04-fdd4-4902-bdb9-c8d51267a1d6 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Deleted volume successfully. Sep 25 12:01:57 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-77f51b04-fdd4-4902-bdb9-c8d51267a1d6 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Lock "cinder-0f363fd7-d6ba-4b09-bf46-aaa8a8aa9828-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:01:57 devstack sudo[107085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-befb1b0c-43ed-41cd-8912-d9c26aaf9d29 Sep 25 12:01:57 devstack sudo[107085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:01:57 devstack sudo[107085]: pam_unix(sudo:session): session closed for user root Sep 25 12:01:57 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-577f4bcb-be39-4cf0-b63b-0f3d39339f77 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-befb1b0c-43ed-41cd-8912-d9c26aaf9d29" returned: 0 in 0.450s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:01:57 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-577f4bcb-be39-4cf0-b63b-0f3d39339f77 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-befb1b0c-43ed-41cd-8912-d9c26aaf9d29 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:01:57 devstack sudo[107092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-befb1b0c-43ed-41cd-8912-d9c26aaf9d29 Sep 25 12:01:57 devstack sudo[107092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:01:57 devstack sudo[107092]: pam_unix(sudo:session): session closed for user root Sep 25 12:01:57 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-577f4bcb-be39-4cf0-b63b-0f3d39339f77 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-befb1b0c-43ed-41cd-8912-d9c26aaf9d29" returned: 0 in 0.271s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:01:57 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-577f4bcb-be39-4cf0-b63b-0f3d39339f77 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Lock "cinder-quobyte-befb1b0c-43ed-41cd-8912-d9c26aaf9d29" released by "delete_volume" :: held 0.774s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:01:58 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-577f4bcb-be39-4cf0-b63b-0f3d39339f77 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Created reservations ['723959d9-6569-41d0-9438-359fdb88c725', '17c73d0e-16ee-4da9-8dcb-670145926234', '485a709a-9246-41e8-b2d4-e028114d40bb', 'bf5e9124-3514-4837-a4f6-d9fc1a740cf4'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:01:58 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-577f4bcb-be39-4cf0-b63b-0f3d39339f77 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:01:58 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-577f4bcb-be39-4cf0-b63b-0f3d39339f77 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:01:58 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-577f4bcb-be39-4cf0-b63b-0f3d39339f77 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:01:58 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-577f4bcb-be39-4cf0-b63b-0f3d39339f77 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:01:58 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-577f4bcb-be39-4cf0-b63b-0f3d39339f77 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:01:58 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-577f4bcb-be39-4cf0-b63b-0f3d39339f77 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:01:58 devstack sudo[107095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 12:01:58 devstack sudo[107095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:01:58 devstack sudo[107095]: pam_unix(sudo:session): session closed for user root Sep 25 12:01:58 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-577f4bcb-be39-4cf0-b63b-0f3d39339f77 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.359s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:01:58 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-577f4bcb-be39-4cf0-b63b-0f3d39339f77 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:01:58 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-577f4bcb-be39-4cf0-b63b-0f3d39339f77 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Deleted volume successfully. Sep 25 12:01:58 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-577f4bcb-be39-4cf0-b63b-0f3d39339f77 tempest-CreateVolumesFromSourceVolumeTest-37317698 None] Lock "cinder-befb1b0c-43ed-41cd-8912-d9c26aaf9d29-delete_volume" released by "delete_volume" :: held 1.441s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:02:02 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-49e2fb71-5a39-48c4-9fd9-a367ffdda1be tempest-ProjectReaderTests-564975871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:02:02 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-49e2fb71-5a39-48c4-9fd9-a367ffdda1be tempest-ProjectReaderTests-564975871 None] Flow 'volume_create_manager' (6c82ab10-fce0-4460-9de2-4077d6271249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:02:02 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-49e2fb71-5a39-48c4-9fd9-a367ffdda1be tempest-ProjectReaderTests-564975871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6b0d275-2403-4e02-92fe-52075780bf47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:02 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-49e2fb71-5a39-48c4-9fd9-a367ffdda1be tempest-ProjectReaderTests-564975871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6b0d275-2403-4e02-92fe-52075780bf47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:02:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1682193338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aae4c12b-4c94-438c-b218-1c0f592b28e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06f78cced79e441eb1d3e6e3290cf46d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:02:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:02:02Z,use_quota=True,user_id='63ed81ae25804afea8b595a9f27ca9e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:02 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-49e2fb71-5a39-48c4-9fd9-a367ffdda1be tempest-ProjectReaderTests-564975871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7d6426c-0095-4470-84b1-0003e913808e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:02 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-49e2fb71-5a39-48c4-9fd9-a367ffdda1be tempest-ProjectReaderTests-564975871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7d6426c-0095-4470-84b1-0003e913808e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:02 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-49e2fb71-5a39-48c4-9fd9-a367ffdda1be tempest-ProjectReaderTests-564975871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1c07883-2285-48a9-8984-480b90cad8b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:02 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-49e2fb71-5a39-48c4-9fd9-a367ffdda1be tempest-ProjectReaderTests-564975871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1c07883-2285-48a9-8984-480b90cad8b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aae4c12b-4c94-438c-b218-1c0f592b28e9', 'volume_name': 'volume-aae4c12b-4c94-438c-b218-1c0f592b28e9', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:02 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-49e2fb71-5a39-48c4-9fd9-a367ffdda1be tempest-ProjectReaderTests-564975871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb1df93f-8612-4131-9969-717c6cd1ecc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:02 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-49e2fb71-5a39-48c4-9fd9-a367ffdda1be tempest-ProjectReaderTests-564975871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb1df93f-8612-4131-9969-717c6cd1ecc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:02 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-49e2fb71-5a39-48c4-9fd9-a367ffdda1be tempest-ProjectReaderTests-564975871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b4c84ba-7fa0-49ad-9674-360afa2696e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:02 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-49e2fb71-5a39-48c4-9fd9-a367ffdda1be tempest-ProjectReaderTests-564975871 None] Volume aae4c12b-4c94-438c-b218-1c0f592b28e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aae4c12b-4c94-438c-b218-1c0f592b28e9', 'volume_size': 1} Sep 25 12:02:02 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-49e2fb71-5a39-48c4-9fd9-a367ffdda1be tempest-ProjectReaderTests-564975871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:02:02 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-49e2fb71-5a39-48c4-9fd9-a367ffdda1be tempest-ProjectReaderTests-564975871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:02:02 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-49e2fb71-5a39-48c4-9fd9-a367ffdda1be tempest-ProjectReaderTests-564975871 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:02:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1682193338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aae4c12b-4c94-438c-b218-1c0f592b28e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06f78cced79e441eb1d3e6e3290cf46d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:02:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:02:02Z,use_quota=True,user_id='63ed81ae25804afea8b595a9f27ca9e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:02:02 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-49e2fb71-5a39-48c4-9fd9-a367ffdda1be tempest-ProjectReaderTests-564975871 None] Creating volume aae4c12b-4c94-438c-b218-1c0f592b28e9 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:02:02 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-49e2fb71-5a39-48c4-9fd9-a367ffdda1be tempest-ProjectReaderTests-564975871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:02:02 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-49e2fb71-5a39-48c4-9fd9-a367ffdda1be tempest-ProjectReaderTests-564975871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:02:02 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-49e2fb71-5a39-48c4-9fd9-a367ffdda1be tempest-ProjectReaderTests-564975871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:02:02 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-49e2fb71-5a39-48c4-9fd9-a367ffdda1be tempest-ProjectReaderTests-564975871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:02:02 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-49e2fb71-5a39-48c4-9fd9-a367ffdda1be tempest-ProjectReaderTests-564975871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:02:02 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-49e2fb71-5a39-48c4-9fd9-a367ffdda1be tempest-ProjectReaderTests-564975871 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:02:02 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-49e2fb71-5a39-48c4-9fd9-a367ffdda1be tempest-ProjectReaderTests-564975871 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 12:02:02 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-49e2fb71-5a39-48c4-9fd9-a367ffdda1be tempest-ProjectReaderTests-564975871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aae4c12b-4c94-438c-b218-1c0f592b28e9 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:02 devstack sudo[107098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aae4c12b-4c94-438c-b218-1c0f592b28e9 1073741824 Sep 25 12:02:02 devstack sudo[107098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:02 devstack sudo[107098]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:02 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-49e2fb71-5a39-48c4-9fd9-a367ffdda1be tempest-ProjectReaderTests-564975871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aae4c12b-4c94-438c-b218-1c0f592b28e9 1073741824" returned: 0 in 0.480s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:02 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-49e2fb71-5a39-48c4-9fd9-a367ffdda1be tempest-ProjectReaderTests-564975871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aae4c12b-4c94-438c-b218-1c0f592b28e9 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:02 devstack sudo[107103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aae4c12b-4c94-438c-b218-1c0f592b28e9 Sep 25 12:02:02 devstack sudo[107103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:03 devstack sudo[107103]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-49e2fb71-5a39-48c4-9fd9-a367ffdda1be tempest-ProjectReaderTests-564975871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aae4c12b-4c94-438c-b218-1c0f592b28e9" returned: 0 in 0.285s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:03 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-49e2fb71-5a39-48c4-9fd9-a367ffdda1be tempest-ProjectReaderTests-564975871 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:02:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-49e2fb71-5a39-48c4-9fd9-a367ffdda1be tempest-ProjectReaderTests-564975871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:02:03 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-49e2fb71-5a39-48c4-9fd9-a367ffdda1be tempest-ProjectReaderTests-564975871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b4c84ba-7fa0-49ad-9674-360afa2696e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aae4c12b-4c94-438c-b218-1c0f592b28e9', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:03 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-49e2fb71-5a39-48c4-9fd9-a367ffdda1be tempest-ProjectReaderTests-564975871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21f1f174-e65e-450d-9f68-0bb731b32935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:03 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-49e2fb71-5a39-48c4-9fd9-a367ffdda1be tempest-ProjectReaderTests-564975871 None] Volume volume-aae4c12b-4c94-438c-b218-1c0f592b28e9 (aae4c12b-4c94-438c-b218-1c0f592b28e9): created successfully Sep 25 12:02:03 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-49e2fb71-5a39-48c4-9fd9-a367ffdda1be tempest-ProjectReaderTests-564975871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21f1f174-e65e-450d-9f68-0bb731b32935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:03 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-49e2fb71-5a39-48c4-9fd9-a367ffdda1be tempest-ProjectReaderTests-564975871 None] Flow 'volume_create_manager' (6c82ab10-fce0-4460-9de2-4077d6271249) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:02:03 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-49e2fb71-5a39-48c4-9fd9-a367ffdda1be tempest-ProjectReaderTests-564975871 None] Created volume successfully. Sep 25 12:02:04 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-04b959cd-a6e5-45ef-a240-95c9b8b44299 tempest-ProjectReaderTests-564975871 None] Acquiring lock "cinder-aae4c12b-4c94-438c-b218-1c0f592b28e9-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:02:04 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-04b959cd-a6e5-45ef-a240-95c9b8b44299 tempest-ProjectReaderTests-564975871 None] Lock "cinder-aae4c12b-4c94-438c-b218-1c0f592b28e9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:02:04 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-04b959cd-a6e5-45ef-a240-95c9b8b44299 tempest-ProjectReaderTests-564975871 None] Acquiring lock "cinder-quobyte-aae4c12b-4c94-438c-b218-1c0f592b28e9" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:02:04 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-04b959cd-a6e5-45ef-a240-95c9b8b44299 tempest-ProjectReaderTests-564975871 None] Lock "cinder-quobyte-aae4c12b-4c94-438c-b218-1c0f592b28e9" acquired by "delete_volume" :: waited 0.026s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:02:04 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[9726b77e-3ef7-4ab2-a3ed-c14cca7a0ce1]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:02:04 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-04b959cd-a6e5-45ef-a240-95c9b8b44299 tempest-ProjectReaderTests-564975871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aae4c12b-4c94-438c-b218-1c0f592b28e9 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:04 devstack sudo[107107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aae4c12b-4c94-438c-b218-1c0f592b28e9 Sep 25 12:02:04 devstack sudo[107107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:05 devstack sudo[107107]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-04b959cd-a6e5-45ef-a240-95c9b8b44299 tempest-ProjectReaderTests-564975871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aae4c12b-4c94-438c-b218-1c0f592b28e9" returned: 0 in 0.414s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-04b959cd-a6e5-45ef-a240-95c9b8b44299 tempest-ProjectReaderTests-564975871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aae4c12b-4c94-438c-b218-1c0f592b28e9 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:05 devstack sudo[107112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aae4c12b-4c94-438c-b218-1c0f592b28e9 Sep 25 12:02:05 devstack sudo[107112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:05 devstack sudo[107112]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-04b959cd-a6e5-45ef-a240-95c9b8b44299 tempest-ProjectReaderTests-564975871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aae4c12b-4c94-438c-b218-1c0f592b28e9" returned: 0 in 0.305s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:05 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-04b959cd-a6e5-45ef-a240-95c9b8b44299 tempest-ProjectReaderTests-564975871 None] Lock "cinder-quobyte-aae4c12b-4c94-438c-b218-1c0f592b28e9" released by "delete_volume" :: held 0.770s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:02:05 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-04b959cd-a6e5-45ef-a240-95c9b8b44299 tempest-ProjectReaderTests-564975871 None] Created reservations ['5c47fd4d-418b-4067-800c-5baacd8d16ae', '4dc0cb93-2439-4b52-98a9-42628a29f1e1', '9f1d33a2-8ea2-411b-8c22-053acbcce171', '6e049414-2acc-45ce-9af3-59b852f9635f'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:02:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-04b959cd-a6e5-45ef-a240-95c9b8b44299 tempest-ProjectReaderTests-564975871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:02:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-04b959cd-a6e5-45ef-a240-95c9b8b44299 tempest-ProjectReaderTests-564975871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:02:05 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-04b959cd-a6e5-45ef-a240-95c9b8b44299 tempest-ProjectReaderTests-564975871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:02:05 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-04b959cd-a6e5-45ef-a240-95c9b8b44299 tempest-ProjectReaderTests-564975871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:02:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-04b959cd-a6e5-45ef-a240-95c9b8b44299 tempest-ProjectReaderTests-564975871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:02:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-04b959cd-a6e5-45ef-a240-95c9b8b44299 tempest-ProjectReaderTests-564975871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:05 devstack sudo[107115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 12:02:05 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:05 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-04b959cd-a6e5-45ef-a240-95c9b8b44299 tempest-ProjectReaderTests-564975871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.285s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:05 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-04b959cd-a6e5-45ef-a240-95c9b8b44299 tempest-ProjectReaderTests-564975871 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:02:05 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-04b959cd-a6e5-45ef-a240-95c9b8b44299 tempest-ProjectReaderTests-564975871 None] Deleted volume successfully. Sep 25 12:02:05 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-04b959cd-a6e5-45ef-a240-95c9b8b44299 tempest-ProjectReaderTests-564975871 None] Lock "cinder-aae4c12b-4c94-438c-b218-1c0f592b28e9-delete_volume" released by "delete_volume" :: held 1.312s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:02:06 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bf09188-4845-4c0f-9583-9aa7854155aa tempest-ProjectReaderTests-564975871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:02:06 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8bf09188-4845-4c0f-9583-9aa7854155aa tempest-ProjectReaderTests-564975871 None] Flow 'volume_create_manager' (ec648844-c2e4-4bf6-bcd2-1deba8981559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:02:06 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8bf09188-4845-4c0f-9583-9aa7854155aa tempest-ProjectReaderTests-564975871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45ab1ac3-c077-410d-8f7d-a3e1ca7e1291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:06 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8bf09188-4845-4c0f-9583-9aa7854155aa tempest-ProjectReaderTests-564975871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45ab1ac3-c077-410d-8f7d-a3e1ca7e1291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:02:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1031412149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23711c1f-dba5-4089-b19a-ed6fce059dca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06f78cced79e441eb1d3e6e3290cf46d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:02:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:02:06Z,use_quota=True,user_id='63ed81ae25804afea8b595a9f27ca9e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:06 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8bf09188-4845-4c0f-9583-9aa7854155aa tempest-ProjectReaderTests-564975871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c609aff3-e4d3-4e6a-b7d0-7078cf53061e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:06 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8bf09188-4845-4c0f-9583-9aa7854155aa tempest-ProjectReaderTests-564975871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c609aff3-e4d3-4e6a-b7d0-7078cf53061e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:06 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8bf09188-4845-4c0f-9583-9aa7854155aa tempest-ProjectReaderTests-564975871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1008a8c-1cc2-49e3-b95c-81371b31ceb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:06 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8bf09188-4845-4c0f-9583-9aa7854155aa tempest-ProjectReaderTests-564975871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1008a8c-1cc2-49e3-b95c-81371b31ceb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23711c1f-dba5-4089-b19a-ed6fce059dca', 'volume_name': 'volume-23711c1f-dba5-4089-b19a-ed6fce059dca', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:06 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8bf09188-4845-4c0f-9583-9aa7854155aa tempest-ProjectReaderTests-564975871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa714c45-e65c-4d23-b830-c6d06aa62c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:06 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8bf09188-4845-4c0f-9583-9aa7854155aa tempest-ProjectReaderTests-564975871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa714c45-e65c-4d23-b830-c6d06aa62c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:06 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8bf09188-4845-4c0f-9583-9aa7854155aa tempest-ProjectReaderTests-564975871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5280aea5-5a78-4f22-8dbc-f24a2b6ded51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:06 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-8bf09188-4845-4c0f-9583-9aa7854155aa tempest-ProjectReaderTests-564975871 None] Volume 23711c1f-dba5-4089-b19a-ed6fce059dca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23711c1f-dba5-4089-b19a-ed6fce059dca', 'volume_size': 1} Sep 25 12:02:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-8bf09188-4845-4c0f-9583-9aa7854155aa tempest-ProjectReaderTests-564975871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:02:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-8bf09188-4845-4c0f-9583-9aa7854155aa tempest-ProjectReaderTests-564975871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:02:06 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-8bf09188-4845-4c0f-9583-9aa7854155aa tempest-ProjectReaderTests-564975871 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:02:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1031412149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23711c1f-dba5-4089-b19a-ed6fce059dca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06f78cced79e441eb1d3e6e3290cf46d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:02:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:02:06Z,use_quota=True,user_id='63ed81ae25804afea8b595a9f27ca9e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:02:06 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-8bf09188-4845-4c0f-9583-9aa7854155aa tempest-ProjectReaderTests-564975871 None] Creating volume 23711c1f-dba5-4089-b19a-ed6fce059dca {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:02:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-8bf09188-4845-4c0f-9583-9aa7854155aa tempest-ProjectReaderTests-564975871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:02:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-8bf09188-4845-4c0f-9583-9aa7854155aa tempest-ProjectReaderTests-564975871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:02:06 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-8bf09188-4845-4c0f-9583-9aa7854155aa tempest-ProjectReaderTests-564975871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:02:06 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-8bf09188-4845-4c0f-9583-9aa7854155aa tempest-ProjectReaderTests-564975871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:02:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-8bf09188-4845-4c0f-9583-9aa7854155aa tempest-ProjectReaderTests-564975871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:02:06 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-8bf09188-4845-4c0f-9583-9aa7854155aa tempest-ProjectReaderTests-564975871 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:02:06 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-8bf09188-4845-4c0f-9583-9aa7854155aa tempest-ProjectReaderTests-564975871 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 12:02:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8bf09188-4845-4c0f-9583-9aa7854155aa tempest-ProjectReaderTests-564975871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23711c1f-dba5-4089-b19a-ed6fce059dca 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:06 devstack sudo[107118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23711c1f-dba5-4089-b19a-ed6fce059dca 1073741824 Sep 25 12:02:06 devstack sudo[107118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:07 devstack sudo[107118]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8bf09188-4845-4c0f-9583-9aa7854155aa tempest-ProjectReaderTests-564975871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23711c1f-dba5-4089-b19a-ed6fce059dca 1073741824" returned: 0 in 0.536s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8bf09188-4845-4c0f-9583-9aa7854155aa tempest-ProjectReaderTests-564975871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23711c1f-dba5-4089-b19a-ed6fce059dca {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:07 devstack sudo[107123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23711c1f-dba5-4089-b19a-ed6fce059dca Sep 25 12:02:07 devstack sudo[107123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:07 devstack sudo[107123]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8bf09188-4845-4c0f-9583-9aa7854155aa tempest-ProjectReaderTests-564975871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23711c1f-dba5-4089-b19a-ed6fce059dca" returned: 0 in 0.348s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:07 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-8bf09188-4845-4c0f-9583-9aa7854155aa tempest-ProjectReaderTests-564975871 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:02:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-8bf09188-4845-4c0f-9583-9aa7854155aa tempest-ProjectReaderTests-564975871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:02:07 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8bf09188-4845-4c0f-9583-9aa7854155aa tempest-ProjectReaderTests-564975871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5280aea5-5a78-4f22-8dbc-f24a2b6ded51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23711c1f-dba5-4089-b19a-ed6fce059dca', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:07 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8bf09188-4845-4c0f-9583-9aa7854155aa tempest-ProjectReaderTests-564975871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d1d5a03-da7c-445f-b00f-27d4e63eed27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:07 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-8bf09188-4845-4c0f-9583-9aa7854155aa tempest-ProjectReaderTests-564975871 None] Volume volume-23711c1f-dba5-4089-b19a-ed6fce059dca (23711c1f-dba5-4089-b19a-ed6fce059dca): created successfully Sep 25 12:02:07 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8bf09188-4845-4c0f-9583-9aa7854155aa tempest-ProjectReaderTests-564975871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d1d5a03-da7c-445f-b00f-27d4e63eed27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:07 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8bf09188-4845-4c0f-9583-9aa7854155aa tempest-ProjectReaderTests-564975871 None] Flow 'volume_create_manager' (ec648844-c2e4-4bf6-bcd2-1deba8981559) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:02:07 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-8bf09188-4845-4c0f-9583-9aa7854155aa tempest-ProjectReaderTests-564975871 None] Created volume successfully. Sep 25 12:02:08 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-2c5f88c4-92dd-4e4c-a07c-8a13c09b738a tempest-ProjectReaderTests-564975871 None] Acquiring lock "cinder-23711c1f-dba5-4089-b19a-ed6fce059dca-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:02:08 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-2c5f88c4-92dd-4e4c-a07c-8a13c09b738a tempest-ProjectReaderTests-564975871 None] Lock "cinder-23711c1f-dba5-4089-b19a-ed6fce059dca-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:02:08 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-2c5f88c4-92dd-4e4c-a07c-8a13c09b738a tempest-ProjectReaderTests-564975871 None] Acquiring lock "cinder-quobyte-23711c1f-dba5-4089-b19a-ed6fce059dca" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:02:08 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-2c5f88c4-92dd-4e4c-a07c-8a13c09b738a tempest-ProjectReaderTests-564975871 None] Lock "cinder-quobyte-23711c1f-dba5-4089-b19a-ed6fce059dca" acquired by "delete_volume" :: waited 0.019s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:02:08 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[7401ea4f-ef45-4048-9ec8-c64052a69bea]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:02:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2c5f88c4-92dd-4e4c-a07c-8a13c09b738a tempest-ProjectReaderTests-564975871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23711c1f-dba5-4089-b19a-ed6fce059dca {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:08 devstack sudo[107126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23711c1f-dba5-4089-b19a-ed6fce059dca Sep 25 12:02:08 devstack sudo[107126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:09 devstack sudo[107126]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2c5f88c4-92dd-4e4c-a07c-8a13c09b738a tempest-ProjectReaderTests-564975871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23711c1f-dba5-4089-b19a-ed6fce059dca" returned: 0 in 0.477s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2c5f88c4-92dd-4e4c-a07c-8a13c09b738a tempest-ProjectReaderTests-564975871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23711c1f-dba5-4089-b19a-ed6fce059dca {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:09 devstack sudo[107131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23711c1f-dba5-4089-b19a-ed6fce059dca Sep 25 12:02:09 devstack sudo[107131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:09 devstack sudo[107131]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2c5f88c4-92dd-4e4c-a07c-8a13c09b738a tempest-ProjectReaderTests-564975871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-23711c1f-dba5-4089-b19a-ed6fce059dca" returned: 0 in 0.282s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:09 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-2c5f88c4-92dd-4e4c-a07c-8a13c09b738a tempest-ProjectReaderTests-564975871 None] Lock "cinder-quobyte-23711c1f-dba5-4089-b19a-ed6fce059dca" released by "delete_volume" :: held 0.811s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:02:09 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-2c5f88c4-92dd-4e4c-a07c-8a13c09b738a tempest-ProjectReaderTests-564975871 None] Created reservations ['5e1ccb69-65c3-4bf3-a695-77200656cc78', 'f8afbb44-f644-4db7-b4ae-832dba01fecd', '6076e8d4-50d1-4b66-9a5a-af6fc62fc8ab', '40d95d8e-e20c-4203-b7a0-3a5f16448ce0'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:02:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-2c5f88c4-92dd-4e4c-a07c-8a13c09b738a tempest-ProjectReaderTests-564975871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:02:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-2c5f88c4-92dd-4e4c-a07c-8a13c09b738a tempest-ProjectReaderTests-564975871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:02:09 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-2c5f88c4-92dd-4e4c-a07c-8a13c09b738a tempest-ProjectReaderTests-564975871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:02:09 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-2c5f88c4-92dd-4e4c-a07c-8a13c09b738a tempest-ProjectReaderTests-564975871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:02:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-2c5f88c4-92dd-4e4c-a07c-8a13c09b738a tempest-ProjectReaderTests-564975871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:02:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2c5f88c4-92dd-4e4c-a07c-8a13c09b738a tempest-ProjectReaderTests-564975871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:09 devstack sudo[107134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 12:02:09 devstack sudo[107134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:09 devstack sudo[107134]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2c5f88c4-92dd-4e4c-a07c-8a13c09b738a tempest-ProjectReaderTests-564975871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.326s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:10 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-2c5f88c4-92dd-4e4c-a07c-8a13c09b738a tempest-ProjectReaderTests-564975871 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:02:10 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-2c5f88c4-92dd-4e4c-a07c-8a13c09b738a tempest-ProjectReaderTests-564975871 None] Deleted volume successfully. Sep 25 12:02:10 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-2c5f88c4-92dd-4e4c-a07c-8a13c09b738a tempest-ProjectReaderTests-564975871 None] Lock "cinder-23711c1f-dba5-4089-b19a-ed6fce059dca-delete_volume" released by "delete_volume" :: held 1.385s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:02:10 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cce2aaa-4f9f-438e-be84-7844686609b6 tempest-ProjectReaderTests-564975871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:02:10 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-9cce2aaa-4f9f-438e-be84-7844686609b6 tempest-ProjectReaderTests-564975871 None] Flow 'volume_create_manager' (579f90be-f6ea-4009-ba02-fc0bca923c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:02:10 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-9cce2aaa-4f9f-438e-be84-7844686609b6 tempest-ProjectReaderTests-564975871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c6ef49b-ba21-42da-b943-80d05a98a88d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:10 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-9cce2aaa-4f9f-438e-be84-7844686609b6 tempest-ProjectReaderTests-564975871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c6ef49b-ba21-42da-b943-80d05a98a88d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:02:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1029261826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca39e239-aaea-4533-91ba-78f20c099dde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06f78cced79e441eb1d3e6e3290cf46d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:02:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:02:10Z,use_quota=True,user_id='63ed81ae25804afea8b595a9f27ca9e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:10 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-9cce2aaa-4f9f-438e-be84-7844686609b6 tempest-ProjectReaderTests-564975871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2def1484-b32e-4fb9-9328-5797256a5e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:10 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-9cce2aaa-4f9f-438e-be84-7844686609b6 tempest-ProjectReaderTests-564975871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2def1484-b32e-4fb9-9328-5797256a5e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:10 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-9cce2aaa-4f9f-438e-be84-7844686609b6 tempest-ProjectReaderTests-564975871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c31d65a-3dbf-4528-a7cf-cb927e0490f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:10 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-9cce2aaa-4f9f-438e-be84-7844686609b6 tempest-ProjectReaderTests-564975871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c31d65a-3dbf-4528-a7cf-cb927e0490f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca39e239-aaea-4533-91ba-78f20c099dde', 'volume_name': 'volume-ca39e239-aaea-4533-91ba-78f20c099dde', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:10 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-9cce2aaa-4f9f-438e-be84-7844686609b6 tempest-ProjectReaderTests-564975871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e3df9cf-a439-4910-8997-1c793c571e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:10 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-9cce2aaa-4f9f-438e-be84-7844686609b6 tempest-ProjectReaderTests-564975871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e3df9cf-a439-4910-8997-1c793c571e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:10 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-9cce2aaa-4f9f-438e-be84-7844686609b6 tempest-ProjectReaderTests-564975871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (286ea4e5-ee73-4d60-ae9b-64d0c26b98b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:10 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-9cce2aaa-4f9f-438e-be84-7844686609b6 tempest-ProjectReaderTests-564975871 None] Volume ca39e239-aaea-4533-91ba-78f20c099dde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca39e239-aaea-4533-91ba-78f20c099dde', 'volume_size': 1} Sep 25 12:02:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-9cce2aaa-4f9f-438e-be84-7844686609b6 tempest-ProjectReaderTests-564975871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:02:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-9cce2aaa-4f9f-438e-be84-7844686609b6 tempest-ProjectReaderTests-564975871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:02:10 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-9cce2aaa-4f9f-438e-be84-7844686609b6 tempest-ProjectReaderTests-564975871 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:02:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1029261826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca39e239-aaea-4533-91ba-78f20c099dde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06f78cced79e441eb1d3e6e3290cf46d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:02:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:02:10Z,use_quota=True,user_id='63ed81ae25804afea8b595a9f27ca9e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:02:10 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-9cce2aaa-4f9f-438e-be84-7844686609b6 tempest-ProjectReaderTests-564975871 None] Creating volume ca39e239-aaea-4533-91ba-78f20c099dde {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:02:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-9cce2aaa-4f9f-438e-be84-7844686609b6 tempest-ProjectReaderTests-564975871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:02:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-9cce2aaa-4f9f-438e-be84-7844686609b6 tempest-ProjectReaderTests-564975871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:02:10 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-9cce2aaa-4f9f-438e-be84-7844686609b6 tempest-ProjectReaderTests-564975871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:02:10 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-9cce2aaa-4f9f-438e-be84-7844686609b6 tempest-ProjectReaderTests-564975871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:02:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-9cce2aaa-4f9f-438e-be84-7844686609b6 tempest-ProjectReaderTests-564975871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:02:10 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-9cce2aaa-4f9f-438e-be84-7844686609b6 tempest-ProjectReaderTests-564975871 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:02:10 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-9cce2aaa-4f9f-438e-be84-7844686609b6 tempest-ProjectReaderTests-564975871 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 12:02:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-9cce2aaa-4f9f-438e-be84-7844686609b6 tempest-ProjectReaderTests-564975871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-ca39e239-aaea-4533-91ba-78f20c099dde 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:10 devstack sudo[107137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-ca39e239-aaea-4533-91ba-78f20c099dde 1073741824 Sep 25 12:02:10 devstack sudo[107137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:10 devstack sudo[107137]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-9cce2aaa-4f9f-438e-be84-7844686609b6 tempest-ProjectReaderTests-564975871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-ca39e239-aaea-4533-91ba-78f20c099dde 1073741824" returned: 0 in 0.493s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-9cce2aaa-4f9f-438e-be84-7844686609b6 tempest-ProjectReaderTests-564975871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-ca39e239-aaea-4533-91ba-78f20c099dde {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:11 devstack sudo[107142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-ca39e239-aaea-4533-91ba-78f20c099dde Sep 25 12:02:11 devstack sudo[107142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:11 devstack sudo[107142]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-9cce2aaa-4f9f-438e-be84-7844686609b6 tempest-ProjectReaderTests-564975871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-ca39e239-aaea-4533-91ba-78f20c099dde" returned: 0 in 0.325s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:11 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-9cce2aaa-4f9f-438e-be84-7844686609b6 tempest-ProjectReaderTests-564975871 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:02:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-9cce2aaa-4f9f-438e-be84-7844686609b6 tempest-ProjectReaderTests-564975871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:02:11 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-9cce2aaa-4f9f-438e-be84-7844686609b6 tempest-ProjectReaderTests-564975871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (286ea4e5-ee73-4d60-ae9b-64d0c26b98b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca39e239-aaea-4533-91ba-78f20c099dde', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:11 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-9cce2aaa-4f9f-438e-be84-7844686609b6 tempest-ProjectReaderTests-564975871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b358a012-d8f4-4244-a164-07ee2d763734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:11 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-9cce2aaa-4f9f-438e-be84-7844686609b6 tempest-ProjectReaderTests-564975871 None] Volume volume-ca39e239-aaea-4533-91ba-78f20c099dde (ca39e239-aaea-4533-91ba-78f20c099dde): created successfully Sep 25 12:02:11 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-9cce2aaa-4f9f-438e-be84-7844686609b6 tempest-ProjectReaderTests-564975871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b358a012-d8f4-4244-a164-07ee2d763734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:11 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-9cce2aaa-4f9f-438e-be84-7844686609b6 tempest-ProjectReaderTests-564975871 None] Flow 'volume_create_manager' (579f90be-f6ea-4009-ba02-fc0bca923c05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:02:11 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-9cce2aaa-4f9f-438e-be84-7844686609b6 tempest-ProjectReaderTests-564975871 None] Created volume successfully. Sep 25 12:02:12 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ccdd1080-a824-4103-a9e4-0f34e2e3a293 tempest-ProjectReaderTests-564975871 None] Acquiring lock "cinder-ca39e239-aaea-4533-91ba-78f20c099dde-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:02:12 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ccdd1080-a824-4103-a9e4-0f34e2e3a293 tempest-ProjectReaderTests-564975871 None] Lock "cinder-ca39e239-aaea-4533-91ba-78f20c099dde-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:02:12 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ccdd1080-a824-4103-a9e4-0f34e2e3a293 tempest-ProjectReaderTests-564975871 None] Acquiring lock "cinder-quobyte-ca39e239-aaea-4533-91ba-78f20c099dde" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:02:12 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ccdd1080-a824-4103-a9e4-0f34e2e3a293 tempest-ProjectReaderTests-564975871 None] Lock "cinder-quobyte-ca39e239-aaea-4533-91ba-78f20c099dde" acquired by "delete_volume" :: waited 0.022s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:02:12 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f74589-8fe7-481b-9aa3-7b999d8d7569]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:02:12 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ccdd1080-a824-4103-a9e4-0f34e2e3a293 tempest-ProjectReaderTests-564975871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-ca39e239-aaea-4533-91ba-78f20c099dde {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:12 devstack sudo[107145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-ca39e239-aaea-4533-91ba-78f20c099dde Sep 25 12:02:12 devstack sudo[107145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:13 devstack sudo[107145]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:13 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ccdd1080-a824-4103-a9e4-0f34e2e3a293 tempest-ProjectReaderTests-564975871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-ca39e239-aaea-4533-91ba-78f20c099dde" returned: 0 in 0.479s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:13 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ccdd1080-a824-4103-a9e4-0f34e2e3a293 tempest-ProjectReaderTests-564975871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-ca39e239-aaea-4533-91ba-78f20c099dde {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:13 devstack sudo[107150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-ca39e239-aaea-4533-91ba-78f20c099dde Sep 25 12:02:13 devstack sudo[107150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:13 devstack sudo[107150]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:13 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ccdd1080-a824-4103-a9e4-0f34e2e3a293 tempest-ProjectReaderTests-564975871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-ca39e239-aaea-4533-91ba-78f20c099dde" returned: 0 in 0.344s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:13 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ccdd1080-a824-4103-a9e4-0f34e2e3a293 tempest-ProjectReaderTests-564975871 None] Lock "cinder-quobyte-ca39e239-aaea-4533-91ba-78f20c099dde" released by "delete_volume" :: held 0.879s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:02:13 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-ccdd1080-a824-4103-a9e4-0f34e2e3a293 tempest-ProjectReaderTests-564975871 None] Created reservations ['a46d8625-3562-403a-b942-50c2eae6bd72', '81782c87-cd16-42df-8257-d445d2492d2d', '57c1cbcf-100e-4bbe-ae7f-5821f6b6b158', 'c3719b4b-b0a0-4903-9c4e-28e5cc2d70fc'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:02:13 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-ccdd1080-a824-4103-a9e4-0f34e2e3a293 tempest-ProjectReaderTests-564975871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:02:13 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-ccdd1080-a824-4103-a9e4-0f34e2e3a293 tempest-ProjectReaderTests-564975871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:02:13 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-ccdd1080-a824-4103-a9e4-0f34e2e3a293 tempest-ProjectReaderTests-564975871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:02:13 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-ccdd1080-a824-4103-a9e4-0f34e2e3a293 tempest-ProjectReaderTests-564975871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:02:13 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-ccdd1080-a824-4103-a9e4-0f34e2e3a293 tempest-ProjectReaderTests-564975871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:02:13 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ccdd1080-a824-4103-a9e4-0f34e2e3a293 tempest-ProjectReaderTests-564975871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:13 devstack sudo[107153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 12:02:13 devstack sudo[107153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:14 devstack sudo[107153]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:14 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ccdd1080-a824-4103-a9e4-0f34e2e3a293 tempest-ProjectReaderTests-564975871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.336s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:14 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-ccdd1080-a824-4103-a9e4-0f34e2e3a293 tempest-ProjectReaderTests-564975871 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:02:14 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-ccdd1080-a824-4103-a9e4-0f34e2e3a293 tempest-ProjectReaderTests-564975871 None] Deleted volume successfully. Sep 25 12:02:14 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ccdd1080-a824-4103-a9e4-0f34e2e3a293 tempest-ProjectReaderTests-564975871 None] Lock "cinder-ca39e239-aaea-4533-91ba-78f20c099dde-delete_volume" released by "delete_volume" :: held 1.512s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:02:14 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-2428f9d4-ba2d-46be-9c19-7c83bf1a6b2a tempest-ProjectReaderTests-564975871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:02:14 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2428f9d4-ba2d-46be-9c19-7c83bf1a6b2a tempest-ProjectReaderTests-564975871 None] Flow 'volume_create_manager' (c6fed151-b129-460c-a182-d565628fd2da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:02:14 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2428f9d4-ba2d-46be-9c19-7c83bf1a6b2a tempest-ProjectReaderTests-564975871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82023d98-9758-43d6-a03a-0385c8a3e71c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:14 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2428f9d4-ba2d-46be-9c19-7c83bf1a6b2a tempest-ProjectReaderTests-564975871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82023d98-9758-43d6-a03a-0385c8a3e71c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:02:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1609236538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04b5e895-d3c7-4a97-bca2-189661590483,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06f78cced79e441eb1d3e6e3290cf46d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:02:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:02:14Z,use_quota=True,user_id='63ed81ae25804afea8b595a9f27ca9e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:14 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2428f9d4-ba2d-46be-9c19-7c83bf1a6b2a tempest-ProjectReaderTests-564975871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c6847ba-8089-4a0c-80d5-decb47d96dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:14 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2428f9d4-ba2d-46be-9c19-7c83bf1a6b2a tempest-ProjectReaderTests-564975871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c6847ba-8089-4a0c-80d5-decb47d96dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:14 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2428f9d4-ba2d-46be-9c19-7c83bf1a6b2a tempest-ProjectReaderTests-564975871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2d0b569-edde-42e7-99e9-bf9159c8264e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:14 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2428f9d4-ba2d-46be-9c19-7c83bf1a6b2a tempest-ProjectReaderTests-564975871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2d0b569-edde-42e7-99e9-bf9159c8264e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04b5e895-d3c7-4a97-bca2-189661590483', 'volume_name': 'volume-04b5e895-d3c7-4a97-bca2-189661590483', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:14 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2428f9d4-ba2d-46be-9c19-7c83bf1a6b2a tempest-ProjectReaderTests-564975871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7aceca9a-d7dc-4bba-960a-13473df5f81d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:14 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2428f9d4-ba2d-46be-9c19-7c83bf1a6b2a tempest-ProjectReaderTests-564975871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7aceca9a-d7dc-4bba-960a-13473df5f81d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:14 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2428f9d4-ba2d-46be-9c19-7c83bf1a6b2a tempest-ProjectReaderTests-564975871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceadf64b-2bd8-483d-a5fa-d9ec728ca2ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:14 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-2428f9d4-ba2d-46be-9c19-7c83bf1a6b2a tempest-ProjectReaderTests-564975871 None] Volume 04b5e895-d3c7-4a97-bca2-189661590483: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04b5e895-d3c7-4a97-bca2-189661590483', 'volume_size': 1} Sep 25 12:02:14 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-2428f9d4-ba2d-46be-9c19-7c83bf1a6b2a tempest-ProjectReaderTests-564975871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:02:14 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-2428f9d4-ba2d-46be-9c19-7c83bf1a6b2a tempest-ProjectReaderTests-564975871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:02:14 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-2428f9d4-ba2d-46be-9c19-7c83bf1a6b2a tempest-ProjectReaderTests-564975871 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:02:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1609236538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04b5e895-d3c7-4a97-bca2-189661590483,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06f78cced79e441eb1d3e6e3290cf46d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:02:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:02:14Z,use_quota=True,user_id='63ed81ae25804afea8b595a9f27ca9e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:02:14 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-2428f9d4-ba2d-46be-9c19-7c83bf1a6b2a tempest-ProjectReaderTests-564975871 None] Creating volume 04b5e895-d3c7-4a97-bca2-189661590483 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:02:14 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-2428f9d4-ba2d-46be-9c19-7c83bf1a6b2a tempest-ProjectReaderTests-564975871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:02:14 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-2428f9d4-ba2d-46be-9c19-7c83bf1a6b2a tempest-ProjectReaderTests-564975871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:02:14 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-2428f9d4-ba2d-46be-9c19-7c83bf1a6b2a tempest-ProjectReaderTests-564975871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:02:14 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-2428f9d4-ba2d-46be-9c19-7c83bf1a6b2a tempest-ProjectReaderTests-564975871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:02:14 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-2428f9d4-ba2d-46be-9c19-7c83bf1a6b2a tempest-ProjectReaderTests-564975871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:02:14 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-2428f9d4-ba2d-46be-9c19-7c83bf1a6b2a tempest-ProjectReaderTests-564975871 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:02:14 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-2428f9d4-ba2d-46be-9c19-7c83bf1a6b2a tempest-ProjectReaderTests-564975871 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 12:02:14 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2428f9d4-ba2d-46be-9c19-7c83bf1a6b2a tempest-ProjectReaderTests-564975871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-04b5e895-d3c7-4a97-bca2-189661590483 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:14 devstack sudo[107157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-04b5e895-d3c7-4a97-bca2-189661590483 1073741824 Sep 25 12:02:14 devstack sudo[107157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:14 devstack sudo[107157]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:14 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2428f9d4-ba2d-46be-9c19-7c83bf1a6b2a tempest-ProjectReaderTests-564975871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-04b5e895-d3c7-4a97-bca2-189661590483 1073741824" returned: 0 in 0.483s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:15 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2428f9d4-ba2d-46be-9c19-7c83bf1a6b2a tempest-ProjectReaderTests-564975871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-04b5e895-d3c7-4a97-bca2-189661590483 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:15 devstack sudo[107163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-04b5e895-d3c7-4a97-bca2-189661590483 Sep 25 12:02:15 devstack sudo[107163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:15 devstack sudo[107163]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:15 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2428f9d4-ba2d-46be-9c19-7c83bf1a6b2a tempest-ProjectReaderTests-564975871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-04b5e895-d3c7-4a97-bca2-189661590483" returned: 0 in 0.277s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:15 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-2428f9d4-ba2d-46be-9c19-7c83bf1a6b2a tempest-ProjectReaderTests-564975871 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:02:15 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-2428f9d4-ba2d-46be-9c19-7c83bf1a6b2a tempest-ProjectReaderTests-564975871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:02:15 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2428f9d4-ba2d-46be-9c19-7c83bf1a6b2a tempest-ProjectReaderTests-564975871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceadf64b-2bd8-483d-a5fa-d9ec728ca2ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04b5e895-d3c7-4a97-bca2-189661590483', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:15 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2428f9d4-ba2d-46be-9c19-7c83bf1a6b2a tempest-ProjectReaderTests-564975871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79e0bc9f-4d03-4a27-b9f6-e8ec839639aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:15 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-2428f9d4-ba2d-46be-9c19-7c83bf1a6b2a tempest-ProjectReaderTests-564975871 None] Volume volume-04b5e895-d3c7-4a97-bca2-189661590483 (04b5e895-d3c7-4a97-bca2-189661590483): created successfully Sep 25 12:02:15 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2428f9d4-ba2d-46be-9c19-7c83bf1a6b2a tempest-ProjectReaderTests-564975871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79e0bc9f-4d03-4a27-b9f6-e8ec839639aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:15 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2428f9d4-ba2d-46be-9c19-7c83bf1a6b2a tempest-ProjectReaderTests-564975871 None] Flow 'volume_create_manager' (c6fed151-b129-460c-a182-d565628fd2da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:02:15 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-2428f9d4-ba2d-46be-9c19-7c83bf1a6b2a tempest-ProjectReaderTests-564975871 None] Created volume successfully. Sep 25 12:02:16 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-2a49964b-34f0-4580-8ee0-5ec6d2d601d8 tempest-ProjectReaderTests-564975871 None] Acquiring lock "cinder-04b5e895-d3c7-4a97-bca2-189661590483-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:02:16 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-2a49964b-34f0-4580-8ee0-5ec6d2d601d8 tempest-ProjectReaderTests-564975871 None] Lock "cinder-04b5e895-d3c7-4a97-bca2-189661590483-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:02:16 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-2a49964b-34f0-4580-8ee0-5ec6d2d601d8 tempest-ProjectReaderTests-564975871 None] Acquiring lock "cinder-quobyte-04b5e895-d3c7-4a97-bca2-189661590483" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:02:16 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-2a49964b-34f0-4580-8ee0-5ec6d2d601d8 tempest-ProjectReaderTests-564975871 None] Lock "cinder-quobyte-04b5e895-d3c7-4a97-bca2-189661590483" acquired by "delete_volume" :: waited 0.020s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:02:16 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[110ffd00-c7c8-4910-aa0e-65bc0e7076c3]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:02:16 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2a49964b-34f0-4580-8ee0-5ec6d2d601d8 tempest-ProjectReaderTests-564975871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-04b5e895-d3c7-4a97-bca2-189661590483 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:16 devstack sudo[107166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-04b5e895-d3c7-4a97-bca2-189661590483 Sep 25 12:02:16 devstack sudo[107166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:17 devstack sudo[107166]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:17 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2a49964b-34f0-4580-8ee0-5ec6d2d601d8 tempest-ProjectReaderTests-564975871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-04b5e895-d3c7-4a97-bca2-189661590483" returned: 0 in 0.430s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:17 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2a49964b-34f0-4580-8ee0-5ec6d2d601d8 tempest-ProjectReaderTests-564975871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-04b5e895-d3c7-4a97-bca2-189661590483 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:17 devstack sudo[107171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-04b5e895-d3c7-4a97-bca2-189661590483 Sep 25 12:02:17 devstack sudo[107171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:17 devstack sudo[107171]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:17 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2a49964b-34f0-4580-8ee0-5ec6d2d601d8 tempest-ProjectReaderTests-564975871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-04b5e895-d3c7-4a97-bca2-189661590483" returned: 0 in 0.272s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:17 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-2a49964b-34f0-4580-8ee0-5ec6d2d601d8 tempest-ProjectReaderTests-564975871 None] Lock "cinder-quobyte-04b5e895-d3c7-4a97-bca2-189661590483" released by "delete_volume" :: held 0.751s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:02:17 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-2a49964b-34f0-4580-8ee0-5ec6d2d601d8 tempest-ProjectReaderTests-564975871 None] Created reservations ['7835361d-8bd8-443c-99fb-35ce46b4d324', '3f47e442-ad0b-4330-afe6-3cdf9dbc1a19', '345fe63f-89ef-473b-aad4-329142940bee', '13efe73d-2ddc-45a6-bacd-39fe4e2c3f9c'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:02:17 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-2a49964b-34f0-4580-8ee0-5ec6d2d601d8 tempest-ProjectReaderTests-564975871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:02:17 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-2a49964b-34f0-4580-8ee0-5ec6d2d601d8 tempest-ProjectReaderTests-564975871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:02:17 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-2a49964b-34f0-4580-8ee0-5ec6d2d601d8 tempest-ProjectReaderTests-564975871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:02:17 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-2a49964b-34f0-4580-8ee0-5ec6d2d601d8 tempest-ProjectReaderTests-564975871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:02:17 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-2a49964b-34f0-4580-8ee0-5ec6d2d601d8 tempest-ProjectReaderTests-564975871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:02:17 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2a49964b-34f0-4580-8ee0-5ec6d2d601d8 tempest-ProjectReaderTests-564975871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:17 devstack sudo[107174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 12:02:17 devstack sudo[107174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:17 devstack sudo[107174]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:17 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2a49964b-34f0-4580-8ee0-5ec6d2d601d8 tempest-ProjectReaderTests-564975871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.274s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:17 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-2a49964b-34f0-4580-8ee0-5ec6d2d601d8 tempest-ProjectReaderTests-564975871 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:02:17 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-2a49964b-34f0-4580-8ee0-5ec6d2d601d8 tempest-ProjectReaderTests-564975871 None] Deleted volume successfully. Sep 25 12:02:17 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-2a49964b-34f0-4580-8ee0-5ec6d2d601d8 tempest-ProjectReaderTests-564975871 None] Lock "cinder-04b5e895-d3c7-4a97-bca2-189661590483-delete_volume" released by "delete_volume" :: held 1.284s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:02:27 devstack cinder-volume[86984]: DEBUG dbcounter [-] [86984] Writing DB stats cinder:UPDATE=109,cinder:SELECT=71,cinder:DELETE=8,cinder:INSERT=25 {{(pid=86984) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:02:27 devstack cinder-volume[86984]: DEBUG dbcounter [-] [86984] Writing DB stats cinder:SELECT=70,cinder:UPDATE=112,cinder:INSERT=25,cinder:DELETE=12 {{(pid=86984) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:02:30 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-2419ae02-01cf-44a8-b606-31334e9c14d1 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:02:30 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2419ae02-01cf-44a8-b606-31334e9c14d1 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Flow 'volume_create_manager' (bbfe6f93-29a2-4f41-9d6f-93f8be84af65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:02:30 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2419ae02-01cf-44a8-b606-31334e9c14d1 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2ef1e31-2f25-4eef-8073-5bd807499979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:31 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2419ae02-01cf-44a8-b606-31334e9c14d1 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2ef1e31-2f25-4eef-8073-5bd807499979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:02:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-758545229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fa04036-b6c6-4b43-b142-78126b238d00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42205d21fa6e421c8bdbb2c71ee6683c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:02:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:02:31Z,use_quota=True,user_id='401960f2e4244dd0a82a74da6a9b25fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:31 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2419ae02-01cf-44a8-b606-31334e9c14d1 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e75b626b-f028-4741-a101-9463d0aea638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:31 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2419ae02-01cf-44a8-b606-31334e9c14d1 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e75b626b-f028-4741-a101-9463d0aea638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:31 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2419ae02-01cf-44a8-b606-31334e9c14d1 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (243038f4-983a-474f-96b5-e9100a78ea05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:31 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2419ae02-01cf-44a8-b606-31334e9c14d1 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (243038f4-983a-474f-96b5-e9100a78ea05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fa04036-b6c6-4b43-b142-78126b238d00', 'volume_name': 'volume-7fa04036-b6c6-4b43-b142-78126b238d00', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:31 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2419ae02-01cf-44a8-b606-31334e9c14d1 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (935295c2-68bd-4bad-a000-40a7ae30efe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:31 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2419ae02-01cf-44a8-b606-31334e9c14d1 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (935295c2-68bd-4bad-a000-40a7ae30efe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:31 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2419ae02-01cf-44a8-b606-31334e9c14d1 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1df26341-c98e-4113-af94-ef15f6e297b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:31 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-2419ae02-01cf-44a8-b606-31334e9c14d1 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Volume 7fa04036-b6c6-4b43-b142-78126b238d00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fa04036-b6c6-4b43-b142-78126b238d00', 'volume_size': 1} Sep 25 12:02:31 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-2419ae02-01cf-44a8-b606-31334e9c14d1 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:02:31 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-2419ae02-01cf-44a8-b606-31334e9c14d1 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:02:31 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-2419ae02-01cf-44a8-b606-31334e9c14d1 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:02:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-758545229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fa04036-b6c6-4b43-b142-78126b238d00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42205d21fa6e421c8bdbb2c71ee6683c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:02:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:02:31Z,use_quota=True,user_id='401960f2e4244dd0a82a74da6a9b25fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:02:31 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-2419ae02-01cf-44a8-b606-31334e9c14d1 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Creating volume 7fa04036-b6c6-4b43-b142-78126b238d00 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:02:31 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-2419ae02-01cf-44a8-b606-31334e9c14d1 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:02:31 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-2419ae02-01cf-44a8-b606-31334e9c14d1 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:02:31 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-2419ae02-01cf-44a8-b606-31334e9c14d1 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:02:31 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-2419ae02-01cf-44a8-b606-31334e9c14d1 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:02:31 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-2419ae02-01cf-44a8-b606-31334e9c14d1 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:02:31 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-2419ae02-01cf-44a8-b606-31334e9c14d1 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:02:31 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-2419ae02-01cf-44a8-b606-31334e9c14d1 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 12:02:31 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2419ae02-01cf-44a8-b606-31334e9c14d1 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7fa04036-b6c6-4b43-b142-78126b238d00 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:31 devstack sudo[107218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7fa04036-b6c6-4b43-b142-78126b238d00 1073741824 Sep 25 12:02:31 devstack sudo[107218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:31 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8a742de-097a-4ab6-a685-088bb97274ba tempest-CreateVolumesFromSnapshotTest-8387161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:02:31 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-c8a742de-097a-4ab6-a685-088bb97274ba tempest-CreateVolumesFromSnapshotTest-8387161 None] Flow 'volume_create_manager' (484b2ab1-3786-4cd0-8e3e-c08499df9950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:02:31 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-c8a742de-097a-4ab6-a685-088bb97274ba tempest-CreateVolumesFromSnapshotTest-8387161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (090dd321-e1f8-428d-ad92-2fe05f244138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:31 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-c8a742de-097a-4ab6-a685-088bb97274ba tempest-CreateVolumesFromSnapshotTest-8387161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (090dd321-e1f8-428d-ad92-2fe05f244138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:02:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-444065836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f99efd7-a969-4426-901e-b71518535f06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e661ceae20fe43e39af28c2c73504034',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:02:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:02:32Z,use_quota=True,user_id='26579bfa5531475b99394665fc8138ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:31 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-c8a742de-097a-4ab6-a685-088bb97274ba tempest-CreateVolumesFromSnapshotTest-8387161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa9af4d8-cfef-49f2-b26a-dfa5889499a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:31 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-c8a742de-097a-4ab6-a685-088bb97274ba tempest-CreateVolumesFromSnapshotTest-8387161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa9af4d8-cfef-49f2-b26a-dfa5889499a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:31 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-c8a742de-097a-4ab6-a685-088bb97274ba tempest-CreateVolumesFromSnapshotTest-8387161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f4148eb-65b5-428e-8766-c4a6241f403e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:31 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-c8a742de-097a-4ab6-a685-088bb97274ba tempest-CreateVolumesFromSnapshotTest-8387161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f4148eb-65b5-428e-8766-c4a6241f403e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f99efd7-a969-4426-901e-b71518535f06', 'volume_name': 'volume-5f99efd7-a969-4426-901e-b71518535f06', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:31 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-c8a742de-097a-4ab6-a685-088bb97274ba tempest-CreateVolumesFromSnapshotTest-8387161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6507374b-7020-407c-9d1d-594f1227811c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:31 devstack sudo[107218]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:31 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-c8a742de-097a-4ab6-a685-088bb97274ba tempest-CreateVolumesFromSnapshotTest-8387161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6507374b-7020-407c-9d1d-594f1227811c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:31 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-c8a742de-097a-4ab6-a685-088bb97274ba tempest-CreateVolumesFromSnapshotTest-8387161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67f76609-502b-40aa-8d22-2868552a1642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:31 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-c8a742de-097a-4ab6-a685-088bb97274ba tempest-CreateVolumesFromSnapshotTest-8387161 None] Volume 5f99efd7-a969-4426-901e-b71518535f06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f99efd7-a969-4426-901e-b71518535f06', 'volume_size': 1} Sep 25 12:02:31 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-c8a742de-097a-4ab6-a685-088bb97274ba tempest-CreateVolumesFromSnapshotTest-8387161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:02:31 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2419ae02-01cf-44a8-b606-31334e9c14d1 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7fa04036-b6c6-4b43-b142-78126b238d00 1073741824" returned: 0 in 0.780s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:31 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2419ae02-01cf-44a8-b606-31334e9c14d1 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7fa04036-b6c6-4b43-b142-78126b238d00 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:31 devstack sudo[107224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7fa04036-b6c6-4b43-b142-78126b238d00 Sep 25 12:02:31 devstack sudo[107224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:32 devstack sudo[107224]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:32 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2419ae02-01cf-44a8-b606-31334e9c14d1 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7fa04036-b6c6-4b43-b142-78126b238d00" returned: 0 in 0.283s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:32 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-2419ae02-01cf-44a8-b606-31334e9c14d1 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] <== create_volume: return (1128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:02:32 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-2419ae02-01cf-44a8-b606-31334e9c14d1 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.131s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:02:32 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-c8a742de-097a-4ab6-a685-088bb97274ba tempest-CreateVolumesFromSnapshotTest-8387161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.338s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:02:32 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-c8a742de-097a-4ab6-a685-088bb97274ba tempest-CreateVolumesFromSnapshotTest-8387161 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:02:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-444065836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f99efd7-a969-4426-901e-b71518535f06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e661ceae20fe43e39af28c2c73504034',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:02:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:02:32Z,use_quota=True,user_id='26579bfa5531475b99394665fc8138ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:02:32 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-c8a742de-097a-4ab6-a685-088bb97274ba tempest-CreateVolumesFromSnapshotTest-8387161 None] Creating volume 5f99efd7-a969-4426-901e-b71518535f06 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:02:32 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-c8a742de-097a-4ab6-a685-088bb97274ba tempest-CreateVolumesFromSnapshotTest-8387161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:02:32 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-c8a742de-097a-4ab6-a685-088bb97274ba tempest-CreateVolumesFromSnapshotTest-8387161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:02:32 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-c8a742de-097a-4ab6-a685-088bb97274ba tempest-CreateVolumesFromSnapshotTest-8387161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:02:32 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-c8a742de-097a-4ab6-a685-088bb97274ba tempest-CreateVolumesFromSnapshotTest-8387161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:02:32 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-c8a742de-097a-4ab6-a685-088bb97274ba tempest-CreateVolumesFromSnapshotTest-8387161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:02:32 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-c8a742de-097a-4ab6-a685-088bb97274ba tempest-CreateVolumesFromSnapshotTest-8387161 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:02:32 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-c8a742de-097a-4ab6-a685-088bb97274ba tempest-CreateVolumesFromSnapshotTest-8387161 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 12:02:32 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-c8a742de-097a-4ab6-a685-088bb97274ba tempest-CreateVolumesFromSnapshotTest-8387161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5f99efd7-a969-4426-901e-b71518535f06 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:32 devstack sudo[107227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5f99efd7-a969-4426-901e-b71518535f06 1073741824 Sep 25 12:02:32 devstack sudo[107227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:32 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2419ae02-01cf-44a8-b606-31334e9c14d1 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1df26341-c98e-4113-af94-ef15f6e297b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fa04036-b6c6-4b43-b142-78126b238d00', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:32 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2419ae02-01cf-44a8-b606-31334e9c14d1 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3426ac22-e912-46a8-9e95-26b7e7380009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:32 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-2419ae02-01cf-44a8-b606-31334e9c14d1 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Volume volume-7fa04036-b6c6-4b43-b142-78126b238d00 (7fa04036-b6c6-4b43-b142-78126b238d00): created successfully Sep 25 12:02:32 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2419ae02-01cf-44a8-b606-31334e9c14d1 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3426ac22-e912-46a8-9e95-26b7e7380009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:32 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2419ae02-01cf-44a8-b606-31334e9c14d1 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Flow 'volume_create_manager' (bbfe6f93-29a2-4f41-9d6f-93f8be84af65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:02:32 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-2419ae02-01cf-44a8-b606-31334e9c14d1 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Created volume successfully. Sep 25 12:02:32 devstack sudo[107227]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:32 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-c8a742de-097a-4ab6-a685-088bb97274ba tempest-CreateVolumesFromSnapshotTest-8387161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5f99efd7-a969-4426-901e-b71518535f06 1073741824" returned: 0 in 0.723s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:33 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-c8a742de-097a-4ab6-a685-088bb97274ba tempest-CreateVolumesFromSnapshotTest-8387161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5f99efd7-a969-4426-901e-b71518535f06 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:33 devstack sudo[107233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5f99efd7-a969-4426-901e-b71518535f06 Sep 25 12:02:33 devstack sudo[107233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:33 devstack sudo[107233]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:33 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-c8a742de-097a-4ab6-a685-088bb97274ba tempest-CreateVolumesFromSnapshotTest-8387161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5f99efd7-a969-4426-901e-b71518535f06" returned: 0 in 0.368s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:33 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-c8a742de-097a-4ab6-a685-088bb97274ba tempest-CreateVolumesFromSnapshotTest-8387161 None] <== create_volume: return (1154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:02:33 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-c8a742de-097a-4ab6-a685-088bb97274ba tempest-CreateVolumesFromSnapshotTest-8387161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.160s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:02:33 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-c8a742de-097a-4ab6-a685-088bb97274ba tempest-CreateVolumesFromSnapshotTest-8387161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67f76609-502b-40aa-8d22-2868552a1642) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f99efd7-a969-4426-901e-b71518535f06', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:33 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-c8a742de-097a-4ab6-a685-088bb97274ba tempest-CreateVolumesFromSnapshotTest-8387161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dabe763e-ad93-4422-a2a1-1e1b8f7abcb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:33 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-c8a742de-097a-4ab6-a685-088bb97274ba tempest-CreateVolumesFromSnapshotTest-8387161 None] Volume volume-5f99efd7-a969-4426-901e-b71518535f06 (5f99efd7-a969-4426-901e-b71518535f06): created successfully Sep 25 12:02:33 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-c8a742de-097a-4ab6-a685-088bb97274ba tempest-CreateVolumesFromSnapshotTest-8387161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dabe763e-ad93-4422-a2a1-1e1b8f7abcb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:33 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-c8a742de-097a-4ab6-a685-088bb97274ba tempest-CreateVolumesFromSnapshotTest-8387161 None] Flow 'volume_create_manager' (484b2ab1-3786-4cd0-8e3e-c08499df9950) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:02:33 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-c8a742de-097a-4ab6-a685-088bb97274ba tempest-CreateVolumesFromSnapshotTest-8387161 None] Created volume successfully. Sep 25 12:02:33 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-75d3cf8a-c41e-4e35-868c-a6b0a8a0550a tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:02:33 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-75d3cf8a-c41e-4e35-868c-a6b0a8a0550a tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Flow 'volume_create_manager' (7ee21ada-33ea-4c23-a1de-c17e57a68157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:02:33 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-75d3cf8a-c41e-4e35-868c-a6b0a8a0550a tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daaa7a54-fa5d-456c-b7a6-343e862febfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:33 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-75d3cf8a-c41e-4e35-868c-a6b0a8a0550a tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daaa7a54-fa5d-456c-b7a6-343e862febfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:02:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-878651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b841a145-1edd-43c3-8719-47b72a343ed5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42205d21fa6e421c8bdbb2c71ee6683c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:02:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:02:34Z,use_quota=True,user_id='401960f2e4244dd0a82a74da6a9b25fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:33 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-75d3cf8a-c41e-4e35-868c-a6b0a8a0550a tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e2cccb7-675d-42a6-aa94-0e9671b1b6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:33 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-75d3cf8a-c41e-4e35-868c-a6b0a8a0550a tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e2cccb7-675d-42a6-aa94-0e9671b1b6ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:33 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-75d3cf8a-c41e-4e35-868c-a6b0a8a0550a tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4d8e9a5-1457-408e-a3cb-dd5da91e8637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:33 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-75d3cf8a-c41e-4e35-868c-a6b0a8a0550a tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4d8e9a5-1457-408e-a3cb-dd5da91e8637) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b841a145-1edd-43c3-8719-47b72a343ed5', 'volume_name': 'volume-b841a145-1edd-43c3-8719-47b72a343ed5', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:33 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-75d3cf8a-c41e-4e35-868c-a6b0a8a0550a tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1508dbf0-31ca-4ae1-bfff-215bd6cec781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:33 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-75d3cf8a-c41e-4e35-868c-a6b0a8a0550a tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1508dbf0-31ca-4ae1-bfff-215bd6cec781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:33 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-75d3cf8a-c41e-4e35-868c-a6b0a8a0550a tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd281570-c7b9-46ad-a95b-f7b42a85d280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:33 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-75d3cf8a-c41e-4e35-868c-a6b0a8a0550a tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Volume b841a145-1edd-43c3-8719-47b72a343ed5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b841a145-1edd-43c3-8719-47b72a343ed5', 'volume_size': 1} Sep 25 12:02:33 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-75d3cf8a-c41e-4e35-868c-a6b0a8a0550a tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:02:33 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-75d3cf8a-c41e-4e35-868c-a6b0a8a0550a tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:02:33 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-75d3cf8a-c41e-4e35-868c-a6b0a8a0550a tempest-CreateVolumesFromSourceVolumeTest-485866238 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:02:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-878651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b841a145-1edd-43c3-8719-47b72a343ed5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42205d21fa6e421c8bdbb2c71ee6683c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:02:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:02:34Z,use_quota=True,user_id='401960f2e4244dd0a82a74da6a9b25fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:02:33 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-75d3cf8a-c41e-4e35-868c-a6b0a8a0550a tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Creating volume b841a145-1edd-43c3-8719-47b72a343ed5 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:02:33 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-75d3cf8a-c41e-4e35-868c-a6b0a8a0550a tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:02:33 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-75d3cf8a-c41e-4e35-868c-a6b0a8a0550a tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:02:33 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-75d3cf8a-c41e-4e35-868c-a6b0a8a0550a tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:02:33 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-75d3cf8a-c41e-4e35-868c-a6b0a8a0550a tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:02:33 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-75d3cf8a-c41e-4e35-868c-a6b0a8a0550a tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:02:33 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-75d3cf8a-c41e-4e35-868c-a6b0a8a0550a tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:02:33 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-75d3cf8a-c41e-4e35-868c-a6b0a8a0550a tempest-CreateVolumesFromSourceVolumeTest-485866238 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 12:02:33 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-75d3cf8a-c41e-4e35-868c-a6b0a8a0550a tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b841a145-1edd-43c3-8719-47b72a343ed5 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:33 devstack sudo[107237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b841a145-1edd-43c3-8719-47b72a343ed5 1073741824 Sep 25 12:02:33 devstack sudo[107237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:34 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-fc6fa2fe-7fec-40a4-85d2-ae90aefaeb24 tempest-CreateVolumesFromSnapshotTest-8387161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:02:34 devstack sudo[107237]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:34 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-75d3cf8a-c41e-4e35-868c-a6b0a8a0550a tempest-CreateVolumesFromSourceVolumeTest-485866238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b841a145-1edd-43c3-8719-47b72a343ed5 1073741824" returned: 0 in 0.892s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:34 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-773acf4e-ca5e-45ab-ad77-0212fb6a0cf3 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:02:34 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-773acf4e-ca5e-45ab-ad77-0212fb6a0cf3 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Flow 'volume_create_manager' (8c096b0a-0953-4dd5-827c-2ab7c2f5b552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:02:34 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-773acf4e-ca5e-45ab-ad77-0212fb6a0cf3 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e64f6a70-4c18-40fc-a16f-a2fa3fbcf163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:34 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-773acf4e-ca5e-45ab-ad77-0212fb6a0cf3 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e64f6a70-4c18-40fc-a16f-a2fa3fbcf163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:02:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-927475125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a4dbb4c-b411-4193-954b-24f15e3be1b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42205d21fa6e421c8bdbb2c71ee6683c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:02:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:02:35Z,use_quota=True,user_id='401960f2e4244dd0a82a74da6a9b25fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:34 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-773acf4e-ca5e-45ab-ad77-0212fb6a0cf3 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f14dd624-7596-4b6a-bb33-be65ff4ef931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:34 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-773acf4e-ca5e-45ab-ad77-0212fb6a0cf3 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f14dd624-7596-4b6a-bb33-be65ff4ef931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:34 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-773acf4e-ca5e-45ab-ad77-0212fb6a0cf3 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d18b44f-7ed3-4e6a-8ab9-2f9e7e8eb857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:34 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-773acf4e-ca5e-45ab-ad77-0212fb6a0cf3 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d18b44f-7ed3-4e6a-8ab9-2f9e7e8eb857) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a4dbb4c-b411-4193-954b-24f15e3be1b0', 'volume_name': 'volume-9a4dbb4c-b411-4193-954b-24f15e3be1b0', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:35 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-773acf4e-ca5e-45ab-ad77-0212fb6a0cf3 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a622441f-c397-4689-bb66-dd1873edd2f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:35 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-773acf4e-ca5e-45ab-ad77-0212fb6a0cf3 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a622441f-c397-4689-bb66-dd1873edd2f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:35 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-773acf4e-ca5e-45ab-ad77-0212fb6a0cf3 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31657e9a-cb07-4f01-a043-a7950b6e3a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:35 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-773acf4e-ca5e-45ab-ad77-0212fb6a0cf3 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Volume 9a4dbb4c-b411-4193-954b-24f15e3be1b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a4dbb4c-b411-4193-954b-24f15e3be1b0', 'volume_size': 1} Sep 25 12:02:35 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-773acf4e-ca5e-45ab-ad77-0212fb6a0cf3 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:02:35 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-75d3cf8a-c41e-4e35-868c-a6b0a8a0550a tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b841a145-1edd-43c3-8719-47b72a343ed5 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:35 devstack sudo[107245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b841a145-1edd-43c3-8719-47b72a343ed5 Sep 25 12:02:35 devstack sudo[107245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:35 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1bb25f6-2c98-45d5-bdab-19793b77ee30 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:02:35 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-c1bb25f6-2c98-45d5-bdab-19793b77ee30 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Flow 'volume_create_manager' (4c290470-53f1-4e72-91db-cba7f40d0235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:02:35 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-c1bb25f6-2c98-45d5-bdab-19793b77ee30 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10bfafe9-6726-4a50-bf2e-199b5f5f6f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:35 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-c1bb25f6-2c98-45d5-bdab-19793b77ee30 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10bfafe9-6726-4a50-bf2e-199b5f5f6f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:02:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-106410101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77cfa6af-8391-439a-929d-945182ad08e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42205d21fa6e421c8bdbb2c71ee6683c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:02:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:02:35Z,use_quota=True,user_id='401960f2e4244dd0a82a74da6a9b25fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:35 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-c1bb25f6-2c98-45d5-bdab-19793b77ee30 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (889d8148-665b-484a-8079-32184634435b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:35 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-c1bb25f6-2c98-45d5-bdab-19793b77ee30 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (889d8148-665b-484a-8079-32184634435b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:35 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-c1bb25f6-2c98-45d5-bdab-19793b77ee30 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa0cdc7c-84d8-4aba-bf1d-ccaf8f9692c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:35 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-c1bb25f6-2c98-45d5-bdab-19793b77ee30 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa0cdc7c-84d8-4aba-bf1d-ccaf8f9692c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77cfa6af-8391-439a-929d-945182ad08e7', 'volume_name': 'volume-77cfa6af-8391-439a-929d-945182ad08e7', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:35 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-c1bb25f6-2c98-45d5-bdab-19793b77ee30 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c57c56cb-14c6-433b-8e78-f86d6a1b4f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:35 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-c1bb25f6-2c98-45d5-bdab-19793b77ee30 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c57c56cb-14c6-433b-8e78-f86d6a1b4f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:35 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-c1bb25f6-2c98-45d5-bdab-19793b77ee30 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (080ebf65-ba1c-4b43-89c1-7e8cd6afed8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:35 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-c1bb25f6-2c98-45d5-bdab-19793b77ee30 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Volume 77cfa6af-8391-439a-929d-945182ad08e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77cfa6af-8391-439a-929d-945182ad08e7', 'volume_size': 1} Sep 25 12:02:35 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-c1bb25f6-2c98-45d5-bdab-19793b77ee30 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:02:35 devstack sudo[107245]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:35 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-75d3cf8a-c41e-4e35-868c-a6b0a8a0550a tempest-CreateVolumesFromSourceVolumeTest-485866238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b841a145-1edd-43c3-8719-47b72a343ed5" returned: 0 in 0.577s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:35 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-75d3cf8a-c41e-4e35-868c-a6b0a8a0550a tempest-CreateVolumesFromSourceVolumeTest-485866238 None] <== create_volume: return (1731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:02:35 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-75d3cf8a-c41e-4e35-868c-a6b0a8a0550a tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.735s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:02:35 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-fc6fa2fe-7fec-40a4-85d2-ae90aefaeb24 tempest-CreateVolumesFromSnapshotTest-8387161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.905s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:02:35 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-fc6fa2fe-7fec-40a4-85d2-ae90aefaeb24 tempest-CreateVolumesFromSnapshotTest-8387161 None] Creating offline snapshot dceac794-eaf5-4d83-9638-39599ab17286 of volume 5f99efd7-a969-4426-901e-b71518535f06 {{(pid=86984) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 12:02:35 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-75d3cf8a-c41e-4e35-868c-a6b0a8a0550a tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd281570-c7b9-46ad-a95b-f7b42a85d280) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b841a145-1edd-43c3-8719-47b72a343ed5', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:35 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-75d3cf8a-c41e-4e35-868c-a6b0a8a0550a tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77494795-1a08-4cc5-a675-e0471972e607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:35 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f7c088-76cd-4438-961c-f3e26bf8b8f2]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:02:35 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-fc6fa2fe-7fec-40a4-85d2-ae90aefaeb24 tempest-CreateVolumesFromSnapshotTest-8387161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5f99efd7-a969-4426-901e-b71518535f06 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:35 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dd236f2-5796-41fd-a605-df3249d7cb3e tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:02:35 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3dd236f2-5796-41fd-a605-df3249d7cb3e tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Flow 'volume_create_manager' (995e846a-6864-4e1d-b991-d4c7ad2a82a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:02:35 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3dd236f2-5796-41fd-a605-df3249d7cb3e tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40c42792-447b-4b35-a7f3-bfb855394a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:35 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-75d3cf8a-c41e-4e35-868c-a6b0a8a0550a tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Volume volume-b841a145-1edd-43c3-8719-47b72a343ed5 (b841a145-1edd-43c3-8719-47b72a343ed5): created successfully Sep 25 12:02:35 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-75d3cf8a-c41e-4e35-868c-a6b0a8a0550a tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77494795-1a08-4cc5-a675-e0471972e607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:35 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-75d3cf8a-c41e-4e35-868c-a6b0a8a0550a tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Flow 'volume_create_manager' (7ee21ada-33ea-4c23-a1de-c17e57a68157) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:02:35 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3dd236f2-5796-41fd-a605-df3249d7cb3e tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40c42792-447b-4b35-a7f3-bfb855394a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:02:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1385531195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90341631-6278-4d3d-a268-d1424c5aa478,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42205d21fa6e421c8bdbb2c71ee6683c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:02:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:02:36Z,use_quota=True,user_id='401960f2e4244dd0a82a74da6a9b25fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:35 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3dd236f2-5796-41fd-a605-df3249d7cb3e tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d9415dc-8fdc-4acb-bdc5-cfaf8b5c4d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:35 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3dd236f2-5796-41fd-a605-df3249d7cb3e tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d9415dc-8fdc-4acb-bdc5-cfaf8b5c4d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:35 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3dd236f2-5796-41fd-a605-df3249d7cb3e tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70653c33-9e0a-416f-8c73-65f27fe24e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:35 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3dd236f2-5796-41fd-a605-df3249d7cb3e tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70653c33-9e0a-416f-8c73-65f27fe24e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90341631-6278-4d3d-a268-d1424c5aa478', 'volume_name': 'volume-90341631-6278-4d3d-a268-d1424c5aa478', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:35 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3dd236f2-5796-41fd-a605-df3249d7cb3e tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f83a7dfc-e069-4002-a320-677cc5ce92d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:35 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3dd236f2-5796-41fd-a605-df3249d7cb3e tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f83a7dfc-e069-4002-a320-677cc5ce92d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:35 devstack sudo[107249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5f99efd7-a969-4426-901e-b71518535f06 Sep 25 12:02:35 devstack sudo[107249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:35 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3dd236f2-5796-41fd-a605-df3249d7cb3e tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d8a87f9-8ff2-4484-a524-b40090a4bc66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:35 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-3dd236f2-5796-41fd-a605-df3249d7cb3e tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Volume 90341631-6278-4d3d-a268-d1424c5aa478: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90341631-6278-4d3d-a268-d1424c5aa478', 'volume_size': 1} Sep 25 12:02:35 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3dd236f2-5796-41fd-a605-df3249d7cb3e tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:02:35 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-75d3cf8a-c41e-4e35-868c-a6b0a8a0550a tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Created volume successfully. Sep 25 12:02:36 devstack sudo[107249]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:36 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-fc6fa2fe-7fec-40a4-85d2-ae90aefaeb24 tempest-CreateVolumesFromSnapshotTest-8387161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5f99efd7-a969-4426-901e-b71518535f06" returned: 0 in 0.664s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:36 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-fc6fa2fe-7fec-40a4-85d2-ae90aefaeb24 tempest-CreateVolumesFromSnapshotTest-8387161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5f99efd7-a969-4426-901e-b71518535f06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5f99efd7-a969-4426-901e-b71518535f06.dceac794-eaf5-4d83-9638-39599ab17286 1G {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:36 devstack sudo[107254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5f99efd7-a969-4426-901e-b71518535f06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5f99efd7-a969-4426-901e-b71518535f06.dceac794-eaf5-4d83-9638-39599ab17286 1G Sep 25 12:02:36 devstack sudo[107254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:36 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6b50948-8612-4751-ad4c-b6ba312d4072 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:02:36 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-c6b50948-8612-4751-ad4c-b6ba312d4072 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Flow 'volume_create_manager' (dfe0d0bb-ca54-43af-a8ec-27d7c4825be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:02:36 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-c6b50948-8612-4751-ad4c-b6ba312d4072 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3474c182-6a21-49f1-8571-857bf016e2f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:36 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-c6b50948-8612-4751-ad4c-b6ba312d4072 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3474c182-6a21-49f1-8571-857bf016e2f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:02:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-65958929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7520728e-21e5-4d22-9fbf-2821f65f5e49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42205d21fa6e421c8bdbb2c71ee6683c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:02:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:02:36Z,use_quota=True,user_id='401960f2e4244dd0a82a74da6a9b25fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:36 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-c6b50948-8612-4751-ad4c-b6ba312d4072 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34bf00ba-1a0a-4bd5-a163-95d3b0e16070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:36 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-c6b50948-8612-4751-ad4c-b6ba312d4072 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34bf00ba-1a0a-4bd5-a163-95d3b0e16070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:36 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-c6b50948-8612-4751-ad4c-b6ba312d4072 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d31e48e-353c-4ea9-9b1d-421ab5390b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:36 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-c6b50948-8612-4751-ad4c-b6ba312d4072 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d31e48e-353c-4ea9-9b1d-421ab5390b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7520728e-21e5-4d22-9fbf-2821f65f5e49', 'volume_name': 'volume-7520728e-21e5-4d22-9fbf-2821f65f5e49', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:36 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-c6b50948-8612-4751-ad4c-b6ba312d4072 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d01727ab-3e4b-4633-88f0-202481249ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:36 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-c6b50948-8612-4751-ad4c-b6ba312d4072 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d01727ab-3e4b-4633-88f0-202481249ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:36 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-c6b50948-8612-4751-ad4c-b6ba312d4072 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (360a9435-1f8f-4ab4-859b-641050410b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:36 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-c6b50948-8612-4751-ad4c-b6ba312d4072 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Volume 7520728e-21e5-4d22-9fbf-2821f65f5e49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7520728e-21e5-4d22-9fbf-2821f65f5e49', 'volume_size': 1} Sep 25 12:02:36 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-c6b50948-8612-4751-ad4c-b6ba312d4072 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:02:36 devstack sudo[107254]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:36 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-fc6fa2fe-7fec-40a4-85d2-ae90aefaeb24 tempest-CreateVolumesFromSnapshotTest-8387161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5f99efd7-a969-4426-901e-b71518535f06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5f99efd7-a969-4426-901e-b71518535f06.dceac794-eaf5-4d83-9638-39599ab17286 1G" returned: 0 in 0.580s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:36 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-fc6fa2fe-7fec-40a4-85d2-ae90aefaeb24 tempest-CreateVolumesFromSnapshotTest-8387161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f99efd7-a969-4426-901e-b71518535f06 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5f99efd7-a969-4426-901e-b71518535f06.dceac794-eaf5-4d83-9638-39599ab17286 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:37 devstack sudo[107260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f99efd7-a969-4426-901e-b71518535f06 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5f99efd7-a969-4426-901e-b71518535f06.dceac794-eaf5-4d83-9638-39599ab17286 Sep 25 12:02:37 devstack sudo[107260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:37 devstack sudo[107260]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:37 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-fc6fa2fe-7fec-40a4-85d2-ae90aefaeb24 tempest-CreateVolumesFromSnapshotTest-8387161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f99efd7-a969-4426-901e-b71518535f06 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5f99efd7-a969-4426-901e-b71518535f06.dceac794-eaf5-4d83-9638-39599ab17286" returned: 0 in 0.433s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:37 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-fc6fa2fe-7fec-40a4-85d2-ae90aefaeb24 tempest-CreateVolumesFromSnapshotTest-8387161 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5f99efd7-a969-4426-901e-b71518535f06.dceac794-eaf5-4d83-9638-39599ab17286 is being set with open permissions: ugo+rw Sep 25 12:02:37 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-fc6fa2fe-7fec-40a4-85d2-ae90aefaeb24 tempest-CreateVolumesFromSnapshotTest-8387161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5f99efd7-a969-4426-901e-b71518535f06.dceac794-eaf5-4d83-9638-39599ab17286 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:37 devstack sudo[107266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5f99efd7-a969-4426-901e-b71518535f06.dceac794-eaf5-4d83-9638-39599ab17286 Sep 25 12:02:37 devstack sudo[107266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:37 devstack sudo[107266]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:37 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-6feb6a4f-818a-4fbd-93ab-e97b85311cfc tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:02:37 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6feb6a4f-818a-4fbd-93ab-e97b85311cfc tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] Flow 'volume_create_manager' (11a4fdfe-6576-4dde-9408-56aab188a12a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:02:37 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6feb6a4f-818a-4fbd-93ab-e97b85311cfc tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b715f9c-316a-4b0c-b79d-1c464d81ef01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:37 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-fc6fa2fe-7fec-40a4-85d2-ae90aefaeb24 tempest-CreateVolumesFromSnapshotTest-8387161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5f99efd7-a969-4426-901e-b71518535f06.dceac794-eaf5-4d83-9638-39599ab17286" returned: 0 in 0.364s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:37 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6feb6a4f-818a-4fbd-93ab-e97b85311cfc tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b715f9c-316a-4b0c-b79d-1c464d81ef01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:02:37Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fdb4b38-aa43-4941-9c52-0126df30b013,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7838c302a3f42699dc880bba25450a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:02:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:02:38Z,use_quota=True,user_id='0467a89c2d7e409eb0a06c03bc2618be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e672148b-ac8f-4690-9184-8b8fe9079816),volume_type_id=e672148b-ac8f-4690-9184-8b8fe9079816)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:37 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6feb6a4f-818a-4fbd-93ab-e97b85311cfc tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cc81cd7-3e68-4148-9660-0b1ad0e01584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:37 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6feb6a4f-818a-4fbd-93ab-e97b85311cfc tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cc81cd7-3e68-4148-9660-0b1ad0e01584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:37 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6feb6a4f-818a-4fbd-93ab-e97b85311cfc tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de37a4fa-76d2-41ec-b71a-b6bbacfb4eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:37 devstack cinder-volume[86984]: DEBUG cinder.image.glance [None req-6feb6a4f-818a-4fbd-93ab-e97b85311cfc tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] Creating Keystone auth plugin from conf {{(pid=86984) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 12:02:37 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-fc6fa2fe-7fec-40a4-85d2-ae90aefaeb24 tempest-CreateVolumesFromSnapshotTest-8387161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5f99efd7-a969-4426-901e-b71518535f06.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:37 devstack sudo[107269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5f99efd7-a969-4426-901e-b71518535f06.info Sep 25 12:02:37 devstack sudo[107269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:38 devstack sudo[107269]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-fc6fa2fe-7fec-40a4-85d2-ae90aefaeb24 tempest-CreateVolumesFromSnapshotTest-8387161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5f99efd7-a969-4426-901e-b71518535f06.info" returned: 0 in 0.316s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:38 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-fc6fa2fe-7fec-40a4-85d2-ae90aefaeb24 tempest-CreateVolumesFromSnapshotTest-8387161 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5f99efd7-a969-4426-901e-b71518535f06.info is being set with open permissions: ugo+rw Sep 25 12:02:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-fc6fa2fe-7fec-40a4-85d2-ae90aefaeb24 tempest-CreateVolumesFromSnapshotTest-8387161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5f99efd7-a969-4426-901e-b71518535f06.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:38 devstack sudo[107272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5f99efd7-a969-4426-901e-b71518535f06.info Sep 25 12:02:38 devstack sudo[107272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:38 devstack sudo[107272]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-fc6fa2fe-7fec-40a4-85d2-ae90aefaeb24 tempest-CreateVolumesFromSnapshotTest-8387161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5f99efd7-a969-4426-901e-b71518535f06.info" returned: 0 in 0.442s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-fc6fa2fe-7fec-40a4-85d2-ae90aefaeb24 tempest-CreateVolumesFromSnapshotTest-8387161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.004s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:02:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-773acf4e-ca5e-45ab-ad77-0212fb6a0cf3 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.638s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:02:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-773acf4e-ca5e-45ab-ad77-0212fb6a0cf3 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:02:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-927475125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a4dbb4c-b411-4193-954b-24f15e3be1b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42205d21fa6e421c8bdbb2c71ee6683c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:02:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:02:35Z,use_quota=True,user_id='401960f2e4244dd0a82a74da6a9b25fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:02:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-773acf4e-ca5e-45ab-ad77-0212fb6a0cf3 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Creating volume 9a4dbb4c-b411-4193-954b-24f15e3be1b0 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:02:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-773acf4e-ca5e-45ab-ad77-0212fb6a0cf3 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:02:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-773acf4e-ca5e-45ab-ad77-0212fb6a0cf3 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:02:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-773acf4e-ca5e-45ab-ad77-0212fb6a0cf3 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:02:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-773acf4e-ca5e-45ab-ad77-0212fb6a0cf3 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:02:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-773acf4e-ca5e-45ab-ad77-0212fb6a0cf3 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:02:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-773acf4e-ca5e-45ab-ad77-0212fb6a0cf3 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:02:38 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-773acf4e-ca5e-45ab-ad77-0212fb6a0cf3 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 12:02:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-773acf4e-ca5e-45ab-ad77-0212fb6a0cf3 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9a4dbb4c-b411-4193-954b-24f15e3be1b0 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:38 devstack cinder-volume[86984]: DEBUG oslo_service.periodic_task [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:02:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:02:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:02:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:02:38 devstack sudo[107275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9a4dbb4c-b411-4193-954b-24f15e3be1b0 1073741824 Sep 25 12:02:38 devstack sudo[107275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:02:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:02:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:38 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6feb6a4f-818a-4fbd-93ab-e97b85311cfc tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de37a4fa-76d2-41ec-b71a-b6bbacfb4eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0fdb4b38-aa43-4941-9c52-0126df30b013', 'volume_name': 'volume-0fdb4b38-aa43-4941-9c52-0126df30b013', 'volume_size': 1, 'image_id': '1b510c88-8e12-4f4d-98fc-9c6be55a44e4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1b510c88-8e12-4f4d-98fc-9c6be55a44e4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '58994f91a46186539421e58157d7b38b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b7838c302a3f42699dc880bba25450a8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd2cdf2e5eaa254ac0e0b8a875a698b283ccb8fbc0a7b12be9598384321e6ae9580f7c10dd17e625da4de794c448f3b6a8bb2a87d09007c487828cc2d152fd707', 'id': '1b510c88-8e12-4f4d-98fc-9c6be55a44e4', 'created_at': datetime.datetime(2026, 9, 25, 10, 2, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 10, 2, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1b510c88-8e12-4f4d-98fc-9c6be55a44e4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:38 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6feb6a4f-818a-4fbd-93ab-e97b85311cfc tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32a581b6-1418-483a-b469-e3fa89b655ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:38 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6feb6a4f-818a-4fbd-93ab-e97b85311cfc tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32a581b6-1418-483a-b469-e3fa89b655ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:38 devstack sudo[107277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 12:02:38 devstack sudo[107277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:38 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6feb6a4f-818a-4fbd-93ab-e97b85311cfc tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8881162f-d5c2-453e-b11e-6b920fcb2406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:38 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-6feb6a4f-818a-4fbd-93ab-e97b85311cfc tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] Volume 0fdb4b38-aa43-4941-9c52-0126df30b013: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0fdb4b38-aa43-4941-9c52-0126df30b013', 'volume_size': 1, 'image_id': '1b510c88-8e12-4f4d-98fc-9c6be55a44e4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1b510c88-8e12-4f4d-98fc-9c6be55a44e4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '58994f91a46186539421e58157d7b38b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b7838c302a3f42699dc880bba25450a8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd2cdf2e5eaa254ac0e0b8a875a698b283ccb8fbc0a7b12be9598384321e6ae9580f7c10dd17e625da4de794c448f3b6a8bb2a87d09007c487828cc2d152fd707', 'id': '1b510c88-8e12-4f4d-98fc-9c6be55a44e4', 'created_at': datetime.datetime(2026, 9, 25, 10, 2, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 10, 2, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1b510c88-8e12-4f4d-98fc-9c6be55a44e4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 25 12:02:38 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-6feb6a4f-818a-4fbd-93ab-e97b85311cfc tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] Trying to clone 0fdb4b38-aa43-4941-9c52-0126df30b013 from image 1b510c88-8e12-4f4d-98fc-9c6be55a44e4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1b510c88-8e12-4f4d-98fc-9c6be55a44e4', 'metadata': {}}]). {{(pid=86984) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 12:02:38 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-fc6fa2fe-7fec-40a4-85d2-ae90aefaeb24 tempest-CreateVolumesFromSnapshotTest-8387161 None] Create snapshot completed successfully Sep 25 12:02:38 devstack cinder-volume[86984]: DEBUG cinder.image.image_utils [None req-6feb6a4f-818a-4fbd-93ab-e97b85311cfc tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1b510c88-8e12-4f4d-98fc-9c6be55a44e4_faw2xxkcdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86984) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 12:02:38 devstack cinder-volume[86984]: INFO cinder.image.image_utils [None req-6feb6a4f-818a-4fbd-93ab-e97b85311cfc tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] Image download 0.00 MB at 0.00 MB/s Sep 25 12:02:38 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a316b7f-3f1e-4e18-9906-82bcc8df8989]: (4, 'raw') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:02:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6feb6a4f-818a-4fbd-93ab-e97b85311cfc tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b510c88-8e12-4f4d-98fc-9c6be55a44e4_faw2xxkcdevstack@QuobyteHD {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:39 devstack sudo[107277]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.336s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:39 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:02:39 devstack cinder-volume[86984]: DEBUG oslo_service.periodic_task [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running periodic task VolumeManager._thread_info {{(pid=86984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:02:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] thread count: 28 {{(pid=86984) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 12:02:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] thread info: [<_MainThread(MainThread, started 132046492332160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86984) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 12:02:39 devstack sudo[107280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b510c88-8e12-4f4d-98fc-9c6be55a44e4_faw2xxkcdevstack@QuobyteHD Sep 25 12:02:39 devstack sudo[107280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:39 devstack sudo[107275]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-773acf4e-ca5e-45ab-ad77-0212fb6a0cf3 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9a4dbb4c-b411-4193-954b-24f15e3be1b0 1073741824" returned: 0 in 0.608s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-773acf4e-ca5e-45ab-ad77-0212fb6a0cf3 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9a4dbb4c-b411-4193-954b-24f15e3be1b0 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:39 devstack sudo[107288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9a4dbb4c-b411-4193-954b-24f15e3be1b0 Sep 25 12:02:39 devstack sudo[107288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:39 devstack sudo[107280]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6feb6a4f-818a-4fbd-93ab-e97b85311cfc tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b510c88-8e12-4f4d-98fc-9c6be55a44e4_faw2xxkcdevstack@QuobyteHD" returned: 0 in 0.408s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6feb6a4f-818a-4fbd-93ab-e97b85311cfc tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b510c88-8e12-4f4d-98fc-9c6be55a44e4_faw2xxkcdevstack@QuobyteHD {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:39 devstack sudo[107290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b510c88-8e12-4f4d-98fc-9c6be55a44e4_faw2xxkcdevstack@QuobyteHD Sep 25 12:02:39 devstack sudo[107290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:39 devstack sudo[107288]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-773acf4e-ca5e-45ab-ad77-0212fb6a0cf3 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9a4dbb4c-b411-4193-954b-24f15e3be1b0" returned: 0 in 0.434s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:39 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-773acf4e-ca5e-45ab-ad77-0212fb6a0cf3 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] <== create_volume: return (1098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:02:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-773acf4e-ca5e-45ab-ad77-0212fb6a0cf3 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.102s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:02:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-c1bb25f6-2c98-45d5-bdab-19793b77ee30 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.470s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:02:39 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-c1bb25f6-2c98-45d5-bdab-19793b77ee30 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:02:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-106410101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77cfa6af-8391-439a-929d-945182ad08e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42205d21fa6e421c8bdbb2c71ee6683c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:02:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:02:35Z,use_quota=True,user_id='401960f2e4244dd0a82a74da6a9b25fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:02:39 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-c1bb25f6-2c98-45d5-bdab-19793b77ee30 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Creating volume 77cfa6af-8391-439a-929d-945182ad08e7 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:02:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-c1bb25f6-2c98-45d5-bdab-19793b77ee30 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:02:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-c1bb25f6-2c98-45d5-bdab-19793b77ee30 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:02:39 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-c1bb25f6-2c98-45d5-bdab-19793b77ee30 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:02:39 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-c1bb25f6-2c98-45d5-bdab-19793b77ee30 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:02:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-c1bb25f6-2c98-45d5-bdab-19793b77ee30 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:02:39 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-c1bb25f6-2c98-45d5-bdab-19793b77ee30 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:02:39 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-c1bb25f6-2c98-45d5-bdab-19793b77ee30 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 12:02:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-c1bb25f6-2c98-45d5-bdab-19793b77ee30 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-77cfa6af-8391-439a-929d-945182ad08e7 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:39 devstack sudo[107290]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6feb6a4f-818a-4fbd-93ab-e97b85311cfc tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b510c88-8e12-4f4d-98fc-9c6be55a44e4_faw2xxkcdevstack@QuobyteHD" returned: 1 in 0.439s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6feb6a4f-818a-4fbd-93ab-e97b85311cfc tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b510c88-8e12-4f4d-98fc-9c6be55a44e4_faw2xxkcdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 12:02:39 devstack cinder-volume[86984]: DEBUG cinder.image.image_utils [None req-6feb6a4f-818a-4fbd-93ab-e97b85311cfc tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] Temporary image 1b510c88-8e12-4f4d-98fc-9c6be55a44e4 is fetched for user 0467a89c2d7e409eb0a06c03bc2618be. {{(pid=86984) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 12:02:39 devstack sudo[107299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-77cfa6af-8391-439a-929d-945182ad08e7 1073741824 Sep 25 12:02:39 devstack sudo[107299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-773acf4e-ca5e-45ab-ad77-0212fb6a0cf3 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31657e9a-cb07-4f01-a043-a7950b6e3a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a4dbb4c-b411-4193-954b-24f15e3be1b0', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-773acf4e-ca5e-45ab-ad77-0212fb6a0cf3 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd731f28-2fa2-4fba-beb4-8df442909d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:39 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-773acf4e-ca5e-45ab-ad77-0212fb6a0cf3 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Volume volume-9a4dbb4c-b411-4193-954b-24f15e3be1b0 (9a4dbb4c-b411-4193-954b-24f15e3be1b0): created successfully Sep 25 12:02:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-773acf4e-ca5e-45ab-ad77-0212fb6a0cf3 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd731f28-2fa2-4fba-beb4-8df442909d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-773acf4e-ca5e-45ab-ad77-0212fb6a0cf3 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Flow 'volume_create_manager' (8c096b0a-0953-4dd5-827c-2ab7c2f5b552) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:02:39 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-773acf4e-ca5e-45ab-ad77-0212fb6a0cf3 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Created volume successfully. Sep 25 12:02:39 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7105e67-24cf-4ac0-8460-db932e1487e3]: (4, 'raw') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:02:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6feb6a4f-818a-4fbd-93ab-e97b85311cfc tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b510c88-8e12-4f4d-98fc-9c6be55a44e4_faw2xxkcdevstack@QuobyteHD {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:40 devstack sudo[107304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b510c88-8e12-4f4d-98fc-9c6be55a44e4_faw2xxkcdevstack@QuobyteHD Sep 25 12:02:40 devstack sudo[107304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:40 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-d06eb5ac-c372-4c05-a8fd-f33c9dab5904 tempest-CreateVolumesFromSnapshotTest-8387161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:02:40 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d06eb5ac-c372-4c05-a8fd-f33c9dab5904 tempest-CreateVolumesFromSnapshotTest-8387161 None] Flow 'volume_create_manager' (a498992e-7df1-40bb-a5df-633ffed6e79a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:02:40 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d06eb5ac-c372-4c05-a8fd-f33c9dab5904 tempest-CreateVolumesFromSnapshotTest-8387161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9779777b-e5a3-49fd-815e-65b2edcd1a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:40 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d06eb5ac-c372-4c05-a8fd-f33c9dab5904 tempest-CreateVolumesFromSnapshotTest-8387161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9779777b-e5a3-49fd-815e-65b2edcd1a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:02:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-278482405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=540afb0e-55c1-493b-a281-ed3ef0312467,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e661ceae20fe43e39af28c2c73504034',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:02:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:02:40Z,use_quota=True,user_id='26579bfa5531475b99394665fc8138ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:40 devstack sudo[107304]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:40 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d06eb5ac-c372-4c05-a8fd-f33c9dab5904 tempest-CreateVolumesFromSnapshotTest-8387161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (932948c5-c5c8-4f4b-b4b7-a9379b7c12ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:40 devstack sudo[107299]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:40 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d06eb5ac-c372-4c05-a8fd-f33c9dab5904 tempest-CreateVolumesFromSnapshotTest-8387161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (932948c5-c5c8-4f4b-b4b7-a9379b7c12ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:40 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d06eb5ac-c372-4c05-a8fd-f33c9dab5904 tempest-CreateVolumesFromSnapshotTest-8387161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1afa3f5-0152-493d-a268-2012c63192c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:40 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d06eb5ac-c372-4c05-a8fd-f33c9dab5904 tempest-CreateVolumesFromSnapshotTest-8387161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1afa3f5-0152-493d-a268-2012c63192c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '540afb0e-55c1-493b-a281-ed3ef0312467', 'volume_name': 'volume-540afb0e-55c1-493b-a281-ed3ef0312467', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:40 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d06eb5ac-c372-4c05-a8fd-f33c9dab5904 tempest-CreateVolumesFromSnapshotTest-8387161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b46654f-f812-4f37-8a32-d08a299c3348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:40 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d06eb5ac-c372-4c05-a8fd-f33c9dab5904 tempest-CreateVolumesFromSnapshotTest-8387161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b46654f-f812-4f37-8a32-d08a299c3348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:40 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d06eb5ac-c372-4c05-a8fd-f33c9dab5904 tempest-CreateVolumesFromSnapshotTest-8387161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec472ef3-e488-44bc-8e3e-a745752636b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:40 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-d06eb5ac-c372-4c05-a8fd-f33c9dab5904 tempest-CreateVolumesFromSnapshotTest-8387161 None] Volume 540afb0e-55c1-493b-a281-ed3ef0312467: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-540afb0e-55c1-493b-a281-ed3ef0312467', 'volume_size': 1} Sep 25 12:02:40 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d06eb5ac-c372-4c05-a8fd-f33c9dab5904 tempest-CreateVolumesFromSnapshotTest-8387161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:02:40 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-c1bb25f6-2c98-45d5-bdab-19793b77ee30 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-77cfa6af-8391-439a-929d-945182ad08e7 1073741824" returned: 0 in 0.861s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:40 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6feb6a4f-818a-4fbd-93ab-e97b85311cfc tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b510c88-8e12-4f4d-98fc-9c6be55a44e4_faw2xxkcdevstack@QuobyteHD" returned: 0 in 0.659s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:40 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6feb6a4f-818a-4fbd-93ab-e97b85311cfc tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b510c88-8e12-4f4d-98fc-9c6be55a44e4_faw2xxkcdevstack@QuobyteHD {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:40 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-c1bb25f6-2c98-45d5-bdab-19793b77ee30 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-77cfa6af-8391-439a-929d-945182ad08e7 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:40 devstack sudo[107313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-77cfa6af-8391-439a-929d-945182ad08e7 Sep 25 12:02:40 devstack sudo[107313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:40 devstack sudo[107312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b510c88-8e12-4f4d-98fc-9c6be55a44e4_faw2xxkcdevstack@QuobyteHD Sep 25 12:02:40 devstack sudo[107312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:41 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-652be833-429b-4c40-af20-6a6949cf83a7 tempest-CreateVolumesFromSnapshotTest-8387161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:02:41 devstack sudo[107312]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:41 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-652be833-429b-4c40-af20-6a6949cf83a7 tempest-CreateVolumesFromSnapshotTest-8387161 None] Flow 'volume_create_manager' (b95d538a-29ba-49b6-82d6-0c456f4dd051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:02:41 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-652be833-429b-4c40-af20-6a6949cf83a7 tempest-CreateVolumesFromSnapshotTest-8387161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f8ee440-bde0-411d-bf2a-fdfec30c4a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6feb6a4f-818a-4fbd-93ab-e97b85311cfc tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b510c88-8e12-4f4d-98fc-9c6be55a44e4_faw2xxkcdevstack@QuobyteHD" returned: 1 in 0.642s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6feb6a4f-818a-4fbd-93ab-e97b85311cfc tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b510c88-8e12-4f4d-98fc-9c6be55a44e4_faw2xxkcdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 12:02:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-6feb6a4f-818a-4fbd-93ab-e97b85311cfc tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:02:41 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-652be833-429b-4c40-af20-6a6949cf83a7 tempest-CreateVolumesFromSnapshotTest-8387161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f8ee440-bde0-411d-bf2a-fdfec30c4a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:02:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-334777343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecdc6d55-442a-4763-a756-f8073b91f109,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e661ceae20fe43e39af28c2c73504034',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:02:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:02:41Z,use_quota=True,user_id='26579bfa5531475b99394665fc8138ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:41 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-652be833-429b-4c40-af20-6a6949cf83a7 tempest-CreateVolumesFromSnapshotTest-8387161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34344410-82d3-4b62-8b2c-853bef38a9c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:41 devstack sudo[107313]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:41 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-652be833-429b-4c40-af20-6a6949cf83a7 tempest-CreateVolumesFromSnapshotTest-8387161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34344410-82d3-4b62-8b2c-853bef38a9c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:41 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-652be833-429b-4c40-af20-6a6949cf83a7 tempest-CreateVolumesFromSnapshotTest-8387161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9053476b-7f86-4546-b3a8-b1bd582a22ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:41 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-652be833-429b-4c40-af20-6a6949cf83a7 tempest-CreateVolumesFromSnapshotTest-8387161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9053476b-7f86-4546-b3a8-b1bd582a22ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecdc6d55-442a-4763-a756-f8073b91f109', 'volume_name': 'volume-ecdc6d55-442a-4763-a756-f8073b91f109', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:41 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-652be833-429b-4c40-af20-6a6949cf83a7 tempest-CreateVolumesFromSnapshotTest-8387161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cd9d405-8dcc-41c3-9588-cec1b23ff460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:41 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-652be833-429b-4c40-af20-6a6949cf83a7 tempest-CreateVolumesFromSnapshotTest-8387161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cd9d405-8dcc-41c3-9588-cec1b23ff460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:41 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-652be833-429b-4c40-af20-6a6949cf83a7 tempest-CreateVolumesFromSnapshotTest-8387161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f58fbcad-9b3e-48c7-beea-54ebdc308177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:41 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-652be833-429b-4c40-af20-6a6949cf83a7 tempest-CreateVolumesFromSnapshotTest-8387161 None] Volume ecdc6d55-442a-4763-a756-f8073b91f109: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecdc6d55-442a-4763-a756-f8073b91f109', 'volume_size': 1} Sep 25 12:02:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-652be833-429b-4c40-af20-6a6949cf83a7 tempest-CreateVolumesFromSnapshotTest-8387161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:02:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-c1bb25f6-2c98-45d5-bdab-19793b77ee30 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-77cfa6af-8391-439a-929d-945182ad08e7" returned: 0 in 0.680s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:41 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-c1bb25f6-2c98-45d5-bdab-19793b77ee30 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] <== create_volume: return (1627ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:02:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-c1bb25f6-2c98-45d5-bdab-19793b77ee30 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.631s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:02:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3dd236f2-5796-41fd-a605-df3249d7cb3e tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.498s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:02:41 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3dd236f2-5796-41fd-a605-df3249d7cb3e tempest-CreateVolumesFromSourceVolumeTest-485866238 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:02:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1385531195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90341631-6278-4d3d-a268-d1424c5aa478,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42205d21fa6e421c8bdbb2c71ee6683c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:02:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:02:36Z,use_quota=True,user_id='401960f2e4244dd0a82a74da6a9b25fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:02:41 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-3dd236f2-5796-41fd-a605-df3249d7cb3e tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Creating volume 90341631-6278-4d3d-a268-d1424c5aa478 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:02:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3dd236f2-5796-41fd-a605-df3249d7cb3e tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:02:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3dd236f2-5796-41fd-a605-df3249d7cb3e tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:02:41 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3dd236f2-5796-41fd-a605-df3249d7cb3e tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:02:41 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3dd236f2-5796-41fd-a605-df3249d7cb3e tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:02:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3dd236f2-5796-41fd-a605-df3249d7cb3e tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:02:41 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3dd236f2-5796-41fd-a605-df3249d7cb3e tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:02:41 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-3dd236f2-5796-41fd-a605-df3249d7cb3e tempest-CreateVolumesFromSourceVolumeTest-485866238 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 12:02:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3dd236f2-5796-41fd-a605-df3249d7cb3e tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-90341631-6278-4d3d-a268-d1424c5aa478 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:41 devstack sudo[107320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-90341631-6278-4d3d-a268-d1424c5aa478 1073741824 Sep 25 12:02:41 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-c1bb25f6-2c98-45d5-bdab-19793b77ee30 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (080ebf65-ba1c-4b43-89c1-7e8cd6afed8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77cfa6af-8391-439a-929d-945182ad08e7', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:41 devstack sudo[107320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:41 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-c1bb25f6-2c98-45d5-bdab-19793b77ee30 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (512fbc06-8a8d-4c52-95bc-2e6db599f422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:41 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-c1bb25f6-2c98-45d5-bdab-19793b77ee30 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Volume volume-77cfa6af-8391-439a-929d-945182ad08e7 (77cfa6af-8391-439a-929d-945182ad08e7): created successfully Sep 25 12:02:41 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-c1bb25f6-2c98-45d5-bdab-19793b77ee30 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (512fbc06-8a8d-4c52-95bc-2e6db599f422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:41 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-c1bb25f6-2c98-45d5-bdab-19793b77ee30 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Flow 'volume_create_manager' (4c290470-53f1-4e72-91db-cba7f40d0235) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:02:41 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-c1bb25f6-2c98-45d5-bdab-19793b77ee30 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Created volume successfully. Sep 25 12:02:41 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ee78cad-3d49-4cdd-8edf-ca5f2bf7e466 tempest-CreateVolumesFromSnapshotTest-8387161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:02:41 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4ee78cad-3d49-4cdd-8edf-ca5f2bf7e466 tempest-CreateVolumesFromSnapshotTest-8387161 None] Flow 'volume_create_manager' (0328a50b-6b4c-460e-8eea-972b7182e267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:02:41 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4ee78cad-3d49-4cdd-8edf-ca5f2bf7e466 tempest-CreateVolumesFromSnapshotTest-8387161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81146d19-90d7-471e-9245-c6bb9247e5ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:41 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4ee78cad-3d49-4cdd-8edf-ca5f2bf7e466 tempest-CreateVolumesFromSnapshotTest-8387161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81146d19-90d7-471e-9245-c6bb9247e5ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:02:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1012305580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9d97979-643d-4c35-aab0-01752ed704ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e661ceae20fe43e39af28c2c73504034',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:02:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:02:42Z,use_quota=True,user_id='26579bfa5531475b99394665fc8138ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:41 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4ee78cad-3d49-4cdd-8edf-ca5f2bf7e466 tempest-CreateVolumesFromSnapshotTest-8387161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fba6667a-78fe-4549-bbbe-006f8443c46f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:41 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4ee78cad-3d49-4cdd-8edf-ca5f2bf7e466 tempest-CreateVolumesFromSnapshotTest-8387161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fba6667a-78fe-4549-bbbe-006f8443c46f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:41 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4ee78cad-3d49-4cdd-8edf-ca5f2bf7e466 tempest-CreateVolumesFromSnapshotTest-8387161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6f73612-5c08-4633-8f6b-abc020968c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:41 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4ee78cad-3d49-4cdd-8edf-ca5f2bf7e466 tempest-CreateVolumesFromSnapshotTest-8387161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6f73612-5c08-4633-8f6b-abc020968c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9d97979-643d-4c35-aab0-01752ed704ae', 'volume_name': 'volume-e9d97979-643d-4c35-aab0-01752ed704ae', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:41 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4ee78cad-3d49-4cdd-8edf-ca5f2bf7e466 tempest-CreateVolumesFromSnapshotTest-8387161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (761f84f4-2c5e-48ab-bdec-9b6b3284bd20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:41 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4ee78cad-3d49-4cdd-8edf-ca5f2bf7e466 tempest-CreateVolumesFromSnapshotTest-8387161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (761f84f4-2c5e-48ab-bdec-9b6b3284bd20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:41 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4ee78cad-3d49-4cdd-8edf-ca5f2bf7e466 tempest-CreateVolumesFromSnapshotTest-8387161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5328b325-b241-43cd-97a8-7bae98983ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:41 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-4ee78cad-3d49-4cdd-8edf-ca5f2bf7e466 tempest-CreateVolumesFromSnapshotTest-8387161 None] Volume e9d97979-643d-4c35-aab0-01752ed704ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9d97979-643d-4c35-aab0-01752ed704ae', 'volume_size': 1} Sep 25 12:02:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-4ee78cad-3d49-4cdd-8edf-ca5f2bf7e466 tempest-CreateVolumesFromSnapshotTest-8387161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:02:42 devstack sudo[107320]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:42 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3dd236f2-5796-41fd-a605-df3249d7cb3e tempest-CreateVolumesFromSourceVolumeTest-485866238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-90341631-6278-4d3d-a268-d1424c5aa478 1073741824" returned: 0 in 0.608s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:42 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3dd236f2-5796-41fd-a605-df3249d7cb3e tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-90341631-6278-4d3d-a268-d1424c5aa478 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:42 devstack sudo[107326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-90341631-6278-4d3d-a268-d1424c5aa478 Sep 25 12:02:42 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb4ded54-0da5-4e9f-b224-0c1fa11af3dd tempest-CreateVolumesFromSnapshotTest-8387161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:02:42 devstack sudo[107326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:42 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-bb4ded54-0da5-4e9f-b224-0c1fa11af3dd tempest-CreateVolumesFromSnapshotTest-8387161 None] Flow 'volume_create_manager' (ad00209a-7b34-4d6d-875a-f6fbd0c373eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:02:42 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-bb4ded54-0da5-4e9f-b224-0c1fa11af3dd tempest-CreateVolumesFromSnapshotTest-8387161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b020704a-f0d2-4c9b-8935-6f47dcf007c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:42 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-bb4ded54-0da5-4e9f-b224-0c1fa11af3dd tempest-CreateVolumesFromSnapshotTest-8387161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b020704a-f0d2-4c9b-8935-6f47dcf007c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:02:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1994898783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac24b0f9-efdf-455e-b788-15f418a4c947,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e661ceae20fe43e39af28c2c73504034',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:02:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:02:42Z,use_quota=True,user_id='26579bfa5531475b99394665fc8138ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:42 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-bb4ded54-0da5-4e9f-b224-0c1fa11af3dd tempest-CreateVolumesFromSnapshotTest-8387161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07c75430-d210-4b27-9c06-94ba933954bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:42 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-bb4ded54-0da5-4e9f-b224-0c1fa11af3dd tempest-CreateVolumesFromSnapshotTest-8387161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07c75430-d210-4b27-9c06-94ba933954bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:42 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-bb4ded54-0da5-4e9f-b224-0c1fa11af3dd tempest-CreateVolumesFromSnapshotTest-8387161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dffc452-1fe7-48db-a0c4-0dcab7242350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:42 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-bb4ded54-0da5-4e9f-b224-0c1fa11af3dd tempest-CreateVolumesFromSnapshotTest-8387161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dffc452-1fe7-48db-a0c4-0dcab7242350) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac24b0f9-efdf-455e-b788-15f418a4c947', 'volume_name': 'volume-ac24b0f9-efdf-455e-b788-15f418a4c947', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:42 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-bb4ded54-0da5-4e9f-b224-0c1fa11af3dd tempest-CreateVolumesFromSnapshotTest-8387161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (943af837-4837-4ea1-a7d6-d1e58427e88a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:42 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-bb4ded54-0da5-4e9f-b224-0c1fa11af3dd tempest-CreateVolumesFromSnapshotTest-8387161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (943af837-4837-4ea1-a7d6-d1e58427e88a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:42 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-bb4ded54-0da5-4e9f-b224-0c1fa11af3dd tempest-CreateVolumesFromSnapshotTest-8387161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8b4d1f5-de6f-4b6a-956a-7dac9192b692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:42 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-bb4ded54-0da5-4e9f-b224-0c1fa11af3dd tempest-CreateVolumesFromSnapshotTest-8387161 None] Volume ac24b0f9-efdf-455e-b788-15f418a4c947: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac24b0f9-efdf-455e-b788-15f418a4c947', 'volume_size': 1} Sep 25 12:02:42 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-bb4ded54-0da5-4e9f-b224-0c1fa11af3dd tempest-CreateVolumesFromSnapshotTest-8387161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:02:42 devstack sudo[107326]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:42 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3dd236f2-5796-41fd-a605-df3249d7cb3e tempest-CreateVolumesFromSourceVolumeTest-485866238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-90341631-6278-4d3d-a268-d1424c5aa478" returned: 0 in 0.409s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:42 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3dd236f2-5796-41fd-a605-df3249d7cb3e tempest-CreateVolumesFromSourceVolumeTest-485866238 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:02:42 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3dd236f2-5796-41fd-a605-df3249d7cb3e tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.102s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:02:42 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-c6b50948-8612-4751-ad4c-b6ba312d4072 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.878s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:02:42 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-c6b50948-8612-4751-ad4c-b6ba312d4072 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:02:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-65958929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7520728e-21e5-4d22-9fbf-2821f65f5e49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42205d21fa6e421c8bdbb2c71ee6683c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:02:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:02:36Z,use_quota=True,user_id='401960f2e4244dd0a82a74da6a9b25fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:02:42 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-c6b50948-8612-4751-ad4c-b6ba312d4072 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Creating volume 7520728e-21e5-4d22-9fbf-2821f65f5e49 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:02:42 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-c6b50948-8612-4751-ad4c-b6ba312d4072 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:02:42 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-c6b50948-8612-4751-ad4c-b6ba312d4072 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:02:42 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-c6b50948-8612-4751-ad4c-b6ba312d4072 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:02:42 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-c6b50948-8612-4751-ad4c-b6ba312d4072 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:02:42 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-c6b50948-8612-4751-ad4c-b6ba312d4072 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:02:42 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-c6b50948-8612-4751-ad4c-b6ba312d4072 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:02:42 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-c6b50948-8612-4751-ad4c-b6ba312d4072 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 12:02:42 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-c6b50948-8612-4751-ad4c-b6ba312d4072 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7520728e-21e5-4d22-9fbf-2821f65f5e49 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:42 devstack sudo[107329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7520728e-21e5-4d22-9fbf-2821f65f5e49 1073741824 Sep 25 12:02:42 devstack sudo[107329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:42 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3dd236f2-5796-41fd-a605-df3249d7cb3e tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d8a87f9-8ff2-4484-a524-b40090a4bc66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90341631-6278-4d3d-a268-d1424c5aa478', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:42 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3dd236f2-5796-41fd-a605-df3249d7cb3e tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63e44c85-1b59-4e3a-9945-16b95b913d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:42 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-3dd236f2-5796-41fd-a605-df3249d7cb3e tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Volume volume-90341631-6278-4d3d-a268-d1424c5aa478 (90341631-6278-4d3d-a268-d1424c5aa478): created successfully Sep 25 12:02:42 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3dd236f2-5796-41fd-a605-df3249d7cb3e tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63e44c85-1b59-4e3a-9945-16b95b913d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:42 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3dd236f2-5796-41fd-a605-df3249d7cb3e tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Flow 'volume_create_manager' (995e846a-6864-4e1d-b991-d4c7ad2a82a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:02:42 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-3dd236f2-5796-41fd-a605-df3249d7cb3e tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Created volume successfully. Sep 25 12:02:42 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-72b9acef-5930-4525-bd01-31c863c0d4df tempest-CreateVolumesFromSnapshotTest-8387161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:02:42 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-72b9acef-5930-4525-bd01-31c863c0d4df tempest-CreateVolumesFromSnapshotTest-8387161 None] Flow 'volume_create_manager' (55141287-5eec-4d81-a02b-300d08b24bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:02:42 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-72b9acef-5930-4525-bd01-31c863c0d4df tempest-CreateVolumesFromSnapshotTest-8387161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (529b94fc-3b1e-4123-83fe-85605979b3b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:42 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-72b9acef-5930-4525-bd01-31c863c0d4df tempest-CreateVolumesFromSnapshotTest-8387161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (529b94fc-3b1e-4123-83fe-85605979b3b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:02:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2136958741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2daff0cf-c5f9-45c3-b0a6-1c10731b1804,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e661ceae20fe43e39af28c2c73504034',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:02:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:02:43Z,use_quota=True,user_id='26579bfa5531475b99394665fc8138ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:42 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-72b9acef-5930-4525-bd01-31c863c0d4df tempest-CreateVolumesFromSnapshotTest-8387161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47ad6951-2ba1-437b-8407-41a87da76248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:42 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-72b9acef-5930-4525-bd01-31c863c0d4df tempest-CreateVolumesFromSnapshotTest-8387161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47ad6951-2ba1-437b-8407-41a87da76248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:42 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-72b9acef-5930-4525-bd01-31c863c0d4df tempest-CreateVolumesFromSnapshotTest-8387161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cfe1600-084b-4892-a170-e200b5d75760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:42 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-72b9acef-5930-4525-bd01-31c863c0d4df tempest-CreateVolumesFromSnapshotTest-8387161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cfe1600-084b-4892-a170-e200b5d75760) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2daff0cf-c5f9-45c3-b0a6-1c10731b1804', 'volume_name': 'volume-2daff0cf-c5f9-45c3-b0a6-1c10731b1804', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:42 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-72b9acef-5930-4525-bd01-31c863c0d4df tempest-CreateVolumesFromSnapshotTest-8387161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15ba637d-afeb-4e0f-827c-e636ef56c5e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:42 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-72b9acef-5930-4525-bd01-31c863c0d4df tempest-CreateVolumesFromSnapshotTest-8387161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15ba637d-afeb-4e0f-827c-e636ef56c5e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:42 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-72b9acef-5930-4525-bd01-31c863c0d4df tempest-CreateVolumesFromSnapshotTest-8387161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38e5df95-2b01-4be7-adf5-d219a31ebb09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:42 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-72b9acef-5930-4525-bd01-31c863c0d4df tempest-CreateVolumesFromSnapshotTest-8387161 None] Volume 2daff0cf-c5f9-45c3-b0a6-1c10731b1804: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2daff0cf-c5f9-45c3-b0a6-1c10731b1804', 'volume_size': 1} Sep 25 12:02:42 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-72b9acef-5930-4525-bd01-31c863c0d4df tempest-CreateVolumesFromSnapshotTest-8387161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:02:43 devstack sudo[107329]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-c6b50948-8612-4751-ad4c-b6ba312d4072 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7520728e-21e5-4d22-9fbf-2821f65f5e49 1073741824" returned: 0 in 0.539s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-c6b50948-8612-4751-ad4c-b6ba312d4072 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7520728e-21e5-4d22-9fbf-2821f65f5e49 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:43 devstack sudo[107335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7520728e-21e5-4d22-9fbf-2821f65f5e49 Sep 25 12:02:43 devstack sudo[107335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:43 devstack sudo[107335]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-c6b50948-8612-4751-ad4c-b6ba312d4072 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7520728e-21e5-4d22-9fbf-2821f65f5e49" returned: 0 in 0.293s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:43 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-c6b50948-8612-4751-ad4c-b6ba312d4072 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:02:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-c6b50948-8612-4751-ad4c-b6ba312d4072 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:02:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d06eb5ac-c372-4c05-a8fd-f33c9dab5904 tempest-CreateVolumesFromSnapshotTest-8387161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.758s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:02:43 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-d06eb5ac-c372-4c05-a8fd-f33c9dab5904 tempest-CreateVolumesFromSnapshotTest-8387161 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:02:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-278482405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=540afb0e-55c1-493b-a281-ed3ef0312467,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e661ceae20fe43e39af28c2c73504034',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:02:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:02:40Z,use_quota=True,user_id='26579bfa5531475b99394665fc8138ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:02:43 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-d06eb5ac-c372-4c05-a8fd-f33c9dab5904 tempest-CreateVolumesFromSnapshotTest-8387161 None] Creating volume 540afb0e-55c1-493b-a281-ed3ef0312467 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:02:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d06eb5ac-c372-4c05-a8fd-f33c9dab5904 tempest-CreateVolumesFromSnapshotTest-8387161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:02:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d06eb5ac-c372-4c05-a8fd-f33c9dab5904 tempest-CreateVolumesFromSnapshotTest-8387161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:02:43 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-d06eb5ac-c372-4c05-a8fd-f33c9dab5904 tempest-CreateVolumesFromSnapshotTest-8387161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:02:43 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-d06eb5ac-c372-4c05-a8fd-f33c9dab5904 tempest-CreateVolumesFromSnapshotTest-8387161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:02:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d06eb5ac-c372-4c05-a8fd-f33c9dab5904 tempest-CreateVolumesFromSnapshotTest-8387161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:02:43 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-d06eb5ac-c372-4c05-a8fd-f33c9dab5904 tempest-CreateVolumesFromSnapshotTest-8387161 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:02:43 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-d06eb5ac-c372-4c05-a8fd-f33c9dab5904 tempest-CreateVolumesFromSnapshotTest-8387161 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 12:02:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d06eb5ac-c372-4c05-a8fd-f33c9dab5904 tempest-CreateVolumesFromSnapshotTest-8387161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-540afb0e-55c1-493b-a281-ed3ef0312467 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:43 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-c6b50948-8612-4751-ad4c-b6ba312d4072 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (360a9435-1f8f-4ab4-859b-641050410b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7520728e-21e5-4d22-9fbf-2821f65f5e49', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:43 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-c6b50948-8612-4751-ad4c-b6ba312d4072 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f33c0d59-df85-4d75-85f3-cc31b1f56a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:43 devstack sudo[107338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-540afb0e-55c1-493b-a281-ed3ef0312467 1073741824 Sep 25 12:02:43 devstack sudo[107338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:43 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-c6b50948-8612-4751-ad4c-b6ba312d4072 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Volume volume-7520728e-21e5-4d22-9fbf-2821f65f5e49 (7520728e-21e5-4d22-9fbf-2821f65f5e49): created successfully Sep 25 12:02:43 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-c6b50948-8612-4751-ad4c-b6ba312d4072 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f33c0d59-df85-4d75-85f3-cc31b1f56a68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:43 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-c6b50948-8612-4751-ad4c-b6ba312d4072 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Flow 'volume_create_manager' (dfe0d0bb-ca54-43af-a8ec-27d7c4825be3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:02:43 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-c6b50948-8612-4751-ad4c-b6ba312d4072 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Created volume successfully. Sep 25 12:02:43 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ce615eea-2895-4f34-86c9-1d06bfc5aa01 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Acquiring lock "cinder-7520728e-21e5-4d22-9fbf-2821f65f5e49-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:02:43 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ce615eea-2895-4f34-86c9-1d06bfc5aa01 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Lock "cinder-7520728e-21e5-4d22-9fbf-2821f65f5e49-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:02:43 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ce615eea-2895-4f34-86c9-1d06bfc5aa01 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Acquiring lock "cinder-quobyte-7520728e-21e5-4d22-9fbf-2821f65f5e49" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:02:43 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ce615eea-2895-4f34-86c9-1d06bfc5aa01 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Lock "cinder-quobyte-7520728e-21e5-4d22-9fbf-2821f65f5e49" acquired by "delete_volume" :: waited 0.022s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:02:43 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f26cea-4edc-44d7-ad09-fb952b88d543]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:02:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ce615eea-2895-4f34-86c9-1d06bfc5aa01 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7520728e-21e5-4d22-9fbf-2821f65f5e49 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:44 devstack sudo[107346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7520728e-21e5-4d22-9fbf-2821f65f5e49 Sep 25 12:02:44 devstack sudo[107346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:44 devstack sudo[107338]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d06eb5ac-c372-4c05-a8fd-f33c9dab5904 tempest-CreateVolumesFromSnapshotTest-8387161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-540afb0e-55c1-493b-a281-ed3ef0312467 1073741824" returned: 0 in 0.664s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d06eb5ac-c372-4c05-a8fd-f33c9dab5904 tempest-CreateVolumesFromSnapshotTest-8387161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-540afb0e-55c1-493b-a281-ed3ef0312467 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:44 devstack sudo[107348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-540afb0e-55c1-493b-a281-ed3ef0312467 Sep 25 12:02:44 devstack sudo[107348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:44 devstack sudo[107346]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ce615eea-2895-4f34-86c9-1d06bfc5aa01 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7520728e-21e5-4d22-9fbf-2821f65f5e49" returned: 0 in 0.442s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ce615eea-2895-4f34-86c9-1d06bfc5aa01 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7520728e-21e5-4d22-9fbf-2821f65f5e49 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:44 devstack sudo[107354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7520728e-21e5-4d22-9fbf-2821f65f5e49 Sep 25 12:02:44 devstack sudo[107354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:44 devstack sudo[107348]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d06eb5ac-c372-4c05-a8fd-f33c9dab5904 tempest-CreateVolumesFromSnapshotTest-8387161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-540afb0e-55c1-493b-a281-ed3ef0312467" returned: 0 in 0.341s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:44 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-d06eb5ac-c372-4c05-a8fd-f33c9dab5904 tempest-CreateVolumesFromSnapshotTest-8387161 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:02:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d06eb5ac-c372-4c05-a8fd-f33c9dab5904 tempest-CreateVolumesFromSnapshotTest-8387161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:02:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-6feb6a4f-818a-4fbd-93ab-e97b85311cfc tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.177s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:02:44 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-6feb6a4f-818a-4fbd-93ab-e97b85311cfc tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:02:37Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fdb4b38-aa43-4941-9c52-0126df30b013,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7838c302a3f42699dc880bba25450a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:02:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:02:38Z,use_quota=True,user_id='0467a89c2d7e409eb0a06c03bc2618be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e672148b-ac8f-4690-9184-8b8fe9079816),volume_type_id=e672148b-ac8f-4690-9184-8b8fe9079816)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:02:44 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-6feb6a4f-818a-4fbd-93ab-e97b85311cfc tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] Creating volume 0fdb4b38-aa43-4941-9c52-0126df30b013 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:02:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-6feb6a4f-818a-4fbd-93ab-e97b85311cfc tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:02:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-6feb6a4f-818a-4fbd-93ab-e97b85311cfc tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:02:44 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-6feb6a4f-818a-4fbd-93ab-e97b85311cfc tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:02:44 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-6feb6a4f-818a-4fbd-93ab-e97b85311cfc tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:02:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-6feb6a4f-818a-4fbd-93ab-e97b85311cfc tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:02:44 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-6feb6a4f-818a-4fbd-93ab-e97b85311cfc tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:02:44 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-6feb6a4f-818a-4fbd-93ab-e97b85311cfc tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 12:02:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6feb6a4f-818a-4fbd-93ab-e97b85311cfc tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0fdb4b38-aa43-4941-9c52-0126df30b013 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:44 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d06eb5ac-c372-4c05-a8fd-f33c9dab5904 tempest-CreateVolumesFromSnapshotTest-8387161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec472ef3-e488-44bc-8e3e-a745752636b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-540afb0e-55c1-493b-a281-ed3ef0312467', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:44 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d06eb5ac-c372-4c05-a8fd-f33c9dab5904 tempest-CreateVolumesFromSnapshotTest-8387161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83b53de5-30ce-4dd5-b909-fc658910e832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:44 devstack sudo[107356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0fdb4b38-aa43-4941-9c52-0126df30b013 1073741824 Sep 25 12:02:44 devstack sudo[107356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:44 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-d06eb5ac-c372-4c05-a8fd-f33c9dab5904 tempest-CreateVolumesFromSnapshotTest-8387161 None] Volume volume-540afb0e-55c1-493b-a281-ed3ef0312467 (540afb0e-55c1-493b-a281-ed3ef0312467): created successfully Sep 25 12:02:44 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d06eb5ac-c372-4c05-a8fd-f33c9dab5904 tempest-CreateVolumesFromSnapshotTest-8387161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83b53de5-30ce-4dd5-b909-fc658910e832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:44 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d06eb5ac-c372-4c05-a8fd-f33c9dab5904 tempest-CreateVolumesFromSnapshotTest-8387161 None] Flow 'volume_create_manager' (a498992e-7df1-40bb-a5df-633ffed6e79a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:02:44 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-d06eb5ac-c372-4c05-a8fd-f33c9dab5904 tempest-CreateVolumesFromSnapshotTest-8387161 None] Created volume successfully. Sep 25 12:02:44 devstack sudo[107354]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ce615eea-2895-4f34-86c9-1d06bfc5aa01 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7520728e-21e5-4d22-9fbf-2821f65f5e49" returned: 0 in 0.330s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:44 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ce615eea-2895-4f34-86c9-1d06bfc5aa01 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Lock "cinder-quobyte-7520728e-21e5-4d22-9fbf-2821f65f5e49" released by "delete_volume" :: held 0.834s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:02:44 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-ce615eea-2895-4f34-86c9-1d06bfc5aa01 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Created reservations ['bd810712-57e5-48b1-a3e6-04e27c0c6613', '1a11032b-1fab-4a36-9e27-345aba7cafb3', '36ff5ff4-c39c-4db3-a2f8-115eb015ce0b', '8cb4525e-b60a-4c0e-9075-a0f7627eab2b'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:02:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-ce615eea-2895-4f34-86c9-1d06bfc5aa01 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:02:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-ce615eea-2895-4f34-86c9-1d06bfc5aa01 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:02:44 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-ce615eea-2895-4f34-86c9-1d06bfc5aa01 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:02:44 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-ce615eea-2895-4f34-86c9-1d06bfc5aa01 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:02:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-ce615eea-2895-4f34-86c9-1d06bfc5aa01 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:02:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ce615eea-2895-4f34-86c9-1d06bfc5aa01 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:44 devstack sudo[107362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 12:02:44 devstack sudo[107362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:45 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ac869616-b960-4a26-ab5f-62bdf0609dd2 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Acquiring lock "cinder-90341631-6278-4d3d-a268-d1424c5aa478-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:02:45 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ac869616-b960-4a26-ab5f-62bdf0609dd2 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Lock "cinder-90341631-6278-4d3d-a268-d1424c5aa478-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:02:45 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ac869616-b960-4a26-ab5f-62bdf0609dd2 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Acquiring lock "cinder-quobyte-90341631-6278-4d3d-a268-d1424c5aa478" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:02:45 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ac869616-b960-4a26-ab5f-62bdf0609dd2 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Lock "cinder-quobyte-90341631-6278-4d3d-a268-d1424c5aa478" acquired by "delete_volume" :: waited 0.017s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:02:45 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee5f1fc-36c0-46c4-895f-9f22969511da]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:02:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ac869616-b960-4a26-ab5f-62bdf0609dd2 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-90341631-6278-4d3d-a268-d1424c5aa478 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:45 devstack sudo[107356]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6feb6a4f-818a-4fbd-93ab-e97b85311cfc tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0fdb4b38-aa43-4941-9c52-0126df30b013 1073741824" returned: 0 in 0.725s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6feb6a4f-818a-4fbd-93ab-e97b85311cfc tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0fdb4b38-aa43-4941-9c52-0126df30b013 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:45 devstack sudo[107367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0fdb4b38-aa43-4941-9c52-0126df30b013 Sep 25 12:02:45 devstack sudo[107367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:45 devstack sudo[107362]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ce615eea-2895-4f34-86c9-1d06bfc5aa01 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.431s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:45 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-ce615eea-2895-4f34-86c9-1d06bfc5aa01 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:02:45 devstack sudo[107365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-90341631-6278-4d3d-a268-d1424c5aa478 Sep 25 12:02:45 devstack sudo[107365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:45 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-ce615eea-2895-4f34-86c9-1d06bfc5aa01 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Deleted volume successfully. Sep 25 12:02:45 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ce615eea-2895-4f34-86c9-1d06bfc5aa01 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Lock "cinder-7520728e-21e5-4d22-9fbf-2821f65f5e49-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:02:45 devstack sudo[107367]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6feb6a4f-818a-4fbd-93ab-e97b85311cfc tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0fdb4b38-aa43-4941-9c52-0126df30b013" returned: 0 in 0.319s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:45 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-6feb6a4f-818a-4fbd-93ab-e97b85311cfc tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:02:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-6feb6a4f-818a-4fbd-93ab-e97b85311cfc tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:02:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-652be833-429b-4c40-af20-6a6949cf83a7 tempest-CreateVolumesFromSnapshotTest-8387161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.194s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:02:45 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-652be833-429b-4c40-af20-6a6949cf83a7 tempest-CreateVolumesFromSnapshotTest-8387161 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:02:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-334777343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecdc6d55-442a-4763-a756-f8073b91f109,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e661ceae20fe43e39af28c2c73504034',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:02:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:02:41Z,use_quota=True,user_id='26579bfa5531475b99394665fc8138ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:02:45 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-652be833-429b-4c40-af20-6a6949cf83a7 tempest-CreateVolumesFromSnapshotTest-8387161 None] Creating volume ecdc6d55-442a-4763-a756-f8073b91f109 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:02:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-652be833-429b-4c40-af20-6a6949cf83a7 tempest-CreateVolumesFromSnapshotTest-8387161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:02:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-652be833-429b-4c40-af20-6a6949cf83a7 tempest-CreateVolumesFromSnapshotTest-8387161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:02:45 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-652be833-429b-4c40-af20-6a6949cf83a7 tempest-CreateVolumesFromSnapshotTest-8387161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:02:45 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-652be833-429b-4c40-af20-6a6949cf83a7 tempest-CreateVolumesFromSnapshotTest-8387161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:02:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-652be833-429b-4c40-af20-6a6949cf83a7 tempest-CreateVolumesFromSnapshotTest-8387161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:02:45 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-652be833-429b-4c40-af20-6a6949cf83a7 tempest-CreateVolumesFromSnapshotTest-8387161 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:02:45 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-652be833-429b-4c40-af20-6a6949cf83a7 tempest-CreateVolumesFromSnapshotTest-8387161 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 12:02:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-652be833-429b-4c40-af20-6a6949cf83a7 tempest-CreateVolumesFromSnapshotTest-8387161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-ecdc6d55-442a-4763-a756-f8073b91f109 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:45 devstack sudo[107373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-ecdc6d55-442a-4763-a756-f8073b91f109 1073741824 Sep 25 12:02:45 devstack sudo[107373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:45 devstack cinder-volume[86984]: DEBUG cinder.volume.volume_utils [None req-6feb6a4f-818a-4fbd-93ab-e97b85311cfc tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] Attempting download of 1b510c88-8e12-4f4d-98fc-9c6be55a44e4 ((None, [{'url': 'file:///opt/stack/data/glance/images/1b510c88-8e12-4f4d-98fc-9c6be55a44e4', 'metadata': {}}])) to volume 0fdb4b38-aa43-4941-9c52-0126df30b013. {{(pid=86984) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 12:02:45 devstack sudo[107365]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ac869616-b960-4a26-ab5f-62bdf0609dd2 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-90341631-6278-4d3d-a268-d1424c5aa478" returned: 0 in 0.486s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ac869616-b960-4a26-ab5f-62bdf0609dd2 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-90341631-6278-4d3d-a268-d1424c5aa478 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:45 devstack sudo[107377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-90341631-6278-4d3d-a268-d1424c5aa478 Sep 25 12:02:45 devstack sudo[107377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:45 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[7511885f-7f44-43cc-84c2-043027502250]: (4, 'raw') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:02:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6feb6a4f-818a-4fbd-93ab-e97b85311cfc tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1b510c88-8e12-4f4d-98fc-9c6be55a44e4_swisji11 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:45 devstack sudo[107379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1b510c88-8e12-4f4d-98fc-9c6be55a44e4_swisji11 Sep 25 12:02:45 devstack sudo[107379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:46 devstack sudo[107377]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ac869616-b960-4a26-ab5f-62bdf0609dd2 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-90341631-6278-4d3d-a268-d1424c5aa478" returned: 0 in 0.343s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:46 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ac869616-b960-4a26-ab5f-62bdf0609dd2 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Lock "cinder-quobyte-90341631-6278-4d3d-a268-d1424c5aa478" released by "delete_volume" :: held 0.881s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:02:46 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-ac869616-b960-4a26-ab5f-62bdf0609dd2 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Created reservations ['2b04e861-39ba-4e4f-bbc8-f93d7cbb52c1', '48e7ce45-8123-4b25-8d90-e85ff2e2cc11', '1ccc65ed-c604-437f-b55e-a4c573a518e5', '5ebe878e-22e9-4d77-ad0d-55c89e8a5aef'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:02:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-ac869616-b960-4a26-ab5f-62bdf0609dd2 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:02:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-ac869616-b960-4a26-ab5f-62bdf0609dd2 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:02:46 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-ac869616-b960-4a26-ab5f-62bdf0609dd2 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:02:46 devstack sudo[107379]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:46 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-ac869616-b960-4a26-ab5f-62bdf0609dd2 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:02:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-ac869616-b960-4a26-ab5f-62bdf0609dd2 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:02:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ac869616-b960-4a26-ab5f-62bdf0609dd2 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6feb6a4f-818a-4fbd-93ab-e97b85311cfc tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1b510c88-8e12-4f4d-98fc-9c6be55a44e4_swisji11" returned: 0 in 0.476s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6feb6a4f-818a-4fbd-93ab-e97b85311cfc tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1b510c88-8e12-4f4d-98fc-9c6be55a44e4_swisji11 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:46 devstack sudo[107388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 12:02:46 devstack sudo[107388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:46 devstack sudo[107373]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-652be833-429b-4c40-af20-6a6949cf83a7 tempest-CreateVolumesFromSnapshotTest-8387161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-ecdc6d55-442a-4763-a756-f8073b91f109 1073741824" returned: 0 in 0.680s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:46 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f76d2018-2803-4524-984d-6d2ab59b5328 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Acquiring lock "cinder-77cfa6af-8391-439a-929d-945182ad08e7-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:02:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-652be833-429b-4c40-af20-6a6949cf83a7 tempest-CreateVolumesFromSnapshotTest-8387161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-ecdc6d55-442a-4763-a756-f8073b91f109 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:46 devstack sudo[107389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1b510c88-8e12-4f4d-98fc-9c6be55a44e4_swisji11 Sep 25 12:02:46 devstack sudo[107389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:46 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f76d2018-2803-4524-984d-6d2ab59b5328 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Lock "cinder-77cfa6af-8391-439a-929d-945182ad08e7-delete_volume" acquired by "delete_volume" :: waited 0.097s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:02:46 devstack sudo[107392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-ecdc6d55-442a-4763-a756-f8073b91f109 Sep 25 12:02:46 devstack sudo[107392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:46 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f76d2018-2803-4524-984d-6d2ab59b5328 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Acquiring lock "cinder-quobyte-77cfa6af-8391-439a-929d-945182ad08e7" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:02:46 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f76d2018-2803-4524-984d-6d2ab59b5328 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Lock "cinder-quobyte-77cfa6af-8391-439a-929d-945182ad08e7" acquired by "delete_volume" :: waited 0.029s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:02:46 devstack sudo[107388]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ac869616-b960-4a26-ab5f-62bdf0609dd2 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.462s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:46 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-ac869616-b960-4a26-ab5f-62bdf0609dd2 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:02:46 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-ac869616-b960-4a26-ab5f-62bdf0609dd2 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Deleted volume successfully. Sep 25 12:02:46 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d5f65a9-b925-4592-b0b2-07c16653aa30]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:02:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f76d2018-2803-4524-984d-6d2ab59b5328 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-77cfa6af-8391-439a-929d-945182ad08e7 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:46 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ac869616-b960-4a26-ab5f-62bdf0609dd2 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Lock "cinder-90341631-6278-4d3d-a268-d1424c5aa478-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:02:46 devstack sudo[107392]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-652be833-429b-4c40-af20-6a6949cf83a7 tempest-CreateVolumesFromSnapshotTest-8387161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-ecdc6d55-442a-4763-a756-f8073b91f109" returned: 0 in 0.424s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:46 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-652be833-429b-4c40-af20-6a6949cf83a7 tempest-CreateVolumesFromSnapshotTest-8387161 None] <== create_volume: return (1234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:02:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-652be833-429b-4c40-af20-6a6949cf83a7 tempest-CreateVolumesFromSnapshotTest-8387161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.240s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:02:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-4ee78cad-3d49-4cdd-8edf-ca5f2bf7e466 tempest-CreateVolumesFromSnapshotTest-8387161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.974s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:02:46 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-4ee78cad-3d49-4cdd-8edf-ca5f2bf7e466 tempest-CreateVolumesFromSnapshotTest-8387161 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:02:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1012305580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9d97979-643d-4c35-aab0-01752ed704ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e661ceae20fe43e39af28c2c73504034',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:02:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:02:42Z,use_quota=True,user_id='26579bfa5531475b99394665fc8138ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:02:46 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-4ee78cad-3d49-4cdd-8edf-ca5f2bf7e466 tempest-CreateVolumesFromSnapshotTest-8387161 None] Creating volume e9d97979-643d-4c35-aab0-01752ed704ae {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:02:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-4ee78cad-3d49-4cdd-8edf-ca5f2bf7e466 tempest-CreateVolumesFromSnapshotTest-8387161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:02:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-4ee78cad-3d49-4cdd-8edf-ca5f2bf7e466 tempest-CreateVolumesFromSnapshotTest-8387161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:02:46 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-4ee78cad-3d49-4cdd-8edf-ca5f2bf7e466 tempest-CreateVolumesFromSnapshotTest-8387161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:02:46 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-4ee78cad-3d49-4cdd-8edf-ca5f2bf7e466 tempest-CreateVolumesFromSnapshotTest-8387161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:02:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-4ee78cad-3d49-4cdd-8edf-ca5f2bf7e466 tempest-CreateVolumesFromSnapshotTest-8387161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:02:46 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-4ee78cad-3d49-4cdd-8edf-ca5f2bf7e466 tempest-CreateVolumesFromSnapshotTest-8387161 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:02:46 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-4ee78cad-3d49-4cdd-8edf-ca5f2bf7e466 tempest-CreateVolumesFromSnapshotTest-8387161 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 12:02:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-4ee78cad-3d49-4cdd-8edf-ca5f2bf7e466 tempest-CreateVolumesFromSnapshotTest-8387161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-e9d97979-643d-4c35-aab0-01752ed704ae 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:46 devstack sudo[107389]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:46 devstack sudo[107395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-77cfa6af-8391-439a-929d-945182ad08e7 Sep 25 12:02:46 devstack sudo[107395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6feb6a4f-818a-4fbd-93ab-e97b85311cfc tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1b510c88-8e12-4f4d-98fc-9c6be55a44e4_swisji11" returned: 1 in 0.662s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6feb6a4f-818a-4fbd-93ab-e97b85311cfc tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1b510c88-8e12-4f4d-98fc-9c6be55a44e4_swisji11' failed. Not Retrying. {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 12:02:46 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[a97a1deb-9ea1-4dc2-a4c3-3f1029317743]: (4, 'raw') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:02:46 devstack sudo[107399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-e9d97979-643d-4c35-aab0-01752ed704ae 1073741824 Sep 25 12:02:46 devstack sudo[107399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6feb6a4f-818a-4fbd-93ab-e97b85311cfc tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b510c88-8e12-4f4d-98fc-9c6be55a44e4_faw2xxkcdevstack@QuobyteHD {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:46 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-652be833-429b-4c40-af20-6a6949cf83a7 tempest-CreateVolumesFromSnapshotTest-8387161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f58fbcad-9b3e-48c7-beea-54ebdc308177) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecdc6d55-442a-4763-a756-f8073b91f109', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:46 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-652be833-429b-4c40-af20-6a6949cf83a7 tempest-CreateVolumesFromSnapshotTest-8387161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98fd8462-0b5d-4cec-941a-1ed5f656c010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:46 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-652be833-429b-4c40-af20-6a6949cf83a7 tempest-CreateVolumesFromSnapshotTest-8387161 None] Volume volume-ecdc6d55-442a-4763-a756-f8073b91f109 (ecdc6d55-442a-4763-a756-f8073b91f109): created successfully Sep 25 12:02:46 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-652be833-429b-4c40-af20-6a6949cf83a7 tempest-CreateVolumesFromSnapshotTest-8387161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98fd8462-0b5d-4cec-941a-1ed5f656c010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:46 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-652be833-429b-4c40-af20-6a6949cf83a7 tempest-CreateVolumesFromSnapshotTest-8387161 None] Flow 'volume_create_manager' (b95d538a-29ba-49b6-82d6-0c456f4dd051) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:02:47 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-652be833-429b-4c40-af20-6a6949cf83a7 tempest-CreateVolumesFromSnapshotTest-8387161 None] Created volume successfully. Sep 25 12:02:47 devstack sudo[107402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b510c88-8e12-4f4d-98fc-9c6be55a44e4_faw2xxkcdevstack@QuobyteHD Sep 25 12:02:47 devstack sudo[107402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:47 devstack sudo[107395]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f76d2018-2803-4524-984d-6d2ab59b5328 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-77cfa6af-8391-439a-929d-945182ad08e7" returned: 0 in 0.484s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f76d2018-2803-4524-984d-6d2ab59b5328 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-77cfa6af-8391-439a-929d-945182ad08e7 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:47 devstack sudo[107409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-77cfa6af-8391-439a-929d-945182ad08e7 Sep 25 12:02:47 devstack sudo[107409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:47 devstack sudo[107402]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6feb6a4f-818a-4fbd-93ab-e97b85311cfc tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b510c88-8e12-4f4d-98fc-9c6be55a44e4_faw2xxkcdevstack@QuobyteHD" returned: 0 in 0.436s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6feb6a4f-818a-4fbd-93ab-e97b85311cfc tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b510c88-8e12-4f4d-98fc-9c6be55a44e4_faw2xxkcdevstack@QuobyteHD {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:47 devstack sudo[107399]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-4ee78cad-3d49-4cdd-8edf-ca5f2bf7e466 tempest-CreateVolumesFromSnapshotTest-8387161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-e9d97979-643d-4c35-aab0-01752ed704ae 1073741824" returned: 0 in 0.633s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:47 devstack sudo[107414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b510c88-8e12-4f4d-98fc-9c6be55a44e4_faw2xxkcdevstack@QuobyteHD Sep 25 12:02:47 devstack sudo[107414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:47 devstack sudo[107409]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f76d2018-2803-4524-984d-6d2ab59b5328 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-77cfa6af-8391-439a-929d-945182ad08e7" returned: 0 in 0.329s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:47 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f76d2018-2803-4524-984d-6d2ab59b5328 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Lock "cinder-quobyte-77cfa6af-8391-439a-929d-945182ad08e7" released by "delete_volume" :: held 0.939s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:02:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-4ee78cad-3d49-4cdd-8edf-ca5f2bf7e466 tempest-CreateVolumesFromSnapshotTest-8387161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-e9d97979-643d-4c35-aab0-01752ed704ae {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:47 devstack sudo[107417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-e9d97979-643d-4c35-aab0-01752ed704ae Sep 25 12:02:47 devstack sudo[107417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:47 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-f76d2018-2803-4524-984d-6d2ab59b5328 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Created reservations ['6bf9289b-2366-44b4-ad80-223412f1881c', '1be3128a-bcf7-41fa-baea-fd43adddf2cf', '6f480b85-8749-4c42-ac86-462ec2db56e6', 'c0e84704-3898-43a8-9f4a-17b28167a1d5'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:02:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f76d2018-2803-4524-984d-6d2ab59b5328 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:02:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f76d2018-2803-4524-984d-6d2ab59b5328 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:02:47 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-f76d2018-2803-4524-984d-6d2ab59b5328 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:02:47 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-f76d2018-2803-4524-984d-6d2ab59b5328 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:02:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f76d2018-2803-4524-984d-6d2ab59b5328 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:02:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f76d2018-2803-4524-984d-6d2ab59b5328 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:47 devstack sudo[107422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 12:02:47 devstack sudo[107422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:47 devstack sudo[107414]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6feb6a4f-818a-4fbd-93ab-e97b85311cfc tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b510c88-8e12-4f4d-98fc-9c6be55a44e4_faw2xxkcdevstack@QuobyteHD" returned: 1 in 0.509s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6feb6a4f-818a-4fbd-93ab-e97b85311cfc tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b510c88-8e12-4f4d-98fc-9c6be55a44e4_faw2xxkcdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 12:02:47 devstack cinder-volume[86984]: DEBUG cinder.image.image_utils [None req-6feb6a4f-818a-4fbd-93ab-e97b85311cfc tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] 1b510c88-8e12-4f4d-98fc-9c6be55a44e4 was raw, converting to qcow2 {{(pid=86984) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 12:02:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6feb6a4f-818a-4fbd-93ab-e97b85311cfc tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1b510c88-8e12-4f4d-98fc-9c6be55a44e4_faw2xxkcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0fdb4b38-aa43-4941-9c52-0126df30b013 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:47 devstack sudo[107424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1b510c88-8e12-4f4d-98fc-9c6be55a44e4_faw2xxkcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0fdb4b38-aa43-4941-9c52-0126df30b013 Sep 25 12:02:47 devstack sudo[107424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:47 devstack sudo[107417]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-4ee78cad-3d49-4cdd-8edf-ca5f2bf7e466 tempest-CreateVolumesFromSnapshotTest-8387161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-e9d97979-643d-4c35-aab0-01752ed704ae" returned: 0 in 0.397s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:47 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-4ee78cad-3d49-4cdd-8edf-ca5f2bf7e466 tempest-CreateVolumesFromSnapshotTest-8387161 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:02:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-4ee78cad-3d49-4cdd-8edf-ca5f2bf7e466 tempest-CreateVolumesFromSnapshotTest-8387161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:02:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-bb4ded54-0da5-4e9f-b224-0c1fa11af3dd tempest-CreateVolumesFromSnapshotTest-8387161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.686s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:02:47 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-bb4ded54-0da5-4e9f-b224-0c1fa11af3dd tempest-CreateVolumesFromSnapshotTest-8387161 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:02:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1994898783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac24b0f9-efdf-455e-b788-15f418a4c947,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e661ceae20fe43e39af28c2c73504034',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:02:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:02:42Z,use_quota=True,user_id='26579bfa5531475b99394665fc8138ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:02:47 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-bb4ded54-0da5-4e9f-b224-0c1fa11af3dd tempest-CreateVolumesFromSnapshotTest-8387161 None] Creating volume ac24b0f9-efdf-455e-b788-15f418a4c947 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:02:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-bb4ded54-0da5-4e9f-b224-0c1fa11af3dd tempest-CreateVolumesFromSnapshotTest-8387161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:02:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-bb4ded54-0da5-4e9f-b224-0c1fa11af3dd tempest-CreateVolumesFromSnapshotTest-8387161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:02:47 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-bb4ded54-0da5-4e9f-b224-0c1fa11af3dd tempest-CreateVolumesFromSnapshotTest-8387161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:02:47 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-bb4ded54-0da5-4e9f-b224-0c1fa11af3dd tempest-CreateVolumesFromSnapshotTest-8387161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:02:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-bb4ded54-0da5-4e9f-b224-0c1fa11af3dd tempest-CreateVolumesFromSnapshotTest-8387161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:02:47 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-bb4ded54-0da5-4e9f-b224-0c1fa11af3dd tempest-CreateVolumesFromSnapshotTest-8387161 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:02:47 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-bb4ded54-0da5-4e9f-b224-0c1fa11af3dd tempest-CreateVolumesFromSnapshotTest-8387161 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 12:02:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-bb4ded54-0da5-4e9f-b224-0c1fa11af3dd tempest-CreateVolumesFromSnapshotTest-8387161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-ac24b0f9-efdf-455e-b788-15f418a4c947 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:48 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4ee78cad-3d49-4cdd-8edf-ca5f2bf7e466 tempest-CreateVolumesFromSnapshotTest-8387161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5328b325-b241-43cd-97a8-7bae98983ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9d97979-643d-4c35-aab0-01752ed704ae', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:48 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4ee78cad-3d49-4cdd-8edf-ca5f2bf7e466 tempest-CreateVolumesFromSnapshotTest-8387161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f912711a-0bc7-4f7f-ab38-8334b1472872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:48 devstack sudo[107427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-ac24b0f9-efdf-455e-b788-15f418a4c947 1073741824 Sep 25 12:02:48 devstack sudo[107427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:48 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-4ee78cad-3d49-4cdd-8edf-ca5f2bf7e466 tempest-CreateVolumesFromSnapshotTest-8387161 None] Volume volume-e9d97979-643d-4c35-aab0-01752ed704ae (e9d97979-643d-4c35-aab0-01752ed704ae): created successfully Sep 25 12:02:48 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4ee78cad-3d49-4cdd-8edf-ca5f2bf7e466 tempest-CreateVolumesFromSnapshotTest-8387161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f912711a-0bc7-4f7f-ab38-8334b1472872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:48 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4ee78cad-3d49-4cdd-8edf-ca5f2bf7e466 tempest-CreateVolumesFromSnapshotTest-8387161 None] Flow 'volume_create_manager' (0328a50b-6b4c-460e-8eea-972b7182e267) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:02:48 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-4ee78cad-3d49-4cdd-8edf-ca5f2bf7e466 tempest-CreateVolumesFromSnapshotTest-8387161 None] Created volume successfully. Sep 25 12:02:48 devstack sudo[107422]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f76d2018-2803-4524-984d-6d2ab59b5328 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.395s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:48 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-f76d2018-2803-4524-984d-6d2ab59b5328 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:02:48 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-f76d2018-2803-4524-984d-6d2ab59b5328 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Deleted volume successfully. Sep 25 12:02:48 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f76d2018-2803-4524-984d-6d2ab59b5328 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Lock "cinder-77cfa6af-8391-439a-929d-945182ad08e7-delete_volume" released by "delete_volume" :: held 1.792s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:02:48 devstack sudo[107424]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6feb6a4f-818a-4fbd-93ab-e97b85311cfc tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1b510c88-8e12-4f4d-98fc-9c6be55a44e4_faw2xxkcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0fdb4b38-aa43-4941-9c52-0126df30b013" returned: 0 in 0.739s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:48 devstack cinder-volume[86984]: DEBUG cinder.image.image_utils [None req-6feb6a4f-818a-4fbd-93ab-e97b85311cfc tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1b510c88-8e12-4f4d-98fc-9c6be55a44e4_faw2xxkcdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0fdb4b38-aa43-4941-9c52-0126df30b013 {{(pid=86984) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 12:02:48 devstack cinder-volume[86984]: INFO cinder.image.image_utils [None req-6feb6a4f-818a-4fbd-93ab-e97b85311cfc tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] Converted 0.00 MB image at 0.00 MB/s Sep 25 12:02:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6feb6a4f-818a-4fbd-93ab-e97b85311cfc tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0fdb4b38-aa43-4941-9c52-0126df30b013 1G {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:48 devstack sudo[107437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0fdb4b38-aa43-4941-9c52-0126df30b013 1G Sep 25 12:02:48 devstack sudo[107437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:48 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-2788b7c4-51e9-4ea7-b5a3-3923e49ab5b5 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Acquiring lock "cinder-9a4dbb4c-b411-4193-954b-24f15e3be1b0-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:02:48 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-2788b7c4-51e9-4ea7-b5a3-3923e49ab5b5 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Lock "cinder-9a4dbb4c-b411-4193-954b-24f15e3be1b0-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:02:48 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-2788b7c4-51e9-4ea7-b5a3-3923e49ab5b5 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Acquiring lock "cinder-quobyte-9a4dbb4c-b411-4193-954b-24f15e3be1b0" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:02:48 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-2788b7c4-51e9-4ea7-b5a3-3923e49ab5b5 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Lock "cinder-quobyte-9a4dbb4c-b411-4193-954b-24f15e3be1b0" acquired by "delete_volume" :: waited 0.018s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:02:48 devstack sudo[107427]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-bb4ded54-0da5-4e9f-b224-0c1fa11af3dd tempest-CreateVolumesFromSnapshotTest-8387161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-ac24b0f9-efdf-455e-b788-15f418a4c947 1073741824" returned: 0 in 0.921s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:48 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[804c815c-1ab3-49f1-a23c-d8eb02fb0145]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:02:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2788b7c4-51e9-4ea7-b5a3-3923e49ab5b5 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9a4dbb4c-b411-4193-954b-24f15e3be1b0 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-bb4ded54-0da5-4e9f-b224-0c1fa11af3dd tempest-CreateVolumesFromSnapshotTest-8387161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-ac24b0f9-efdf-455e-b788-15f418a4c947 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:48 devstack sudo[107443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-ac24b0f9-efdf-455e-b788-15f418a4c947 Sep 25 12:02:48 devstack sudo[107443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:49 devstack sudo[107440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9a4dbb4c-b411-4193-954b-24f15e3be1b0 Sep 25 12:02:49 devstack sudo[107440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:49 devstack sudo[107437]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6feb6a4f-818a-4fbd-93ab-e97b85311cfc tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0fdb4b38-aa43-4941-9c52-0126df30b013 1G" returned: 0 in 0.540s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:49 devstack cinder-volume[86984]: DEBUG cinder.volume.volume_utils [None req-6feb6a4f-818a-4fbd-93ab-e97b85311cfc tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] Downloaded image 1b510c88-8e12-4f4d-98fc-9c6be55a44e4 ((None, [{'url': 'file:///opt/stack/data/glance/images/1b510c88-8e12-4f4d-98fc-9c6be55a44e4', 'metadata': {}}])) to volume 0fdb4b38-aa43-4941-9c52-0126df30b013 successfully. {{(pid=86984) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 12:02:49 devstack cinder-volume[86984]: DEBUG cinder.image.image_utils [None req-6feb6a4f-818a-4fbd-93ab-e97b85311cfc tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] Temporary image 1b510c88-8e12-4f4d-98fc-9c6be55a44e4 for user 0467a89c2d7e409eb0a06c03bc2618be is deleted. {{(pid=86984) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 12:02:49 devstack cinder-volume[86984]: DEBUG cinder.volume.volume_utils [None req-6feb6a4f-818a-4fbd-93ab-e97b85311cfc tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] Marking volume 0fdb4b38-aa43-4941-9c52-0126df30b013 as bootable. {{(pid=86984) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 12:02:49 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-6feb6a4f-818a-4fbd-93ab-e97b85311cfc tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] Copying metadata from image 1b510c88-8e12-4f4d-98fc-9c6be55a44e4 to 0fdb4b38-aa43-4941-9c52-0126df30b013. {{(pid=86984) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 12:02:49 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-6feb6a4f-818a-4fbd-93ab-e97b85311cfc tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] Creating volume glance metadata for volume 0fdb4b38-aa43-4941-9c52-0126df30b013 backed by image 1b510c88-8e12-4f4d-98fc-9c6be55a44e4 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '1b510c88-8e12-4f4d-98fc-9c6be55a44e4', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '58994f91a46186539421e58157d7b38b', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86984) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 12:02:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6feb6a4f-818a-4fbd-93ab-e97b85311cfc tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8881162f-d5c2-453e-b11e-6b920fcb2406) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fdb4b38-aa43-4941-9c52-0126df30b013', 'volume_size': 1, 'image_id': '1b510c88-8e12-4f4d-98fc-9c6be55a44e4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1b510c88-8e12-4f4d-98fc-9c6be55a44e4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '58994f91a46186539421e58157d7b38b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b7838c302a3f42699dc880bba25450a8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd2cdf2e5eaa254ac0e0b8a875a698b283ccb8fbc0a7b12be9598384321e6ae9580f7c10dd17e625da4de794c448f3b6a8bb2a87d09007c487828cc2d152fd707', 'id': '1b510c88-8e12-4f4d-98fc-9c6be55a44e4', 'created_at': datetime.datetime(2026, 9, 25, 10, 2, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 10, 2, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1b510c88-8e12-4f4d-98fc-9c6be55a44e4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6feb6a4f-818a-4fbd-93ab-e97b85311cfc tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e33327b9-267c-4cbf-9806-d1e58080edef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:49 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-6feb6a4f-818a-4fbd-93ab-e97b85311cfc tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] Volume volume-0fdb4b38-aa43-4941-9c52-0126df30b013 (0fdb4b38-aa43-4941-9c52-0126df30b013): created successfully Sep 25 12:02:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6feb6a4f-818a-4fbd-93ab-e97b85311cfc tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e33327b9-267c-4cbf-9806-d1e58080edef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:49 devstack sudo[107443]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-6feb6a4f-818a-4fbd-93ab-e97b85311cfc tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] Flow 'volume_create_manager' (11a4fdfe-6576-4dde-9408-56aab188a12a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:02:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-bb4ded54-0da5-4e9f-b224-0c1fa11af3dd tempest-CreateVolumesFromSnapshotTest-8387161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-ac24b0f9-efdf-455e-b788-15f418a4c947" returned: 0 in 0.369s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:49 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-bb4ded54-0da5-4e9f-b224-0c1fa11af3dd tempest-CreateVolumesFromSnapshotTest-8387161 None] <== create_volume: return (1367ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:02:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-bb4ded54-0da5-4e9f-b224-0c1fa11af3dd tempest-CreateVolumesFromSnapshotTest-8387161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.370s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:02:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-72b9acef-5930-4525-bd01-31c863c0d4df tempest-CreateVolumesFromSnapshotTest-8387161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.511s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:02:49 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-72b9acef-5930-4525-bd01-31c863c0d4df tempest-CreateVolumesFromSnapshotTest-8387161 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:02:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2136958741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2daff0cf-c5f9-45c3-b0a6-1c10731b1804,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e661ceae20fe43e39af28c2c73504034',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:02:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:02:43Z,use_quota=True,user_id='26579bfa5531475b99394665fc8138ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:02:49 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-72b9acef-5930-4525-bd01-31c863c0d4df tempest-CreateVolumesFromSnapshotTest-8387161 None] Creating volume 2daff0cf-c5f9-45c3-b0a6-1c10731b1804 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:02:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-72b9acef-5930-4525-bd01-31c863c0d4df tempest-CreateVolumesFromSnapshotTest-8387161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:02:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-72b9acef-5930-4525-bd01-31c863c0d4df tempest-CreateVolumesFromSnapshotTest-8387161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:02:49 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-72b9acef-5930-4525-bd01-31c863c0d4df tempest-CreateVolumesFromSnapshotTest-8387161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:02:49 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-72b9acef-5930-4525-bd01-31c863c0d4df tempest-CreateVolumesFromSnapshotTest-8387161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:02:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-72b9acef-5930-4525-bd01-31c863c0d4df tempest-CreateVolumesFromSnapshotTest-8387161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:02:49 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-72b9acef-5930-4525-bd01-31c863c0d4df tempest-CreateVolumesFromSnapshotTest-8387161 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:02:49 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-72b9acef-5930-4525-bd01-31c863c0d4df tempest-CreateVolumesFromSnapshotTest-8387161 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 12:02:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-72b9acef-5930-4525-bd01-31c863c0d4df tempest-CreateVolumesFromSnapshotTest-8387161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2daff0cf-c5f9-45c3-b0a6-1c10731b1804 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:49 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-6feb6a4f-818a-4fbd-93ab-e97b85311cfc tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] Created volume successfully. Sep 25 12:02:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-bb4ded54-0da5-4e9f-b224-0c1fa11af3dd tempest-CreateVolumesFromSnapshotTest-8387161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8b4d1f5-de6f-4b6a-956a-7dac9192b692) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac24b0f9-efdf-455e-b788-15f418a4c947', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:49 devstack sudo[107453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2daff0cf-c5f9-45c3-b0a6-1c10731b1804 1073741824 Sep 25 12:02:49 devstack sudo[107453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-bb4ded54-0da5-4e9f-b224-0c1fa11af3dd tempest-CreateVolumesFromSnapshotTest-8387161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff5ac9b4-7204-4144-93d1-d02211f71643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:49 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-bb4ded54-0da5-4e9f-b224-0c1fa11af3dd tempest-CreateVolumesFromSnapshotTest-8387161 None] Volume volume-ac24b0f9-efdf-455e-b788-15f418a4c947 (ac24b0f9-efdf-455e-b788-15f418a4c947): created successfully Sep 25 12:02:49 devstack sudo[107440]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-bb4ded54-0da5-4e9f-b224-0c1fa11af3dd tempest-CreateVolumesFromSnapshotTest-8387161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff5ac9b4-7204-4144-93d1-d02211f71643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-bb4ded54-0da5-4e9f-b224-0c1fa11af3dd tempest-CreateVolumesFromSnapshotTest-8387161 None] Flow 'volume_create_manager' (ad00209a-7b34-4d6d-875a-f6fbd0c373eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:02:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2788b7c4-51e9-4ea7-b5a3-3923e49ab5b5 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9a4dbb4c-b411-4193-954b-24f15e3be1b0" returned: 0 in 0.519s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2788b7c4-51e9-4ea7-b5a3-3923e49ab5b5 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9a4dbb4c-b411-4193-954b-24f15e3be1b0 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:49 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-bb4ded54-0da5-4e9f-b224-0c1fa11af3dd tempest-CreateVolumesFromSnapshotTest-8387161 None] Created volume successfully. Sep 25 12:02:49 devstack sudo[107455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9a4dbb4c-b411-4193-954b-24f15e3be1b0 Sep 25 12:02:49 devstack sudo[107455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:49 devstack sudo[107455]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2788b7c4-51e9-4ea7-b5a3-3923e49ab5b5 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9a4dbb4c-b411-4193-954b-24f15e3be1b0" returned: 0 in 0.329s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:49 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-2788b7c4-51e9-4ea7-b5a3-3923e49ab5b5 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Lock "cinder-quobyte-9a4dbb4c-b411-4193-954b-24f15e3be1b0" released by "delete_volume" :: held 0.913s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:02:49 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-2788b7c4-51e9-4ea7-b5a3-3923e49ab5b5 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Created reservations ['79d80e36-ee21-4da9-8167-86332772e330', 'f4951f65-3719-43f6-82d2-c40c1fa0081c', 'b4ba6bf0-511b-464c-be3f-698894cf48b3', 'bc06e240-b4b0-4f5a-a299-5d2f20a23d59'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:02:49 devstack sudo[107453]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-72b9acef-5930-4525-bd01-31c863c0d4df tempest-CreateVolumesFromSnapshotTest-8387161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2daff0cf-c5f9-45c3-b0a6-1c10731b1804 1073741824" returned: 0 in 0.656s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-2788b7c4-51e9-4ea7-b5a3-3923e49ab5b5 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:02:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-2788b7c4-51e9-4ea7-b5a3-3923e49ab5b5 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:02:50 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-2788b7c4-51e9-4ea7-b5a3-3923e49ab5b5 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:02:50 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-2788b7c4-51e9-4ea7-b5a3-3923e49ab5b5 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:02:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-2788b7c4-51e9-4ea7-b5a3-3923e49ab5b5 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:02:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2788b7c4-51e9-4ea7-b5a3-3923e49ab5b5 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:50 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f4f2ff29-0af3-487e-b19a-57ab9c2c8a7b tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] Acquiring lock "cinder-0fdb4b38-aa43-4941-9c52-0126df30b013-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:02:50 devstack sudo[107462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 12:02:50 devstack sudo[107462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:50 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f4f2ff29-0af3-487e-b19a-57ab9c2c8a7b tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] Lock "cinder-0fdb4b38-aa43-4941-9c52-0126df30b013-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:02:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-72b9acef-5930-4525-bd01-31c863c0d4df tempest-CreateVolumesFromSnapshotTest-8387161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2daff0cf-c5f9-45c3-b0a6-1c10731b1804 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:50 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f4f2ff29-0af3-487e-b19a-57ab9c2c8a7b tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] Acquiring lock "cinder-quobyte-0fdb4b38-aa43-4941-9c52-0126df30b013" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:02:50 devstack sudo[107464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2daff0cf-c5f9-45c3-b0a6-1c10731b1804 Sep 25 12:02:50 devstack sudo[107464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:50 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f4f2ff29-0af3-487e-b19a-57ab9c2c8a7b tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] Lock "cinder-quobyte-0fdb4b38-aa43-4941-9c52-0126df30b013" acquired by "delete_volume" :: waited 0.037s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:02:50 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd3d2339-3e47-4382-bc17-bd678a2cb1b0]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:02:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f4f2ff29-0af3-487e-b19a-57ab9c2c8a7b tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0fdb4b38-aa43-4941-9c52-0126df30b013 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:50 devstack sudo[107462]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2788b7c4-51e9-4ea7-b5a3-3923e49ab5b5 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.316s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:50 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-2788b7c4-51e9-4ea7-b5a3-3923e49ab5b5 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:02:50 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-2788b7c4-51e9-4ea7-b5a3-3923e49ab5b5 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Deleted volume successfully. Sep 25 12:02:50 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-2788b7c4-51e9-4ea7-b5a3-3923e49ab5b5 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Lock "cinder-9a4dbb4c-b411-4193-954b-24f15e3be1b0-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:02:50 devstack sudo[107466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0fdb4b38-aa43-4941-9c52-0126df30b013 Sep 25 12:02:50 devstack sudo[107466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:50 devstack sudo[107464]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-72b9acef-5930-4525-bd01-31c863c0d4df tempest-CreateVolumesFromSnapshotTest-8387161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2daff0cf-c5f9-45c3-b0a6-1c10731b1804" returned: 0 in 0.382s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:50 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-72b9acef-5930-4525-bd01-31c863c0d4df tempest-CreateVolumesFromSnapshotTest-8387161 None] <== create_volume: return (1169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:02:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-72b9acef-5930-4525-bd01-31c863c0d4df tempest-CreateVolumesFromSnapshotTest-8387161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.172s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:02:50 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-72b9acef-5930-4525-bd01-31c863c0d4df tempest-CreateVolumesFromSnapshotTest-8387161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38e5df95-2b01-4be7-adf5-d219a31ebb09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2daff0cf-c5f9-45c3-b0a6-1c10731b1804', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:50 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-72b9acef-5930-4525-bd01-31c863c0d4df tempest-CreateVolumesFromSnapshotTest-8387161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55210b1e-1fbf-4907-b436-f2a10d6a7aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:02:50 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-72b9acef-5930-4525-bd01-31c863c0d4df tempest-CreateVolumesFromSnapshotTest-8387161 None] Volume volume-2daff0cf-c5f9-45c3-b0a6-1c10731b1804 (2daff0cf-c5f9-45c3-b0a6-1c10731b1804): created successfully Sep 25 12:02:50 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-72b9acef-5930-4525-bd01-31c863c0d4df tempest-CreateVolumesFromSnapshotTest-8387161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55210b1e-1fbf-4907-b436-f2a10d6a7aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:02:50 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-72b9acef-5930-4525-bd01-31c863c0d4df tempest-CreateVolumesFromSnapshotTest-8387161 None] Flow 'volume_create_manager' (55141287-5eec-4d81-a02b-300d08b24bbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:02:50 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-72b9acef-5930-4525-bd01-31c863c0d4df tempest-CreateVolumesFromSnapshotTest-8387161 None] Created volume successfully. Sep 25 12:02:50 devstack sudo[107466]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:50 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-debba0c9-6b70-487b-8ce9-70037b33223f tempest-CreateVolumesFromSnapshotTest-8387161 None] Acquiring lock "cinder-2daff0cf-c5f9-45c3-b0a6-1c10731b1804-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:02:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f4f2ff29-0af3-487e-b19a-57ab9c2c8a7b tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0fdb4b38-aa43-4941-9c52-0126df30b013" returned: 0 in 0.496s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f4f2ff29-0af3-487e-b19a-57ab9c2c8a7b tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0fdb4b38-aa43-4941-9c52-0126df30b013 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:50 devstack sudo[107473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0fdb4b38-aa43-4941-9c52-0126df30b013 Sep 25 12:02:50 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-debba0c9-6b70-487b-8ce9-70037b33223f tempest-CreateVolumesFromSnapshotTest-8387161 None] Lock "cinder-2daff0cf-c5f9-45c3-b0a6-1c10731b1804-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:02:50 devstack sudo[107473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:50 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-debba0c9-6b70-487b-8ce9-70037b33223f tempest-CreateVolumesFromSnapshotTest-8387161 None] Acquiring lock "cinder-quobyte-2daff0cf-c5f9-45c3-b0a6-1c10731b1804" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:02:50 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-debba0c9-6b70-487b-8ce9-70037b33223f tempest-CreateVolumesFromSnapshotTest-8387161 None] Lock "cinder-quobyte-2daff0cf-c5f9-45c3-b0a6-1c10731b1804" acquired by "delete_volume" :: waited 0.018s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:02:50 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[af5625ed-fc36-47df-b190-ea136ea8e0b1]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:02:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-debba0c9-6b70-487b-8ce9-70037b33223f tempest-CreateVolumesFromSnapshotTest-8387161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2daff0cf-c5f9-45c3-b0a6-1c10731b1804 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:51 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-89f407ce-351a-48f0-ac07-0ba020936d26 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Acquiring lock "cinder-b841a145-1edd-43c3-8719-47b72a343ed5-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:02:51 devstack sudo[107475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2daff0cf-c5f9-45c3-b0a6-1c10731b1804 Sep 25 12:02:51 devstack sudo[107475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:51 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-89f407ce-351a-48f0-ac07-0ba020936d26 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Lock "cinder-b841a145-1edd-43c3-8719-47b72a343ed5-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:02:51 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-89f407ce-351a-48f0-ac07-0ba020936d26 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Acquiring lock "cinder-quobyte-b841a145-1edd-43c3-8719-47b72a343ed5" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:02:51 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-89f407ce-351a-48f0-ac07-0ba020936d26 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Lock "cinder-quobyte-b841a145-1edd-43c3-8719-47b72a343ed5" acquired by "delete_volume" :: waited 0.021s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:02:51 devstack sudo[107473]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f4f2ff29-0af3-487e-b19a-57ab9c2c8a7b tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0fdb4b38-aa43-4941-9c52-0126df30b013" returned: 0 in 0.415s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:51 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f4f2ff29-0af3-487e-b19a-57ab9c2c8a7b tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] Lock "cinder-quobyte-0fdb4b38-aa43-4941-9c52-0126df30b013" released by "delete_volume" :: held 0.978s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:02:51 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[c978ea1e-666e-4243-aeec-49b1a048b798]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:02:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-89f407ce-351a-48f0-ac07-0ba020936d26 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b841a145-1edd-43c3-8719-47b72a343ed5 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:51 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-f4f2ff29-0af3-487e-b19a-57ab9c2c8a7b tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] Created reservations ['ce262223-74ac-44ed-95db-390e27843747', '4c36e052-7eb5-47ae-9576-af136f7a0e2e', 'c687df2a-8ac4-4569-a958-3a72a4a0d31b', '01ee102c-ecab-4ab9-a5c3-86a1e8fd1a76'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:02:51 devstack sudo[107478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b841a145-1edd-43c3-8719-47b72a343ed5 Sep 25 12:02:51 devstack sudo[107478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f4f2ff29-0af3-487e-b19a-57ab9c2c8a7b tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:02:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f4f2ff29-0af3-487e-b19a-57ab9c2c8a7b tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:02:51 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-f4f2ff29-0af3-487e-b19a-57ab9c2c8a7b tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:02:51 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-f4f2ff29-0af3-487e-b19a-57ab9c2c8a7b tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:02:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f4f2ff29-0af3-487e-b19a-57ab9c2c8a7b tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:02:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f4f2ff29-0af3-487e-b19a-57ab9c2c8a7b tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:51 devstack sudo[107483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 12:02:51 devstack sudo[107483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:51 devstack sudo[107475]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-debba0c9-6b70-487b-8ce9-70037b33223f tempest-CreateVolumesFromSnapshotTest-8387161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2daff0cf-c5f9-45c3-b0a6-1c10731b1804" returned: 0 in 0.576s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-debba0c9-6b70-487b-8ce9-70037b33223f tempest-CreateVolumesFromSnapshotTest-8387161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2daff0cf-c5f9-45c3-b0a6-1c10731b1804 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:51 devstack sudo[107485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2daff0cf-c5f9-45c3-b0a6-1c10731b1804 Sep 25 12:02:51 devstack sudo[107485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:51 devstack sudo[107478]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-89f407ce-351a-48f0-ac07-0ba020936d26 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b841a145-1edd-43c3-8719-47b72a343ed5" returned: 0 in 0.609s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-89f407ce-351a-48f0-ac07-0ba020936d26 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b841a145-1edd-43c3-8719-47b72a343ed5 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:51 devstack sudo[107492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b841a145-1edd-43c3-8719-47b72a343ed5 Sep 25 12:02:51 devstack sudo[107492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:51 devstack sudo[107485]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-debba0c9-6b70-487b-8ce9-70037b33223f tempest-CreateVolumesFromSnapshotTest-8387161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2daff0cf-c5f9-45c3-b0a6-1c10731b1804" returned: 0 in 0.392s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:51 devstack sudo[107483]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f4f2ff29-0af3-487e-b19a-57ab9c2c8a7b tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.503s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:51 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-f4f2ff29-0af3-487e-b19a-57ab9c2c8a7b tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:02:51 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-f4f2ff29-0af3-487e-b19a-57ab9c2c8a7b tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] Deleted volume successfully. Sep 25 12:02:51 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-debba0c9-6b70-487b-8ce9-70037b33223f tempest-CreateVolumesFromSnapshotTest-8387161 None] Lock "cinder-quobyte-2daff0cf-c5f9-45c3-b0a6-1c10731b1804" released by "delete_volume" :: held 1.072s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:02:51 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f4f2ff29-0af3-487e-b19a-57ab9c2c8a7b tempest-VolumeAndVolumeTypeFromImageTest-2097172627 None] Lock "cinder-0fdb4b38-aa43-4941-9c52-0126df30b013-delete_volume" released by "delete_volume" :: held 1.892s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:02:52 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-debba0c9-6b70-487b-8ce9-70037b33223f tempest-CreateVolumesFromSnapshotTest-8387161 None] Created reservations ['576a19e1-ba97-42d5-a2bc-1c3de0c35b15', '1b737167-b6aa-483c-9288-88a35a8b082e', '7aaba246-5e93-4089-a188-9da316fd9d73', 'ec5433db-3249-4350-9da6-a7d8928b0a60'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:02:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-debba0c9-6b70-487b-8ce9-70037b33223f tempest-CreateVolumesFromSnapshotTest-8387161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:02:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-debba0c9-6b70-487b-8ce9-70037b33223f tempest-CreateVolumesFromSnapshotTest-8387161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:02:52 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-debba0c9-6b70-487b-8ce9-70037b33223f tempest-CreateVolumesFromSnapshotTest-8387161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:02:52 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-debba0c9-6b70-487b-8ce9-70037b33223f tempest-CreateVolumesFromSnapshotTest-8387161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:02:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-debba0c9-6b70-487b-8ce9-70037b33223f tempest-CreateVolumesFromSnapshotTest-8387161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:02:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-debba0c9-6b70-487b-8ce9-70037b33223f tempest-CreateVolumesFromSnapshotTest-8387161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:52 devstack sudo[107492]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-89f407ce-351a-48f0-ac07-0ba020936d26 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-b841a145-1edd-43c3-8719-47b72a343ed5" returned: 0 in 0.478s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:52 devstack sudo[107495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 12:02:52 devstack sudo[107495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:52 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-89f407ce-351a-48f0-ac07-0ba020936d26 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Lock "cinder-quobyte-b841a145-1edd-43c3-8719-47b72a343ed5" released by "delete_volume" :: held 1.151s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:02:52 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-89f407ce-351a-48f0-ac07-0ba020936d26 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Created reservations ['5a3e3c99-52e3-4070-b637-4656fa710be2', '2b387666-cb51-4b64-af63-2035b51d7014', 'a5a8400d-4cc6-4bd8-baac-ceb858b08ab3', '1539a49e-71bf-488d-9b32-8e0c09fbb46e'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:02:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-89f407ce-351a-48f0-ac07-0ba020936d26 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:02:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-89f407ce-351a-48f0-ac07-0ba020936d26 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:02:52 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-89f407ce-351a-48f0-ac07-0ba020936d26 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:02:52 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-89f407ce-351a-48f0-ac07-0ba020936d26 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:02:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-89f407ce-351a-48f0-ac07-0ba020936d26 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:02:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-89f407ce-351a-48f0-ac07-0ba020936d26 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:52 devstack sudo[107497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 12:02:52 devstack sudo[107497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:52 devstack sudo[107495]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-debba0c9-6b70-487b-8ce9-70037b33223f tempest-CreateVolumesFromSnapshotTest-8387161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.405s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:52 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-debba0c9-6b70-487b-8ce9-70037b33223f tempest-CreateVolumesFromSnapshotTest-8387161 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:02:52 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-debba0c9-6b70-487b-8ce9-70037b33223f tempest-CreateVolumesFromSnapshotTest-8387161 None] Deleted volume successfully. Sep 25 12:02:52 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-debba0c9-6b70-487b-8ce9-70037b33223f tempest-CreateVolumesFromSnapshotTest-8387161 None] Lock "cinder-2daff0cf-c5f9-45c3-b0a6-1c10731b1804-delete_volume" released by "delete_volume" :: held 1.924s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:02:52 devstack sudo[107497]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-89f407ce-351a-48f0-ac07-0ba020936d26 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.350s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:52 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-89f407ce-351a-48f0-ac07-0ba020936d26 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:02:52 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-89f407ce-351a-48f0-ac07-0ba020936d26 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Deleted volume successfully. Sep 25 12:02:52 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-89f407ce-351a-48f0-ac07-0ba020936d26 tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Lock "cinder-b841a145-1edd-43c3-8719-47b72a343ed5-delete_volume" released by "delete_volume" :: held 1.868s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:02:53 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-7416515d-c422-4e3b-8b7c-f85055e568ae tempest-CreateVolumesFromSnapshotTest-8387161 None] Acquiring lock "cinder-ac24b0f9-efdf-455e-b788-15f418a4c947-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:02:53 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-7416515d-c422-4e3b-8b7c-f85055e568ae tempest-CreateVolumesFromSnapshotTest-8387161 None] Lock "cinder-ac24b0f9-efdf-455e-b788-15f418a4c947-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:02:53 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-7416515d-c422-4e3b-8b7c-f85055e568ae tempest-CreateVolumesFromSnapshotTest-8387161 None] Acquiring lock "cinder-quobyte-ac24b0f9-efdf-455e-b788-15f418a4c947" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:02:53 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-7416515d-c422-4e3b-8b7c-f85055e568ae tempest-CreateVolumesFromSnapshotTest-8387161 None] Lock "cinder-quobyte-ac24b0f9-efdf-455e-b788-15f418a4c947" acquired by "delete_volume" :: waited 0.039s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:02:53 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[4153c7a4-efea-4a98-83ad-02e694066e40]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:02:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7416515d-c422-4e3b-8b7c-f85055e568ae tempest-CreateVolumesFromSnapshotTest-8387161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-ac24b0f9-efdf-455e-b788-15f418a4c947 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:53 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-4093ce2c-211c-48f9-9e9d-86ff59ed0cea tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Acquiring lock "cinder-7fa04036-b6c6-4b43-b142-78126b238d00-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:02:53 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-4093ce2c-211c-48f9-9e9d-86ff59ed0cea tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Lock "cinder-7fa04036-b6c6-4b43-b142-78126b238d00-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:02:53 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-4093ce2c-211c-48f9-9e9d-86ff59ed0cea tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Acquiring lock "cinder-quobyte-7fa04036-b6c6-4b43-b142-78126b238d00" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:02:53 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-4093ce2c-211c-48f9-9e9d-86ff59ed0cea tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Lock "cinder-quobyte-7fa04036-b6c6-4b43-b142-78126b238d00" acquired by "delete_volume" :: waited 0.045s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:02:53 devstack sudo[107501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-ac24b0f9-efdf-455e-b788-15f418a4c947 Sep 25 12:02:53 devstack sudo[107501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:53 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[d59ff81f-1796-416d-b499-0302a9a4ba3e]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:02:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-4093ce2c-211c-48f9-9e9d-86ff59ed0cea tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7fa04036-b6c6-4b43-b142-78126b238d00 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:53 devstack sudo[107503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7fa04036-b6c6-4b43-b142-78126b238d00 Sep 25 12:02:53 devstack sudo[107503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:54 devstack sudo[107501]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7416515d-c422-4e3b-8b7c-f85055e568ae tempest-CreateVolumesFromSnapshotTest-8387161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-ac24b0f9-efdf-455e-b788-15f418a4c947" returned: 0 in 0.626s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7416515d-c422-4e3b-8b7c-f85055e568ae tempest-CreateVolumesFromSnapshotTest-8387161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-ac24b0f9-efdf-455e-b788-15f418a4c947 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:54 devstack sudo[107509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-ac24b0f9-efdf-455e-b788-15f418a4c947 Sep 25 12:02:54 devstack sudo[107509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:54 devstack sudo[107503]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-4093ce2c-211c-48f9-9e9d-86ff59ed0cea tempest-CreateVolumesFromSourceVolumeTest-485866238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7fa04036-b6c6-4b43-b142-78126b238d00" returned: 0 in 0.560s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-4093ce2c-211c-48f9-9e9d-86ff59ed0cea tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7fa04036-b6c6-4b43-b142-78126b238d00 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:54 devstack sudo[107514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7fa04036-b6c6-4b43-b142-78126b238d00 Sep 25 12:02:54 devstack sudo[107514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:54 devstack sudo[107509]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7416515d-c422-4e3b-8b7c-f85055e568ae tempest-CreateVolumesFromSnapshotTest-8387161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-ac24b0f9-efdf-455e-b788-15f418a4c947" returned: 0 in 0.473s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:54 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-7416515d-c422-4e3b-8b7c-f85055e568ae tempest-CreateVolumesFromSnapshotTest-8387161 None] Lock "cinder-quobyte-ac24b0f9-efdf-455e-b788-15f418a4c947" released by "delete_volume" :: held 1.176s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:02:54 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-7416515d-c422-4e3b-8b7c-f85055e568ae tempest-CreateVolumesFromSnapshotTest-8387161 None] Created reservations ['df443a64-78c4-4b24-9062-ba5fb17a444e', '1a180efe-793c-4c63-964f-cf0006213ced', 'f93743d0-533b-445b-9016-de833edd14d1', 'b4d42545-0e42-47a4-a638-0b9220112544'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:02:54 devstack sudo[107514]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-4093ce2c-211c-48f9-9e9d-86ff59ed0cea tempest-CreateVolumesFromSourceVolumeTest-485866238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7fa04036-b6c6-4b43-b142-78126b238d00" returned: 0 in 0.463s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:54 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-4093ce2c-211c-48f9-9e9d-86ff59ed0cea tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Lock "cinder-quobyte-7fa04036-b6c6-4b43-b142-78126b238d00" released by "delete_volume" :: held 1.125s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:02:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-7416515d-c422-4e3b-8b7c-f85055e568ae tempest-CreateVolumesFromSnapshotTest-8387161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:02:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-7416515d-c422-4e3b-8b7c-f85055e568ae tempest-CreateVolumesFromSnapshotTest-8387161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:02:54 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-7416515d-c422-4e3b-8b7c-f85055e568ae tempest-CreateVolumesFromSnapshotTest-8387161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:02:54 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-7416515d-c422-4e3b-8b7c-f85055e568ae tempest-CreateVolumesFromSnapshotTest-8387161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:02:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-7416515d-c422-4e3b-8b7c-f85055e568ae tempest-CreateVolumesFromSnapshotTest-8387161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:02:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7416515d-c422-4e3b-8b7c-f85055e568ae tempest-CreateVolumesFromSnapshotTest-8387161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:54 devstack sudo[107518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 12:02:54 devstack sudo[107518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:54 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-4093ce2c-211c-48f9-9e9d-86ff59ed0cea tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Created reservations ['fbbd8ce5-7ec4-43b5-97e5-01df075cc1f6', '0452f85d-9dce-46c1-b45a-96956162c9bc', 'b2ce28f2-cdba-4892-933b-a1bd311cb937', '23b89696-b8a9-44e2-b52f-adbd456cd689'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:02:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-4093ce2c-211c-48f9-9e9d-86ff59ed0cea tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:02:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-4093ce2c-211c-48f9-9e9d-86ff59ed0cea tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:02:55 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-4093ce2c-211c-48f9-9e9d-86ff59ed0cea tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:02:55 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-4093ce2c-211c-48f9-9e9d-86ff59ed0cea tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:02:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-4093ce2c-211c-48f9-9e9d-86ff59ed0cea tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:02:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-4093ce2c-211c-48f9-9e9d-86ff59ed0cea tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:55 devstack sudo[107520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 12:02:55 devstack sudo[107520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:55 devstack sudo[107518]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7416515d-c422-4e3b-8b7c-f85055e568ae tempest-CreateVolumesFromSnapshotTest-8387161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.486s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:55 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-7416515d-c422-4e3b-8b7c-f85055e568ae tempest-CreateVolumesFromSnapshotTest-8387161 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:02:55 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-7416515d-c422-4e3b-8b7c-f85055e568ae tempest-CreateVolumesFromSnapshotTest-8387161 None] Deleted volume successfully. Sep 25 12:02:55 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-7416515d-c422-4e3b-8b7c-f85055e568ae tempest-CreateVolumesFromSnapshotTest-8387161 None] Lock "cinder-ac24b0f9-efdf-455e-b788-15f418a4c947-delete_volume" released by "delete_volume" :: held 2.185s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:02:55 devstack sudo[107520]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-4093ce2c-211c-48f9-9e9d-86ff59ed0cea tempest-CreateVolumesFromSourceVolumeTest-485866238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.456s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:55 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-4093ce2c-211c-48f9-9e9d-86ff59ed0cea tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:02:55 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-4093ce2c-211c-48f9-9e9d-86ff59ed0cea tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Deleted volume successfully. Sep 25 12:02:55 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-4093ce2c-211c-48f9-9e9d-86ff59ed0cea tempest-CreateVolumesFromSourceVolumeTest-485866238 None] Lock "cinder-7fa04036-b6c6-4b43-b142-78126b238d00-delete_volume" released by "delete_volume" :: held 2.127s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:02:55 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-7f18e5e2-5e00-4848-bd8a-29ba5688e8f5 tempest-CreateVolumesFromSnapshotTest-8387161 None] Acquiring lock "cinder-e9d97979-643d-4c35-aab0-01752ed704ae-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:02:55 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-7f18e5e2-5e00-4848-bd8a-29ba5688e8f5 tempest-CreateVolumesFromSnapshotTest-8387161 None] Lock "cinder-e9d97979-643d-4c35-aab0-01752ed704ae-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:02:55 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-7f18e5e2-5e00-4848-bd8a-29ba5688e8f5 tempest-CreateVolumesFromSnapshotTest-8387161 None] Acquiring lock "cinder-quobyte-e9d97979-643d-4c35-aab0-01752ed704ae" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:02:55 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-7f18e5e2-5e00-4848-bd8a-29ba5688e8f5 tempest-CreateVolumesFromSnapshotTest-8387161 None] Lock "cinder-quobyte-e9d97979-643d-4c35-aab0-01752ed704ae" acquired by "delete_volume" :: waited 0.020s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:02:55 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d29cb3-b554-473f-891f-6c9281f22076]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:02:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7f18e5e2-5e00-4848-bd8a-29ba5688e8f5 tempest-CreateVolumesFromSnapshotTest-8387161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-e9d97979-643d-4c35-aab0-01752ed704ae {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:56 devstack sudo[107524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-e9d97979-643d-4c35-aab0-01752ed704ae Sep 25 12:02:56 devstack sudo[107524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:56 devstack sudo[107524]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:56 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7f18e5e2-5e00-4848-bd8a-29ba5688e8f5 tempest-CreateVolumesFromSnapshotTest-8387161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-e9d97979-643d-4c35-aab0-01752ed704ae" returned: 0 in 0.566s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:56 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7f18e5e2-5e00-4848-bd8a-29ba5688e8f5 tempest-CreateVolumesFromSnapshotTest-8387161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-e9d97979-643d-4c35-aab0-01752ed704ae {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:56 devstack sudo[107529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-e9d97979-643d-4c35-aab0-01752ed704ae Sep 25 12:02:56 devstack sudo[107529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:56 devstack sudo[107529]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:56 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7f18e5e2-5e00-4848-bd8a-29ba5688e8f5 tempest-CreateVolumesFromSnapshotTest-8387161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-e9d97979-643d-4c35-aab0-01752ed704ae" returned: 0 in 0.395s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:56 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-7f18e5e2-5e00-4848-bd8a-29ba5688e8f5 tempest-CreateVolumesFromSnapshotTest-8387161 None] Lock "cinder-quobyte-e9d97979-643d-4c35-aab0-01752ed704ae" released by "delete_volume" :: held 1.050s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:02:56 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-7f18e5e2-5e00-4848-bd8a-29ba5688e8f5 tempest-CreateVolumesFromSnapshotTest-8387161 None] Created reservations ['44e1f028-31fd-4a97-a99e-9f8f443d53a3', '2cc62141-1319-4322-98e0-b63213093fb8', '05d66812-f3bc-4003-b7b8-44d759e8e42f', '84aa6722-0bb4-48f1-9403-f8192f4b70b0'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:02:57 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-7f18e5e2-5e00-4848-bd8a-29ba5688e8f5 tempest-CreateVolumesFromSnapshotTest-8387161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:02:57 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-7f18e5e2-5e00-4848-bd8a-29ba5688e8f5 tempest-CreateVolumesFromSnapshotTest-8387161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:02:57 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-7f18e5e2-5e00-4848-bd8a-29ba5688e8f5 tempest-CreateVolumesFromSnapshotTest-8387161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:02:57 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-7f18e5e2-5e00-4848-bd8a-29ba5688e8f5 tempest-CreateVolumesFromSnapshotTest-8387161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:02:57 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-7f18e5e2-5e00-4848-bd8a-29ba5688e8f5 tempest-CreateVolumesFromSnapshotTest-8387161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:02:57 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7f18e5e2-5e00-4848-bd8a-29ba5688e8f5 tempest-CreateVolumesFromSnapshotTest-8387161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:57 devstack sudo[107532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 12:02:57 devstack sudo[107532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:57 devstack sudo[107532]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:57 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7f18e5e2-5e00-4848-bd8a-29ba5688e8f5 tempest-CreateVolumesFromSnapshotTest-8387161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.366s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:57 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-7f18e5e2-5e00-4848-bd8a-29ba5688e8f5 tempest-CreateVolumesFromSnapshotTest-8387161 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:02:57 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-7f18e5e2-5e00-4848-bd8a-29ba5688e8f5 tempest-CreateVolumesFromSnapshotTest-8387161 None] Deleted volume successfully. Sep 25 12:02:57 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-7f18e5e2-5e00-4848-bd8a-29ba5688e8f5 tempest-CreateVolumesFromSnapshotTest-8387161 None] Lock "cinder-e9d97979-643d-4c35-aab0-01752ed704ae-delete_volume" released by "delete_volume" :: held 1.804s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:02:58 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-1230b0d0-273e-4a0a-a0a3-cb9745c62312 tempest-CreateVolumesFromSnapshotTest-8387161 None] Acquiring lock "cinder-ecdc6d55-442a-4763-a756-f8073b91f109-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:02:58 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-1230b0d0-273e-4a0a-a0a3-cb9745c62312 tempest-CreateVolumesFromSnapshotTest-8387161 None] Lock "cinder-ecdc6d55-442a-4763-a756-f8073b91f109-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:02:58 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-1230b0d0-273e-4a0a-a0a3-cb9745c62312 tempest-CreateVolumesFromSnapshotTest-8387161 None] Acquiring lock "cinder-quobyte-ecdc6d55-442a-4763-a756-f8073b91f109" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:02:58 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-1230b0d0-273e-4a0a-a0a3-cb9745c62312 tempest-CreateVolumesFromSnapshotTest-8387161 None] Lock "cinder-quobyte-ecdc6d55-442a-4763-a756-f8073b91f109" acquired by "delete_volume" :: waited 0.032s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:02:58 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe7c4b8-b7a2-4f18-81ce-87f6f4ee2d12]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:02:58 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-1230b0d0-273e-4a0a-a0a3-cb9745c62312 tempest-CreateVolumesFromSnapshotTest-8387161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-ecdc6d55-442a-4763-a756-f8073b91f109 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:58 devstack sudo[107571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-ecdc6d55-442a-4763-a756-f8073b91f109 Sep 25 12:02:58 devstack sudo[107571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:58 devstack sudo[107571]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:58 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-1230b0d0-273e-4a0a-a0a3-cb9745c62312 tempest-CreateVolumesFromSnapshotTest-8387161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-ecdc6d55-442a-4763-a756-f8073b91f109" returned: 0 in 0.641s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:58 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-1230b0d0-273e-4a0a-a0a3-cb9745c62312 tempest-CreateVolumesFromSnapshotTest-8387161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-ecdc6d55-442a-4763-a756-f8073b91f109 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:59 devstack sudo[107576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-ecdc6d55-442a-4763-a756-f8073b91f109 Sep 25 12:02:59 devstack sudo[107576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:02:59 devstack sudo[107576]: pam_unix(sudo:session): session closed for user root Sep 25 12:02:59 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-1230b0d0-273e-4a0a-a0a3-cb9745c62312 tempest-CreateVolumesFromSnapshotTest-8387161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-ecdc6d55-442a-4763-a756-f8073b91f109" returned: 0 in 0.556s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:02:59 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-1230b0d0-273e-4a0a-a0a3-cb9745c62312 tempest-CreateVolumesFromSnapshotTest-8387161 None] Lock "cinder-quobyte-ecdc6d55-442a-4763-a756-f8073b91f109" released by "delete_volume" :: held 1.289s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:02:59 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-1230b0d0-273e-4a0a-a0a3-cb9745c62312 tempest-CreateVolumesFromSnapshotTest-8387161 None] Created reservations ['3007733e-34d0-4105-9acd-6ae888f0a1a1', '3baa8cae-f6bc-43b4-88e7-8081bc27f7db', '64794e5d-d03d-4a10-b2d8-3e6726334183', '963d17fb-a661-4049-8a45-b3da99304883'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:02:59 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-1230b0d0-273e-4a0a-a0a3-cb9745c62312 tempest-CreateVolumesFromSnapshotTest-8387161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:02:59 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-1230b0d0-273e-4a0a-a0a3-cb9745c62312 tempest-CreateVolumesFromSnapshotTest-8387161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:02:59 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-1230b0d0-273e-4a0a-a0a3-cb9745c62312 tempest-CreateVolumesFromSnapshotTest-8387161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:02:59 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-1230b0d0-273e-4a0a-a0a3-cb9745c62312 tempest-CreateVolumesFromSnapshotTest-8387161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:02:59 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-1230b0d0-273e-4a0a-a0a3-cb9745c62312 tempest-CreateVolumesFromSnapshotTest-8387161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:02:59 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-1230b0d0-273e-4a0a-a0a3-cb9745c62312 tempest-CreateVolumesFromSnapshotTest-8387161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:02:59 devstack sudo[107579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 12:02:59 devstack sudo[107579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:00 devstack sudo[107579]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:00 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-1230b0d0-273e-4a0a-a0a3-cb9745c62312 tempest-CreateVolumesFromSnapshotTest-8387161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.395s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:00 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-1230b0d0-273e-4a0a-a0a3-cb9745c62312 tempest-CreateVolumesFromSnapshotTest-8387161 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:03:00 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-1230b0d0-273e-4a0a-a0a3-cb9745c62312 tempest-CreateVolumesFromSnapshotTest-8387161 None] Deleted volume successfully. Sep 25 12:03:00 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-1230b0d0-273e-4a0a-a0a3-cb9745c62312 tempest-CreateVolumesFromSnapshotTest-8387161 None] Lock "cinder-ecdc6d55-442a-4763-a756-f8073b91f109-delete_volume" released by "delete_volume" :: held 2.090s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:03:00 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-3914e1c3-f823-41de-9115-348d7a855e37 tempest-CreateVolumesFromSnapshotTest-8387161 None] Acquiring lock "cinder-540afb0e-55c1-493b-a281-ed3ef0312467-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:03:00 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-3914e1c3-f823-41de-9115-348d7a855e37 tempest-CreateVolumesFromSnapshotTest-8387161 None] Lock "cinder-540afb0e-55c1-493b-a281-ed3ef0312467-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:03:00 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-3914e1c3-f823-41de-9115-348d7a855e37 tempest-CreateVolumesFromSnapshotTest-8387161 None] Acquiring lock "cinder-quobyte-540afb0e-55c1-493b-a281-ed3ef0312467" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:03:00 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-3914e1c3-f823-41de-9115-348d7a855e37 tempest-CreateVolumesFromSnapshotTest-8387161 None] Lock "cinder-quobyte-540afb0e-55c1-493b-a281-ed3ef0312467" acquired by "delete_volume" :: waited 0.028s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:03:00 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4795aac-f0bb-4a5a-84b5-b4ce480643e7]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:03:00 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3914e1c3-f823-41de-9115-348d7a855e37 tempest-CreateVolumesFromSnapshotTest-8387161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-540afb0e-55c1-493b-a281-ed3ef0312467 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:01 devstack sudo[107582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-540afb0e-55c1-493b-a281-ed3ef0312467 Sep 25 12:03:01 devstack sudo[107582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:01 devstack sudo[107582]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:01 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3914e1c3-f823-41de-9115-348d7a855e37 tempest-CreateVolumesFromSnapshotTest-8387161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-540afb0e-55c1-493b-a281-ed3ef0312467" returned: 0 in 0.537s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:01 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3914e1c3-f823-41de-9115-348d7a855e37 tempest-CreateVolumesFromSnapshotTest-8387161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-540afb0e-55c1-493b-a281-ed3ef0312467 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:01 devstack sudo[107587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-540afb0e-55c1-493b-a281-ed3ef0312467 Sep 25 12:03:01 devstack sudo[107587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:01 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae7ca65b-31e0-48cb-bc78-9d32c77fe75a tempest-CreateVolumesFromImageTest-2103843249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:03:01 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ae7ca65b-31e0-48cb-bc78-9d32c77fe75a tempest-CreateVolumesFromImageTest-2103843249 None] Flow 'volume_create_manager' (a828eea2-66b7-4d3a-b91f-97887261f98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:03:01 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ae7ca65b-31e0-48cb-bc78-9d32c77fe75a tempest-CreateVolumesFromImageTest-2103843249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c02da630-a74c-4b08-9261-f92cd817efe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:03:01 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ae7ca65b-31e0-48cb-bc78-9d32c77fe75a tempest-CreateVolumesFromImageTest-2103843249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c02da630-a74c-4b08-9261-f92cd817efe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:03:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-728842767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62714e30-e4ac-4743-be8d-3c7900670a6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cee4aeb0c2ce4bbd92d9a9802ffd8809',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:03:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:03:02Z,use_quota=True,user_id='d6f51ced4b52443e994809f473e5dd43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:03:01 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ae7ca65b-31e0-48cb-bc78-9d32c77fe75a tempest-CreateVolumesFromImageTest-2103843249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6866a63-88c4-4696-8508-7cda8865b513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:03:02 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ae7ca65b-31e0-48cb-bc78-9d32c77fe75a tempest-CreateVolumesFromImageTest-2103843249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6866a63-88c4-4696-8508-7cda8865b513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:03:02 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ae7ca65b-31e0-48cb-bc78-9d32c77fe75a tempest-CreateVolumesFromImageTest-2103843249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f426446f-f677-41b2-841c-b9a5b8cc393a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:03:02 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ae7ca65b-31e0-48cb-bc78-9d32c77fe75a tempest-CreateVolumesFromImageTest-2103843249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f426446f-f677-41b2-841c-b9a5b8cc393a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62714e30-e4ac-4743-be8d-3c7900670a6c', 'volume_name': 'volume-62714e30-e4ac-4743-be8d-3c7900670a6c', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:03:02 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ae7ca65b-31e0-48cb-bc78-9d32c77fe75a tempest-CreateVolumesFromImageTest-2103843249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4474eb0-e7a4-4fdb-8b02-b562efbe482e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:03:02 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ae7ca65b-31e0-48cb-bc78-9d32c77fe75a tempest-CreateVolumesFromImageTest-2103843249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4474eb0-e7a4-4fdb-8b02-b562efbe482e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:03:02 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ae7ca65b-31e0-48cb-bc78-9d32c77fe75a tempest-CreateVolumesFromImageTest-2103843249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33c3846c-bd20-4c73-8944-c7f62bccff16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:03:02 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-ae7ca65b-31e0-48cb-bc78-9d32c77fe75a tempest-CreateVolumesFromImageTest-2103843249 None] Volume 62714e30-e4ac-4743-be8d-3c7900670a6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62714e30-e4ac-4743-be8d-3c7900670a6c', 'volume_size': 1} Sep 25 12:03:02 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-ae7ca65b-31e0-48cb-bc78-9d32c77fe75a tempest-CreateVolumesFromImageTest-2103843249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:03:02 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-ae7ca65b-31e0-48cb-bc78-9d32c77fe75a tempest-CreateVolumesFromImageTest-2103843249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:03:02 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-ae7ca65b-31e0-48cb-bc78-9d32c77fe75a tempest-CreateVolumesFromImageTest-2103843249 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:03:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-728842767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62714e30-e4ac-4743-be8d-3c7900670a6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cee4aeb0c2ce4bbd92d9a9802ffd8809',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:03:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:03:02Z,use_quota=True,user_id='d6f51ced4b52443e994809f473e5dd43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:03:02 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-ae7ca65b-31e0-48cb-bc78-9d32c77fe75a tempest-CreateVolumesFromImageTest-2103843249 None] Creating volume 62714e30-e4ac-4743-be8d-3c7900670a6c {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:03:02 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-ae7ca65b-31e0-48cb-bc78-9d32c77fe75a tempest-CreateVolumesFromImageTest-2103843249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:03:02 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-ae7ca65b-31e0-48cb-bc78-9d32c77fe75a tempest-CreateVolumesFromImageTest-2103843249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:03:02 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-ae7ca65b-31e0-48cb-bc78-9d32c77fe75a tempest-CreateVolumesFromImageTest-2103843249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:03:02 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-ae7ca65b-31e0-48cb-bc78-9d32c77fe75a tempest-CreateVolumesFromImageTest-2103843249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:03:02 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-ae7ca65b-31e0-48cb-bc78-9d32c77fe75a tempest-CreateVolumesFromImageTest-2103843249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:03:02 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-ae7ca65b-31e0-48cb-bc78-9d32c77fe75a tempest-CreateVolumesFromImageTest-2103843249 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:03:02 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-ae7ca65b-31e0-48cb-bc78-9d32c77fe75a tempest-CreateVolumesFromImageTest-2103843249 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 12:03:02 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ae7ca65b-31e0-48cb-bc78-9d32c77fe75a tempest-CreateVolumesFromImageTest-2103843249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-62714e30-e4ac-4743-be8d-3c7900670a6c 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:02 devstack sudo[107587]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:02 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3914e1c3-f823-41de-9115-348d7a855e37 tempest-CreateVolumesFromSnapshotTest-8387161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-540afb0e-55c1-493b-a281-ed3ef0312467" returned: 0 in 0.672s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:02 devstack sudo[107590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-62714e30-e4ac-4743-be8d-3c7900670a6c 1073741824 Sep 25 12:03:02 devstack sudo[107590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:02 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-3914e1c3-f823-41de-9115-348d7a855e37 tempest-CreateVolumesFromSnapshotTest-8387161 None] Lock "cinder-quobyte-540afb0e-55c1-493b-a281-ed3ef0312467" released by "delete_volume" :: held 1.324s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:03:02 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-3914e1c3-f823-41de-9115-348d7a855e37 tempest-CreateVolumesFromSnapshotTest-8387161 None] Created reservations ['6d4df2f8-8413-48fc-a308-a2c760c67566', 'b4e4c103-def4-40f0-8015-482ed080dade', 'cc4845c2-84e2-4272-af65-987f4dbf7f21', '24ccd530-f7ab-40ed-98cc-cd8913445a3c'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:03:02 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3914e1c3-f823-41de-9115-348d7a855e37 tempest-CreateVolumesFromSnapshotTest-8387161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:03:02 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3914e1c3-f823-41de-9115-348d7a855e37 tempest-CreateVolumesFromSnapshotTest-8387161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:03:02 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3914e1c3-f823-41de-9115-348d7a855e37 tempest-CreateVolumesFromSnapshotTest-8387161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:03:02 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3914e1c3-f823-41de-9115-348d7a855e37 tempest-CreateVolumesFromSnapshotTest-8387161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:03:02 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3914e1c3-f823-41de-9115-348d7a855e37 tempest-CreateVolumesFromSnapshotTest-8387161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:03:02 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3914e1c3-f823-41de-9115-348d7a855e37 tempest-CreateVolumesFromSnapshotTest-8387161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:02 devstack sudo[107594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 12:03:02 devstack sudo[107594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:03 devstack sudo[107590]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ae7ca65b-31e0-48cb-bc78-9d32c77fe75a tempest-CreateVolumesFromImageTest-2103843249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-62714e30-e4ac-4743-be8d-3c7900670a6c 1073741824" returned: 0 in 0.990s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:03 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-37ef2433-48b2-44fe-abdb-eec3a5fba10b tempest-CreateVolumesFromSnapshotTest-8387161 None] Acquiring lock "cinder-dceac794-eaf5-4d83-9638-39599ab17286-delete_snapshot" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:03:03 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-90135e74-e4ce-4911-9ca6-ff97464c7846 tempest-CreateVolumesFromImageTest-2103843249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:03:03 devstack sudo[107594]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:03 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-90135e74-e4ce-4911-9ca6-ff97464c7846 tempest-CreateVolumesFromImageTest-2103843249 None] Flow 'volume_create_manager' (4c7c2318-66eb-44f1-aa57-2e1ea5fb96c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:03:03 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-90135e74-e4ce-4911-9ca6-ff97464c7846 tempest-CreateVolumesFromImageTest-2103843249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (706b1bbe-1549-4828-bd50-8c53556fd68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:03:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3914e1c3-f823-41de-9115-348d7a855e37 tempest-CreateVolumesFromSnapshotTest-8387161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.749s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:03 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-3914e1c3-f823-41de-9115-348d7a855e37 tempest-CreateVolumesFromSnapshotTest-8387161 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:03:03 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-3914e1c3-f823-41de-9115-348d7a855e37 tempest-CreateVolumesFromSnapshotTest-8387161 None] Deleted volume successfully. Sep 25 12:03:03 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-90135e74-e4ce-4911-9ca6-ff97464c7846 tempest-CreateVolumesFromImageTest-2103843249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (706b1bbe-1549-4828-bd50-8c53556fd68b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:03:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1163560645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b9c60c7-bf91-45c9-b8fb-5f4a482d2d53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cee4aeb0c2ce4bbd92d9a9802ffd8809',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:03:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:03:03Z,use_quota=True,user_id='d6f51ced4b52443e994809f473e5dd43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:03:03 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-90135e74-e4ce-4911-9ca6-ff97464c7846 tempest-CreateVolumesFromImageTest-2103843249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fc67367-61e3-4f4b-bd94-fd542f662e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:03:03 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-90135e74-e4ce-4911-9ca6-ff97464c7846 tempest-CreateVolumesFromImageTest-2103843249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fc67367-61e3-4f4b-bd94-fd542f662e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:03:03 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-90135e74-e4ce-4911-9ca6-ff97464c7846 tempest-CreateVolumesFromImageTest-2103843249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (103b156c-a0f8-464c-b3f0-73a1b9465848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:03:03 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-90135e74-e4ce-4911-9ca6-ff97464c7846 tempest-CreateVolumesFromImageTest-2103843249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (103b156c-a0f8-464c-b3f0-73a1b9465848) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b9c60c7-bf91-45c9-b8fb-5f4a482d2d53', 'volume_name': 'volume-3b9c60c7-bf91-45c9-b8fb-5f4a482d2d53', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:03:03 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-90135e74-e4ce-4911-9ca6-ff97464c7846 tempest-CreateVolumesFromImageTest-2103843249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed8f3cdb-8765-4003-b842-2f25b8b42edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:03:03 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-90135e74-e4ce-4911-9ca6-ff97464c7846 tempest-CreateVolumesFromImageTest-2103843249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed8f3cdb-8765-4003-b842-2f25b8b42edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:03:03 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-90135e74-e4ce-4911-9ca6-ff97464c7846 tempest-CreateVolumesFromImageTest-2103843249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3951015-d265-4aa7-94c1-1159fa2909ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:03:03 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-90135e74-e4ce-4911-9ca6-ff97464c7846 tempest-CreateVolumesFromImageTest-2103843249 None] Volume 3b9c60c7-bf91-45c9-b8fb-5f4a482d2d53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b9c60c7-bf91-45c9-b8fb-5f4a482d2d53', 'volume_size': 1} Sep 25 12:03:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-90135e74-e4ce-4911-9ca6-ff97464c7846 tempest-CreateVolumesFromImageTest-2103843249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:03:03 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-37ef2433-48b2-44fe-abdb-eec3a5fba10b tempest-CreateVolumesFromSnapshotTest-8387161 None] Lock "cinder-dceac794-eaf5-4d83-9638-39599ab17286-delete_snapshot" acquired by "delete_snapshot" :: waited 0.234s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:03:03 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-37ef2433-48b2-44fe-abdb-eec3a5fba10b tempest-CreateVolumesFromSnapshotTest-8387161 None] Acquiring lock "cinder-quobyte-5f99efd7-a969-4426-901e-b71518535f06" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:03:03 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-37ef2433-48b2-44fe-abdb-eec3a5fba10b tempest-CreateVolumesFromSnapshotTest-8387161 None] Lock "cinder-quobyte-5f99efd7-a969-4426-901e-b71518535f06" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:03:03 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-37ef2433-48b2-44fe-abdb-eec3a5fba10b tempest-CreateVolumesFromSnapshotTest-8387161 None] Acquiring lock "cinder-quobyte-dceac794-eaf5-4d83-9638-39599ab17286" by "_delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:03:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ae7ca65b-31e0-48cb-bc78-9d32c77fe75a tempest-CreateVolumesFromImageTest-2103843249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-62714e30-e4ac-4743-be8d-3c7900670a6c {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:03 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-37ef2433-48b2-44fe-abdb-eec3a5fba10b tempest-CreateVolumesFromSnapshotTest-8387161 None] Lock "cinder-quobyte-dceac794-eaf5-4d83-9638-39599ab17286" acquired by "_delete_snapshot" :: waited 0.059s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:03:03 devstack sudo[107598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-62714e30-e4ac-4743-be8d-3c7900670a6c Sep 25 12:03:03 devstack sudo[107598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:03 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-37ef2433-48b2-44fe-abdb-eec3a5fba10b tempest-CreateVolumesFromSnapshotTest-8387161 None] Deleting offline snapshot dceac794-eaf5-4d83-9638-39599ab17286 of volume 5f99efd7-a969-4426-901e-b71518535f06 {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 12:03:03 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-37ef2433-48b2-44fe-abdb-eec3a5fba10b tempest-CreateVolumesFromSnapshotTest-8387161 None] snapshot_file for this snap is: volume-5f99efd7-a969-4426-901e-b71518535f06.dceac794-eaf5-4d83-9638-39599ab17286 {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 12:03:03 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-3914e1c3-f823-41de-9115-348d7a855e37 tempest-CreateVolumesFromSnapshotTest-8387161 None] Lock "cinder-540afb0e-55c1-493b-a281-ed3ef0312467-delete_volume" released by "delete_volume" :: held 2.863s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:03:03 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8362bb6-24c5-439d-9cf5-6491280ef060]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:03:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-37ef2433-48b2-44fe-abdb-eec3a5fba10b tempest-CreateVolumesFromSnapshotTest-8387161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5f99efd7-a969-4426-901e-b71518535f06.dceac794-eaf5-4d83-9638-39599ab17286 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:03 devstack sudo[107600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5f99efd7-a969-4426-901e-b71518535f06.dceac794-eaf5-4d83-9638-39599ab17286 Sep 25 12:03:03 devstack sudo[107600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:03 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-db8a5e28-ae86-44ff-b815-6ba5938b80ee tempest-CreateVolumesFromImageTest-2103843249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:03:04 devstack sudo[107598]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:04 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-db8a5e28-ae86-44ff-b815-6ba5938b80ee tempest-CreateVolumesFromImageTest-2103843249 None] Flow 'volume_create_manager' (16702ede-c8ca-4bbe-8ba6-59f8d761b6f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:03:04 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-db8a5e28-ae86-44ff-b815-6ba5938b80ee tempest-CreateVolumesFromImageTest-2103843249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f208c25d-ae05-4a8b-89ee-37457f6c10e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:03:04 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ae7ca65b-31e0-48cb-bc78-9d32c77fe75a tempest-CreateVolumesFromImageTest-2103843249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-62714e30-e4ac-4743-be8d-3c7900670a6c" returned: 0 in 0.692s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:04 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-ae7ca65b-31e0-48cb-bc78-9d32c77fe75a tempest-CreateVolumesFromImageTest-2103843249 None] <== create_volume: return (2023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:03:04 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-ae7ca65b-31e0-48cb-bc78-9d32c77fe75a tempest-CreateVolumesFromImageTest-2103843249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.027s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:03:04 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-90135e74-e4ce-4911-9ca6-ff97464c7846 tempest-CreateVolumesFromImageTest-2103843249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.760s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:03:04 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-90135e74-e4ce-4911-9ca6-ff97464c7846 tempest-CreateVolumesFromImageTest-2103843249 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:03:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1163560645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b9c60c7-bf91-45c9-b8fb-5f4a482d2d53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cee4aeb0c2ce4bbd92d9a9802ffd8809',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:03:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:03:03Z,use_quota=True,user_id='d6f51ced4b52443e994809f473e5dd43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:03:04 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-90135e74-e4ce-4911-9ca6-ff97464c7846 tempest-CreateVolumesFromImageTest-2103843249 None] Creating volume 3b9c60c7-bf91-45c9-b8fb-5f4a482d2d53 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:03:04 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-90135e74-e4ce-4911-9ca6-ff97464c7846 tempest-CreateVolumesFromImageTest-2103843249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:03:04 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-90135e74-e4ce-4911-9ca6-ff97464c7846 tempest-CreateVolumesFromImageTest-2103843249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:03:04 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-90135e74-e4ce-4911-9ca6-ff97464c7846 tempest-CreateVolumesFromImageTest-2103843249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:03:04 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-90135e74-e4ce-4911-9ca6-ff97464c7846 tempest-CreateVolumesFromImageTest-2103843249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:03:04 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-90135e74-e4ce-4911-9ca6-ff97464c7846 tempest-CreateVolumesFromImageTest-2103843249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:03:04 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-90135e74-e4ce-4911-9ca6-ff97464c7846 tempest-CreateVolumesFromImageTest-2103843249 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:03:04 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-90135e74-e4ce-4911-9ca6-ff97464c7846 tempest-CreateVolumesFromImageTest-2103843249 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 12:03:04 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-90135e74-e4ce-4911-9ca6-ff97464c7846 tempest-CreateVolumesFromImageTest-2103843249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-3b9c60c7-bf91-45c9-b8fb-5f4a482d2d53 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:04 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-db8a5e28-ae86-44ff-b815-6ba5938b80ee tempest-CreateVolumesFromImageTest-2103843249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f208c25d-ae05-4a8b-89ee-37457f6c10e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:03:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1955727309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d4dfcfe-768a-4a59-a6a5-c6fa616482c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cee4aeb0c2ce4bbd92d9a9802ffd8809',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:03:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:03:04Z,use_quota=True,user_id='d6f51ced4b52443e994809f473e5dd43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:03:04 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-db8a5e28-ae86-44ff-b815-6ba5938b80ee tempest-CreateVolumesFromImageTest-2103843249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e08eb2ce-e828-4f37-bb42-d5a5260df9ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:03:04 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-db8a5e28-ae86-44ff-b815-6ba5938b80ee tempest-CreateVolumesFromImageTest-2103843249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e08eb2ce-e828-4f37-bb42-d5a5260df9ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:03:04 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-db8a5e28-ae86-44ff-b815-6ba5938b80ee tempest-CreateVolumesFromImageTest-2103843249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (086e4130-473b-4ac8-87e7-d86e49015ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:03:04 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-db8a5e28-ae86-44ff-b815-6ba5938b80ee tempest-CreateVolumesFromImageTest-2103843249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (086e4130-473b-4ac8-87e7-d86e49015ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d4dfcfe-768a-4a59-a6a5-c6fa616482c9', 'volume_name': 'volume-1d4dfcfe-768a-4a59-a6a5-c6fa616482c9', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:03:04 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-db8a5e28-ae86-44ff-b815-6ba5938b80ee tempest-CreateVolumesFromImageTest-2103843249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e4e3a6c-a169-4ebf-8bf8-faff6db8137d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:03:04 devstack sudo[107604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-3b9c60c7-bf91-45c9-b8fb-5f4a482d2d53 1073741824 Sep 25 12:03:04 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-db8a5e28-ae86-44ff-b815-6ba5938b80ee tempest-CreateVolumesFromImageTest-2103843249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e4e3a6c-a169-4ebf-8bf8-faff6db8137d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:03:04 devstack sudo[107604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:04 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-db8a5e28-ae86-44ff-b815-6ba5938b80ee tempest-CreateVolumesFromImageTest-2103843249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b871e63-8d40-4c70-9eca-7b35f4ae1a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:03:04 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-db8a5e28-ae86-44ff-b815-6ba5938b80ee tempest-CreateVolumesFromImageTest-2103843249 None] Volume 1d4dfcfe-768a-4a59-a6a5-c6fa616482c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d4dfcfe-768a-4a59-a6a5-c6fa616482c9', 'volume_size': 1} Sep 25 12:03:04 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-db8a5e28-ae86-44ff-b815-6ba5938b80ee tempest-CreateVolumesFromImageTest-2103843249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:03:04 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ae7ca65b-31e0-48cb-bc78-9d32c77fe75a tempest-CreateVolumesFromImageTest-2103843249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33c3846c-bd20-4c73-8944-c7f62bccff16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62714e30-e4ac-4743-be8d-3c7900670a6c', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:03:04 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ae7ca65b-31e0-48cb-bc78-9d32c77fe75a tempest-CreateVolumesFromImageTest-2103843249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34da958e-58b2-4cdb-9d84-d923a428c471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:03:04 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-ae7ca65b-31e0-48cb-bc78-9d32c77fe75a tempest-CreateVolumesFromImageTest-2103843249 None] Volume volume-62714e30-e4ac-4743-be8d-3c7900670a6c (62714e30-e4ac-4743-be8d-3c7900670a6c): created successfully Sep 25 12:03:04 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ae7ca65b-31e0-48cb-bc78-9d32c77fe75a tempest-CreateVolumesFromImageTest-2103843249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34da958e-58b2-4cdb-9d84-d923a428c471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:03:04 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ae7ca65b-31e0-48cb-bc78-9d32c77fe75a tempest-CreateVolumesFromImageTest-2103843249 None] Flow 'volume_create_manager' (a828eea2-66b7-4d3a-b91f-97887261f98c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:03:04 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-ae7ca65b-31e0-48cb-bc78-9d32c77fe75a tempest-CreateVolumesFromImageTest-2103843249 None] Created volume successfully. Sep 25 12:03:04 devstack sudo[107600]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:04 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-37ef2433-48b2-44fe-abdb-eec3a5fba10b tempest-CreateVolumesFromSnapshotTest-8387161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5f99efd7-a969-4426-901e-b71518535f06.dceac794-eaf5-4d83-9638-39599ab17286" returned: 0 in 0.985s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:04 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-37ef2433-48b2-44fe-abdb-eec3a5fba10b tempest-CreateVolumesFromSnapshotTest-8387161 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5f99efd7-a969-4426-901e-b71518535f06(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86984) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:03:04 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6038db1-e240-4e22-a838-a8d4e614027b]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:03:04 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-37ef2433-48b2-44fe-abdb-eec3a5fba10b tempest-CreateVolumesFromSnapshotTest-8387161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5f99efd7-a969-4426-901e-b71518535f06 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:04 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fc112fe-d169-4410-a012-dbec966a34e6 tempest-CreateVolumesFromImageTest-2103843249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:03:04 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2fc112fe-d169-4410-a012-dbec966a34e6 tempest-CreateVolumesFromImageTest-2103843249 None] Flow 'volume_create_manager' (94170560-4c06-4fde-8fb9-420d565119f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:03:04 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2fc112fe-d169-4410-a012-dbec966a34e6 tempest-CreateVolumesFromImageTest-2103843249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83116237-361d-4793-9c81-be90124d4dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:03:04 devstack sudo[107612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5f99efd7-a969-4426-901e-b71518535f06 Sep 25 12:03:04 devstack sudo[107612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:04 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2fc112fe-d169-4410-a012-dbec966a34e6 tempest-CreateVolumesFromImageTest-2103843249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83116237-361d-4793-9c81-be90124d4dd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:03:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1065065609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f58904e3-8257-476b-90b2-ce4b41f5da7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cee4aeb0c2ce4bbd92d9a9802ffd8809',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:03:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:03:05Z,use_quota=True,user_id='d6f51ced4b52443e994809f473e5dd43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:03:04 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2fc112fe-d169-4410-a012-dbec966a34e6 tempest-CreateVolumesFromImageTest-2103843249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (effecc00-b71d-477a-b797-cd94d2dc69c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:03:04 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2fc112fe-d169-4410-a012-dbec966a34e6 tempest-CreateVolumesFromImageTest-2103843249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (effecc00-b71d-477a-b797-cd94d2dc69c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:03:04 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2fc112fe-d169-4410-a012-dbec966a34e6 tempest-CreateVolumesFromImageTest-2103843249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90a5d852-bb60-418d-97f6-0c5f7762cadc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:03:04 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2fc112fe-d169-4410-a012-dbec966a34e6 tempest-CreateVolumesFromImageTest-2103843249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90a5d852-bb60-418d-97f6-0c5f7762cadc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f58904e3-8257-476b-90b2-ce4b41f5da7c', 'volume_name': 'volume-f58904e3-8257-476b-90b2-ce4b41f5da7c', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:03:04 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2fc112fe-d169-4410-a012-dbec966a34e6 tempest-CreateVolumesFromImageTest-2103843249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02bc5292-d04c-4bd8-9b09-e0e10ba18394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:03:04 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2fc112fe-d169-4410-a012-dbec966a34e6 tempest-CreateVolumesFromImageTest-2103843249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02bc5292-d04c-4bd8-9b09-e0e10ba18394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:03:04 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2fc112fe-d169-4410-a012-dbec966a34e6 tempest-CreateVolumesFromImageTest-2103843249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14db1208-4af7-49b1-b6c2-2fc8dd5e89f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:03:04 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-2fc112fe-d169-4410-a012-dbec966a34e6 tempest-CreateVolumesFromImageTest-2103843249 None] Volume f58904e3-8257-476b-90b2-ce4b41f5da7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f58904e3-8257-476b-90b2-ce4b41f5da7c', 'volume_size': 1} Sep 25 12:03:04 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-2fc112fe-d169-4410-a012-dbec966a34e6 tempest-CreateVolumesFromImageTest-2103843249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:03:04 devstack sudo[107604]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:04 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-90135e74-e4ce-4911-9ca6-ff97464c7846 tempest-CreateVolumesFromImageTest-2103843249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-3b9c60c7-bf91-45c9-b8fb-5f4a482d2d53 1073741824" returned: 0 in 0.867s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-90135e74-e4ce-4911-9ca6-ff97464c7846 tempest-CreateVolumesFromImageTest-2103843249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-3b9c60c7-bf91-45c9-b8fb-5f4a482d2d53 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:05 devstack sudo[107615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-3b9c60c7-bf91-45c9-b8fb-5f4a482d2d53 Sep 25 12:03:05 devstack sudo[107615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:05 devstack sudo[107612]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-37ef2433-48b2-44fe-abdb-eec3a5fba10b tempest-CreateVolumesFromSnapshotTest-8387161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5f99efd7-a969-4426-901e-b71518535f06" returned: 0 in 0.678s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-37ef2433-48b2-44fe-abdb-eec3a5fba10b tempest-CreateVolumesFromSnapshotTest-8387161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5f99efd7-a969-4426-901e-b71518535f06.dceac794-eaf5-4d83-9638-39599ab17286 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:05 devstack sudo[107620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5f99efd7-a969-4426-901e-b71518535f06.dceac794-eaf5-4d83-9638-39599ab17286 Sep 25 12:03:05 devstack sudo[107620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:05 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-7af161ee-0bba-4e69-86ac-4ec7e8608142 tempest-CreateVolumesFromImageTest-2103843249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:03:05 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7af161ee-0bba-4e69-86ac-4ec7e8608142 tempest-CreateVolumesFromImageTest-2103843249 None] Flow 'volume_create_manager' (d80448fc-079d-4135-9b26-5645e5d8d3cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:03:05 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7af161ee-0bba-4e69-86ac-4ec7e8608142 tempest-CreateVolumesFromImageTest-2103843249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (429eff55-cafc-4ba2-90eb-e93e45e6ea4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:03:05 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7af161ee-0bba-4e69-86ac-4ec7e8608142 tempest-CreateVolumesFromImageTest-2103843249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (429eff55-cafc-4ba2-90eb-e93e45e6ea4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:03:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-363902835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ca1bb93-35c8-425a-bc68-51efdfb816c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cee4aeb0c2ce4bbd92d9a9802ffd8809',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:03:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:03:05Z,use_quota=True,user_id='d6f51ced4b52443e994809f473e5dd43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:03:05 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7af161ee-0bba-4e69-86ac-4ec7e8608142 tempest-CreateVolumesFromImageTest-2103843249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dad4badd-8fc5-43c0-b47b-664d5110e4c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:03:05 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7af161ee-0bba-4e69-86ac-4ec7e8608142 tempest-CreateVolumesFromImageTest-2103843249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dad4badd-8fc5-43c0-b47b-664d5110e4c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:03:05 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7af161ee-0bba-4e69-86ac-4ec7e8608142 tempest-CreateVolumesFromImageTest-2103843249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2f4e4a4-81f1-4b72-a65d-7e3edc471385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:03:05 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7af161ee-0bba-4e69-86ac-4ec7e8608142 tempest-CreateVolumesFromImageTest-2103843249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2f4e4a4-81f1-4b72-a65d-7e3edc471385) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ca1bb93-35c8-425a-bc68-51efdfb816c0', 'volume_name': 'volume-0ca1bb93-35c8-425a-bc68-51efdfb816c0', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:03:05 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7af161ee-0bba-4e69-86ac-4ec7e8608142 tempest-CreateVolumesFromImageTest-2103843249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (224b266c-fa02-467c-8f63-7298593d7c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:03:05 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7af161ee-0bba-4e69-86ac-4ec7e8608142 tempest-CreateVolumesFromImageTest-2103843249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (224b266c-fa02-467c-8f63-7298593d7c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:03:05 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7af161ee-0bba-4e69-86ac-4ec7e8608142 tempest-CreateVolumesFromImageTest-2103843249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d1d3307-c213-4e70-b6c8-359f9f4cbce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:03:05 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-7af161ee-0bba-4e69-86ac-4ec7e8608142 tempest-CreateVolumesFromImageTest-2103843249 None] Volume 0ca1bb93-35c8-425a-bc68-51efdfb816c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ca1bb93-35c8-425a-bc68-51efdfb816c0', 'volume_size': 1} Sep 25 12:03:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-7af161ee-0bba-4e69-86ac-4ec7e8608142 tempest-CreateVolumesFromImageTest-2103843249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:03:05 devstack sudo[107615]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-90135e74-e4ce-4911-9ca6-ff97464c7846 tempest-CreateVolumesFromImageTest-2103843249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-3b9c60c7-bf91-45c9-b8fb-5f4a482d2d53" returned: 0 in 0.532s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:05 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-90135e74-e4ce-4911-9ca6-ff97464c7846 tempest-CreateVolumesFromImageTest-2103843249 None] <== create_volume: return (1499ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:03:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-90135e74-e4ce-4911-9ca6-ff97464c7846 tempest-CreateVolumesFromImageTest-2103843249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.506s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:03:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-db8a5e28-ae86-44ff-b815-6ba5938b80ee tempest-CreateVolumesFromImageTest-2103843249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.388s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:03:05 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-db8a5e28-ae86-44ff-b815-6ba5938b80ee tempest-CreateVolumesFromImageTest-2103843249 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:03:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1955727309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d4dfcfe-768a-4a59-a6a5-c6fa616482c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cee4aeb0c2ce4bbd92d9a9802ffd8809',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:03:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:03:04Z,use_quota=True,user_id='d6f51ced4b52443e994809f473e5dd43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:03:05 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-db8a5e28-ae86-44ff-b815-6ba5938b80ee tempest-CreateVolumesFromImageTest-2103843249 None] Creating volume 1d4dfcfe-768a-4a59-a6a5-c6fa616482c9 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:03:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-db8a5e28-ae86-44ff-b815-6ba5938b80ee tempest-CreateVolumesFromImageTest-2103843249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:03:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-db8a5e28-ae86-44ff-b815-6ba5938b80ee tempest-CreateVolumesFromImageTest-2103843249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:03:05 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-db8a5e28-ae86-44ff-b815-6ba5938b80ee tempest-CreateVolumesFromImageTest-2103843249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:03:05 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-db8a5e28-ae86-44ff-b815-6ba5938b80ee tempest-CreateVolumesFromImageTest-2103843249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:03:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-db8a5e28-ae86-44ff-b815-6ba5938b80ee tempest-CreateVolumesFromImageTest-2103843249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:03:05 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-db8a5e28-ae86-44ff-b815-6ba5938b80ee tempest-CreateVolumesFromImageTest-2103843249 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:03:05 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-db8a5e28-ae86-44ff-b815-6ba5938b80ee tempest-CreateVolumesFromImageTest-2103843249 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 12:03:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-db8a5e28-ae86-44ff-b815-6ba5938b80ee tempest-CreateVolumesFromImageTest-2103843249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1d4dfcfe-768a-4a59-a6a5-c6fa616482c9 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:05 devstack sudo[107625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1d4dfcfe-768a-4a59-a6a5-c6fa616482c9 1073741824 Sep 25 12:03:05 devstack sudo[107625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:05 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-90135e74-e4ce-4911-9ca6-ff97464c7846 tempest-CreateVolumesFromImageTest-2103843249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3951015-d265-4aa7-94c1-1159fa2909ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b9c60c7-bf91-45c9-b8fb-5f4a482d2d53', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:03:05 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-90135e74-e4ce-4911-9ca6-ff97464c7846 tempest-CreateVolumesFromImageTest-2103843249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (089562e8-5014-47e4-afcd-a9ab2d7aff9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:03:05 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-90135e74-e4ce-4911-9ca6-ff97464c7846 tempest-CreateVolumesFromImageTest-2103843249 None] Volume volume-3b9c60c7-bf91-45c9-b8fb-5f4a482d2d53 (3b9c60c7-bf91-45c9-b8fb-5f4a482d2d53): created successfully Sep 25 12:03:05 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-90135e74-e4ce-4911-9ca6-ff97464c7846 tempest-CreateVolumesFromImageTest-2103843249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (089562e8-5014-47e4-afcd-a9ab2d7aff9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:03:05 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-90135e74-e4ce-4911-9ca6-ff97464c7846 tempest-CreateVolumesFromImageTest-2103843249 None] Flow 'volume_create_manager' (4c7c2318-66eb-44f1-aa57-2e1ea5fb96c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:03:05 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-90135e74-e4ce-4911-9ca6-ff97464c7846 tempest-CreateVolumesFromImageTest-2103843249 None] Created volume successfully. Sep 25 12:03:05 devstack sudo[107620]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-37ef2433-48b2-44fe-abdb-eec3a5fba10b tempest-CreateVolumesFromSnapshotTest-8387161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5f99efd7-a969-4426-901e-b71518535f06.dceac794-eaf5-4d83-9638-39599ab17286" returned: 0 in 0.671s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-37ef2433-48b2-44fe-abdb-eec3a5fba10b tempest-CreateVolumesFromSnapshotTest-8387161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5f99efd7-a969-4426-901e-b71518535f06.dceac794-eaf5-4d83-9638-39599ab17286 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:05 devstack sudo[107630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5f99efd7-a969-4426-901e-b71518535f06.dceac794-eaf5-4d83-9638-39599ab17286 Sep 25 12:03:05 devstack sudo[107630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:06 devstack sudo[107625]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-db8a5e28-ae86-44ff-b815-6ba5938b80ee tempest-CreateVolumesFromImageTest-2103843249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1d4dfcfe-768a-4a59-a6a5-c6fa616482c9 1073741824" returned: 0 in 0.652s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:06 devstack sudo[107630]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-37ef2433-48b2-44fe-abdb-eec3a5fba10b tempest-CreateVolumesFromSnapshotTest-8387161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5f99efd7-a969-4426-901e-b71518535f06.dceac794-eaf5-4d83-9638-39599ab17286" returned: 0 in 0.397s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-db8a5e28-ae86-44ff-b815-6ba5938b80ee tempest-CreateVolumesFromImageTest-2103843249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1d4dfcfe-768a-4a59-a6a5-c6fa616482c9 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:06 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-37ef2433-48b2-44fe-abdb-eec3a5fba10b tempest-CreateVolumesFromSnapshotTest-8387161 None] Lock "cinder-quobyte-dceac794-eaf5-4d83-9638-39599ab17286" released by "_delete_snapshot" :: held 3.029s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:03:06 devstack sudo[107635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1d4dfcfe-768a-4a59-a6a5-c6fa616482c9 Sep 25 12:03:06 devstack sudo[107635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:06 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-37ef2433-48b2-44fe-abdb-eec3a5fba10b tempest-CreateVolumesFromSnapshotTest-8387161 None] Lock "cinder-quobyte-5f99efd7-a969-4426-901e-b71518535f06" released by "delete_snapshot" :: held 3.114s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:03:06 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-37ef2433-48b2-44fe-abdb-eec3a5fba10b tempest-CreateVolumesFromSnapshotTest-8387161 None] Created reservations ['bf25bc77-e125-49a7-ba58-8932c87ceb43', '917192da-00e9-41c4-96a1-cfb7c7dbae09', 'c8331573-9d5b-4380-8fc7-8b27ca905ead', 'd74e71b0-d46a-48cd-94dc-46a963e9cae0'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:03:06 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-37ef2433-48b2-44fe-abdb-eec3a5fba10b tempest-CreateVolumesFromSnapshotTest-8387161 None] Delete snapshot completed successfully. Sep 25 12:03:06 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-37ef2433-48b2-44fe-abdb-eec3a5fba10b tempest-CreateVolumesFromSnapshotTest-8387161 None] Lock "cinder-dceac794-eaf5-4d83-9638-39599ab17286-delete_snapshot" released by "delete_snapshot" :: held 3.331s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:03:06 devstack sudo[107635]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-db8a5e28-ae86-44ff-b815-6ba5938b80ee tempest-CreateVolumesFromImageTest-2103843249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1d4dfcfe-768a-4a59-a6a5-c6fa616482c9" returned: 0 in 0.395s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:06 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-db8a5e28-ae86-44ff-b815-6ba5938b80ee tempest-CreateVolumesFromImageTest-2103843249 None] <== create_volume: return (1201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:03:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-db8a5e28-ae86-44ff-b815-6ba5938b80ee tempest-CreateVolumesFromImageTest-2103843249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.205s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:03:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-2fc112fe-d169-4410-a012-dbec966a34e6 tempest-CreateVolumesFromImageTest-2103843249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.931s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:03:06 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-2fc112fe-d169-4410-a012-dbec966a34e6 tempest-CreateVolumesFromImageTest-2103843249 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:03:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1065065609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f58904e3-8257-476b-90b2-ce4b41f5da7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cee4aeb0c2ce4bbd92d9a9802ffd8809',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:03:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:03:05Z,use_quota=True,user_id='d6f51ced4b52443e994809f473e5dd43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:03:06 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-2fc112fe-d169-4410-a012-dbec966a34e6 tempest-CreateVolumesFromImageTest-2103843249 None] Creating volume f58904e3-8257-476b-90b2-ce4b41f5da7c {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:03:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-2fc112fe-d169-4410-a012-dbec966a34e6 tempest-CreateVolumesFromImageTest-2103843249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:03:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-2fc112fe-d169-4410-a012-dbec966a34e6 tempest-CreateVolumesFromImageTest-2103843249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:03:06 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-2fc112fe-d169-4410-a012-dbec966a34e6 tempest-CreateVolumesFromImageTest-2103843249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:03:06 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-2fc112fe-d169-4410-a012-dbec966a34e6 tempest-CreateVolumesFromImageTest-2103843249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:03:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-2fc112fe-d169-4410-a012-dbec966a34e6 tempest-CreateVolumesFromImageTest-2103843249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:03:06 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-2fc112fe-d169-4410-a012-dbec966a34e6 tempest-CreateVolumesFromImageTest-2103843249 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:03:06 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-2fc112fe-d169-4410-a012-dbec966a34e6 tempest-CreateVolumesFromImageTest-2103843249 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 12:03:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2fc112fe-d169-4410-a012-dbec966a34e6 tempest-CreateVolumesFromImageTest-2103843249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f58904e3-8257-476b-90b2-ce4b41f5da7c 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:06 devstack sudo[107638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f58904e3-8257-476b-90b2-ce4b41f5da7c 1073741824 Sep 25 12:03:06 devstack sudo[107638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:06 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-db8a5e28-ae86-44ff-b815-6ba5938b80ee tempest-CreateVolumesFromImageTest-2103843249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b871e63-8d40-4c70-9eca-7b35f4ae1a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d4dfcfe-768a-4a59-a6a5-c6fa616482c9', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:03:06 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-db8a5e28-ae86-44ff-b815-6ba5938b80ee tempest-CreateVolumesFromImageTest-2103843249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa50d1b4-4904-46f7-a610-9ebac9f923d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:03:06 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-db8a5e28-ae86-44ff-b815-6ba5938b80ee tempest-CreateVolumesFromImageTest-2103843249 None] Volume volume-1d4dfcfe-768a-4a59-a6a5-c6fa616482c9 (1d4dfcfe-768a-4a59-a6a5-c6fa616482c9): created successfully Sep 25 12:03:06 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-db8a5e28-ae86-44ff-b815-6ba5938b80ee tempest-CreateVolumesFromImageTest-2103843249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa50d1b4-4904-46f7-a610-9ebac9f923d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:03:06 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-db8a5e28-ae86-44ff-b815-6ba5938b80ee tempest-CreateVolumesFromImageTest-2103843249 None] Flow 'volume_create_manager' (16702ede-c8ca-4bbe-8ba6-59f8d761b6f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:03:06 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-db8a5e28-ae86-44ff-b815-6ba5938b80ee tempest-CreateVolumesFromImageTest-2103843249 None] Created volume successfully. Sep 25 12:03:07 devstack sudo[107638]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2fc112fe-d169-4410-a012-dbec966a34e6 tempest-CreateVolumesFromImageTest-2103843249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f58904e3-8257-476b-90b2-ce4b41f5da7c 1073741824" returned: 0 in 0.558s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2fc112fe-d169-4410-a012-dbec966a34e6 tempest-CreateVolumesFromImageTest-2103843249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f58904e3-8257-476b-90b2-ce4b41f5da7c {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:07 devstack sudo[107644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f58904e3-8257-476b-90b2-ce4b41f5da7c Sep 25 12:03:07 devstack sudo[107644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:07 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-c00c2c8b-b486-4e95-9882-3c863777af49 tempest-CreateVolumesFromSnapshotTest-8387161 None] Acquiring lock "cinder-5f99efd7-a969-4426-901e-b71518535f06-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:03:07 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-c00c2c8b-b486-4e95-9882-3c863777af49 tempest-CreateVolumesFromSnapshotTest-8387161 None] Lock "cinder-5f99efd7-a969-4426-901e-b71518535f06-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:03:07 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-215c3824-81b8-452a-8105-8a92c313b426 tempest-VolumeImageDependencyTests-1254163555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:03:07 devstack sudo[107644]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:07 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-215c3824-81b8-452a-8105-8a92c313b426 tempest-VolumeImageDependencyTests-1254163555 None] Flow 'volume_create_manager' (34fb65f7-195c-48eb-9e9f-86a99c122c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:03:07 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-215c3824-81b8-452a-8105-8a92c313b426 tempest-VolumeImageDependencyTests-1254163555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6290a66-803a-424a-bbc1-c947d77bb307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:03:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2fc112fe-d169-4410-a012-dbec966a34e6 tempest-CreateVolumesFromImageTest-2103843249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f58904e3-8257-476b-90b2-ce4b41f5da7c" returned: 0 in 0.527s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:07 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-c00c2c8b-b486-4e95-9882-3c863777af49 tempest-CreateVolumesFromSnapshotTest-8387161 None] Acquiring lock "cinder-quobyte-5f99efd7-a969-4426-901e-b71518535f06" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:03:07 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-2fc112fe-d169-4410-a012-dbec966a34e6 tempest-CreateVolumesFromImageTest-2103843249 None] <== create_volume: return (1175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:03:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-2fc112fe-d169-4410-a012-dbec966a34e6 tempest-CreateVolumesFromImageTest-2103843249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.178s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:03:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-7af161ee-0bba-4e69-86ac-4ec7e8608142 tempest-CreateVolumesFromImageTest-2103843249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.432s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:03:07 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-7af161ee-0bba-4e69-86ac-4ec7e8608142 tempest-CreateVolumesFromImageTest-2103843249 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:03:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-363902835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ca1bb93-35c8-425a-bc68-51efdfb816c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cee4aeb0c2ce4bbd92d9a9802ffd8809',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:03:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:03:05Z,use_quota=True,user_id='d6f51ced4b52443e994809f473e5dd43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:03:08 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-7af161ee-0bba-4e69-86ac-4ec7e8608142 tempest-CreateVolumesFromImageTest-2103843249 None] Creating volume 0ca1bb93-35c8-425a-bc68-51efdfb816c0 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:03:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-7af161ee-0bba-4e69-86ac-4ec7e8608142 tempest-CreateVolumesFromImageTest-2103843249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:03:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-7af161ee-0bba-4e69-86ac-4ec7e8608142 tempest-CreateVolumesFromImageTest-2103843249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:03:08 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-7af161ee-0bba-4e69-86ac-4ec7e8608142 tempest-CreateVolumesFromImageTest-2103843249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:03:08 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-7af161ee-0bba-4e69-86ac-4ec7e8608142 tempest-CreateVolumesFromImageTest-2103843249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:03:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-7af161ee-0bba-4e69-86ac-4ec7e8608142 tempest-CreateVolumesFromImageTest-2103843249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:03:08 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-7af161ee-0bba-4e69-86ac-4ec7e8608142 tempest-CreateVolumesFromImageTest-2103843249 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:03:08 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-7af161ee-0bba-4e69-86ac-4ec7e8608142 tempest-CreateVolumesFromImageTest-2103843249 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 12:03:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7af161ee-0bba-4e69-86ac-4ec7e8608142 tempest-CreateVolumesFromImageTest-2103843249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0ca1bb93-35c8-425a-bc68-51efdfb816c0 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:08 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-215c3824-81b8-452a-8105-8a92c313b426 tempest-VolumeImageDependencyTests-1254163555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6290a66-803a-424a-bbc1-c947d77bb307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:03:07Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1a2fa1f-67eb-4d66-9150-d7ab816a9788,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28ab0c68e8fe4d66a925724cdaa58d76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:03:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:03:08Z,use_quota=True,user_id='b1532628bdca4a0ab1910d5a67306e05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:03:08 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-215c3824-81b8-452a-8105-8a92c313b426 tempest-VolumeImageDependencyTests-1254163555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dea9db69-d7e9-405d-9bf3-eb2c8027c679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:03:08 devstack sudo[107647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0ca1bb93-35c8-425a-bc68-51efdfb816c0 1073741824 Sep 25 12:03:08 devstack sudo[107647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:08 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-215c3824-81b8-452a-8105-8a92c313b426 tempest-VolumeImageDependencyTests-1254163555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dea9db69-d7e9-405d-9bf3-eb2c8027c679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:03:08 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-215c3824-81b8-452a-8105-8a92c313b426 tempest-VolumeImageDependencyTests-1254163555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ddb0a8c-af11-43d0-8f35-a1e9263e395e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:03:08 devstack cinder-volume[86984]: DEBUG cinder.image.glance [None req-215c3824-81b8-452a-8105-8a92c313b426 tempest-VolumeImageDependencyTests-1254163555 None] Creating Keystone auth plugin from conf {{(pid=86984) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 12:03:08 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2fc112fe-d169-4410-a012-dbec966a34e6 tempest-CreateVolumesFromImageTest-2103843249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14db1208-4af7-49b1-b6c2-2fc8dd5e89f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f58904e3-8257-476b-90b2-ce4b41f5da7c', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:03:08 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2fc112fe-d169-4410-a012-dbec966a34e6 tempest-CreateVolumesFromImageTest-2103843249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2852f939-61ba-4b63-ba5f-1bdcb451e2a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:03:08 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-c00c2c8b-b486-4e95-9882-3c863777af49 tempest-CreateVolumesFromSnapshotTest-8387161 None] Lock "cinder-quobyte-5f99efd7-a969-4426-901e-b71518535f06" acquired by "delete_volume" :: waited 0.088s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:03:08 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-2fc112fe-d169-4410-a012-dbec966a34e6 tempest-CreateVolumesFromImageTest-2103843249 None] Volume volume-f58904e3-8257-476b-90b2-ce4b41f5da7c (f58904e3-8257-476b-90b2-ce4b41f5da7c): created successfully Sep 25 12:03:08 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2fc112fe-d169-4410-a012-dbec966a34e6 tempest-CreateVolumesFromImageTest-2103843249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2852f939-61ba-4b63-ba5f-1bdcb451e2a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:03:08 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2fc112fe-d169-4410-a012-dbec966a34e6 tempest-CreateVolumesFromImageTest-2103843249 None] Flow 'volume_create_manager' (94170560-4c06-4fde-8fb9-420d565119f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:03:08 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[132dbb9d-89f6-4446-ae6b-c004c0153f68]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:03:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-c00c2c8b-b486-4e95-9882-3c863777af49 tempest-CreateVolumesFromSnapshotTest-8387161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5f99efd7-a969-4426-901e-b71518535f06 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:08 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-2fc112fe-d169-4410-a012-dbec966a34e6 tempest-CreateVolumesFromImageTest-2103843249 None] Created volume successfully. Sep 25 12:03:08 devstack sudo[107649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5f99efd7-a969-4426-901e-b71518535f06 Sep 25 12:03:08 devstack sudo[107649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:08 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-215c3824-81b8-452a-8105-8a92c313b426 tempest-VolumeImageDependencyTests-1254163555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ddb0a8c-af11-43d0-8f35-a1e9263e395e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f1a2fa1f-67eb-4d66-9150-d7ab816a9788', 'volume_name': 'volume-f1a2fa1f-67eb-4d66-9150-d7ab816a9788', 'volume_size': 1, 'image_id': 'e07e0488-b8d9-48a3-a76e-30a63968a2d3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e07e0488-b8d9-48a3-a76e-30a63968a2d3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '48ed88aa0f06001f2cef2a06687a972d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '28ab0c68e8fe4d66a925724cdaa58d76', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7503116173b9f6a715a599ce3a25c1033ad87363f32a1b4c20a4821e709920ced63b35e85471463acd3e9119949a81efe1d8862aedb225f722f798b36bf570cd', 'id': 'e07e0488-b8d9-48a3-a76e-30a63968a2d3', 'created_at': datetime.datetime(2026, 9, 25, 10, 3, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 10, 3, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e07e0488-b8d9-48a3-a76e-30a63968a2d3/file', 'properties': {}}, 'image_service': }' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:03:08 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-215c3824-81b8-452a-8105-8a92c313b426 tempest-VolumeImageDependencyTests-1254163555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1296311e-97c4-490f-8d3b-d1bd8beb8d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:03:08 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-215c3824-81b8-452a-8105-8a92c313b426 tempest-VolumeImageDependencyTests-1254163555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1296311e-97c4-490f-8d3b-d1bd8beb8d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:03:08 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-215c3824-81b8-452a-8105-8a92c313b426 tempest-VolumeImageDependencyTests-1254163555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (691263d2-d062-44da-b9df-3ff30ab33c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:03:08 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-215c3824-81b8-452a-8105-8a92c313b426 tempest-VolumeImageDependencyTests-1254163555 None] Volume f1a2fa1f-67eb-4d66-9150-d7ab816a9788: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f1a2fa1f-67eb-4d66-9150-d7ab816a9788', 'volume_size': 1, 'image_id': 'e07e0488-b8d9-48a3-a76e-30a63968a2d3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e07e0488-b8d9-48a3-a76e-30a63968a2d3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '48ed88aa0f06001f2cef2a06687a972d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '28ab0c68e8fe4d66a925724cdaa58d76', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7503116173b9f6a715a599ce3a25c1033ad87363f32a1b4c20a4821e709920ced63b35e85471463acd3e9119949a81efe1d8862aedb225f722f798b36bf570cd', 'id': 'e07e0488-b8d9-48a3-a76e-30a63968a2d3', 'created_at': datetime.datetime(2026, 9, 25, 10, 3, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 10, 3, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e07e0488-b8d9-48a3-a76e-30a63968a2d3/file', 'properties': {}}, 'image_service': } Sep 25 12:03:08 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-215c3824-81b8-452a-8105-8a92c313b426 tempest-VolumeImageDependencyTests-1254163555 None] Trying to clone f1a2fa1f-67eb-4d66-9150-d7ab816a9788 from image e07e0488-b8d9-48a3-a76e-30a63968a2d3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e07e0488-b8d9-48a3-a76e-30a63968a2d3', 'metadata': {}}]). {{(pid=86984) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 12:03:08 devstack cinder-volume[86984]: DEBUG cinder.image.image_utils [None req-215c3824-81b8-452a-8105-8a92c313b426 tempest-VolumeImageDependencyTests-1254163555 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e07e0488-b8d9-48a3-a76e-30a63968a2d3_ducu4pwsdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86984) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 12:03:08 devstack cinder-volume[86984]: INFO cinder.image.image_utils [None req-215c3824-81b8-452a-8105-8a92c313b426 tempest-VolumeImageDependencyTests-1254163555 None] Image download 0.00 MB at 0.00 MB/s Sep 25 12:03:08 devstack sudo[107647]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7af161ee-0bba-4e69-86ac-4ec7e8608142 tempest-CreateVolumesFromImageTest-2103843249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0ca1bb93-35c8-425a-bc68-51efdfb816c0 1073741824" returned: 0 in 0.720s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:08 devstack sudo[107649]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-c00c2c8b-b486-4e95-9882-3c863777af49 tempest-CreateVolumesFromSnapshotTest-8387161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5f99efd7-a969-4426-901e-b71518535f06" returned: 0 in 0.591s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-c00c2c8b-b486-4e95-9882-3c863777af49 tempest-CreateVolumesFromSnapshotTest-8387161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5f99efd7-a969-4426-901e-b71518535f06 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:08 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb26b367-ebf3-4635-9d44-3ddfd56be2d6]: (4, 'raw') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:03:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-215c3824-81b8-452a-8105-8a92c313b426 tempest-VolumeImageDependencyTests-1254163555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e07e0488-b8d9-48a3-a76e-30a63968a2d3_ducu4pwsdevstack@QuobyteHD {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:08 devstack sudo[107658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5f99efd7-a969-4426-901e-b71518535f06 Sep 25 12:03:08 devstack sudo[107658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7af161ee-0bba-4e69-86ac-4ec7e8608142 tempest-CreateVolumesFromImageTest-2103843249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0ca1bb93-35c8-425a-bc68-51efdfb816c0 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:08 devstack sudo[107661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0ca1bb93-35c8-425a-bc68-51efdfb816c0 Sep 25 12:03:08 devstack sudo[107661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:09 devstack sudo[107659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e07e0488-b8d9-48a3-a76e-30a63968a2d3_ducu4pwsdevstack@QuobyteHD Sep 25 12:03:09 devstack sudo[107659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:09 devstack sudo[107658]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-c00c2c8b-b486-4e95-9882-3c863777af49 tempest-CreateVolumesFromSnapshotTest-8387161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5f99efd7-a969-4426-901e-b71518535f06" returned: 0 in 0.452s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:09 devstack sudo[107661]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7af161ee-0bba-4e69-86ac-4ec7e8608142 tempest-CreateVolumesFromImageTest-2103843249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0ca1bb93-35c8-425a-bc68-51efdfb816c0" returned: 0 in 0.422s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:09 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-7af161ee-0bba-4e69-86ac-4ec7e8608142 tempest-CreateVolumesFromImageTest-2103843249 None] <== create_volume: return (1239ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:03:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-7af161ee-0bba-4e69-86ac-4ec7e8608142 tempest-CreateVolumesFromImageTest-2103843249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.241s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:03:09 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-c00c2c8b-b486-4e95-9882-3c863777af49 tempest-CreateVolumesFromSnapshotTest-8387161 None] Lock "cinder-quobyte-5f99efd7-a969-4426-901e-b71518535f06" released by "delete_volume" :: held 1.170s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:03:09 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7af161ee-0bba-4e69-86ac-4ec7e8608142 tempest-CreateVolumesFromImageTest-2103843249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d1d3307-c213-4e70-b6c8-359f9f4cbce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ca1bb93-35c8-425a-bc68-51efdfb816c0', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:03:09 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7af161ee-0bba-4e69-86ac-4ec7e8608142 tempest-CreateVolumesFromImageTest-2103843249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24abd1a1-71f5-4438-889d-8a18dd37a36d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:03:09 devstack sudo[107659]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-215c3824-81b8-452a-8105-8a92c313b426 tempest-VolumeImageDependencyTests-1254163555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e07e0488-b8d9-48a3-a76e-30a63968a2d3_ducu4pwsdevstack@QuobyteHD" returned: 0 in 0.517s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-215c3824-81b8-452a-8105-8a92c313b426 tempest-VolumeImageDependencyTests-1254163555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e07e0488-b8d9-48a3-a76e-30a63968a2d3_ducu4pwsdevstack@QuobyteHD {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:09 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-7af161ee-0bba-4e69-86ac-4ec7e8608142 tempest-CreateVolumesFromImageTest-2103843249 None] Volume volume-0ca1bb93-35c8-425a-bc68-51efdfb816c0 (0ca1bb93-35c8-425a-bc68-51efdfb816c0): created successfully Sep 25 12:03:09 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7af161ee-0bba-4e69-86ac-4ec7e8608142 tempest-CreateVolumesFromImageTest-2103843249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24abd1a1-71f5-4438-889d-8a18dd37a36d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:03:09 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-7af161ee-0bba-4e69-86ac-4ec7e8608142 tempest-CreateVolumesFromImageTest-2103843249 None] Flow 'volume_create_manager' (d80448fc-079d-4135-9b26-5645e5d8d3cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:03:09 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-c00c2c8b-b486-4e95-9882-3c863777af49 tempest-CreateVolumesFromSnapshotTest-8387161 None] Created reservations ['7ccf16c3-f76e-411c-be26-77f14080746b', '7a497f5d-c47a-4f6e-a07e-052218feb744', 'c2de3ed2-9106-4f71-9264-5435e731daf7', '76360b59-0d42-420f-a837-3553e87b0090'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:03:09 devstack sudo[107668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e07e0488-b8d9-48a3-a76e-30a63968a2d3_ducu4pwsdevstack@QuobyteHD Sep 25 12:03:09 devstack sudo[107668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:09 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-7af161ee-0bba-4e69-86ac-4ec7e8608142 tempest-CreateVolumesFromImageTest-2103843249 None] Created volume successfully. Sep 25 12:03:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-c00c2c8b-b486-4e95-9882-3c863777af49 tempest-CreateVolumesFromSnapshotTest-8387161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:03:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-c00c2c8b-b486-4e95-9882-3c863777af49 tempest-CreateVolumesFromSnapshotTest-8387161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:03:09 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-c00c2c8b-b486-4e95-9882-3c863777af49 tempest-CreateVolumesFromSnapshotTest-8387161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:03:09 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-c00c2c8b-b486-4e95-9882-3c863777af49 tempest-CreateVolumesFromSnapshotTest-8387161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:03:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-c00c2c8b-b486-4e95-9882-3c863777af49 tempest-CreateVolumesFromSnapshotTest-8387161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:03:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-c00c2c8b-b486-4e95-9882-3c863777af49 tempest-CreateVolumesFromSnapshotTest-8387161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:09 devstack sudo[107673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 12:03:09 devstack sudo[107673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:09 devstack sudo[107668]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-215c3824-81b8-452a-8105-8a92c313b426 tempest-VolumeImageDependencyTests-1254163555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e07e0488-b8d9-48a3-a76e-30a63968a2d3_ducu4pwsdevstack@QuobyteHD" returned: 1 in 0.409s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-215c3824-81b8-452a-8105-8a92c313b426 tempest-VolumeImageDependencyTests-1254163555 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e07e0488-b8d9-48a3-a76e-30a63968a2d3_ducu4pwsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 12:03:09 devstack cinder-volume[86984]: DEBUG cinder.image.image_utils [None req-215c3824-81b8-452a-8105-8a92c313b426 tempest-VolumeImageDependencyTests-1254163555 None] Temporary image e07e0488-b8d9-48a3-a76e-30a63968a2d3 is fetched for user b1532628bdca4a0ab1910d5a67306e05. {{(pid=86984) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 12:03:09 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d9be72-1889-4190-9665-e60715b6d497]: (4, 'raw') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:03:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-215c3824-81b8-452a-8105-8a92c313b426 tempest-VolumeImageDependencyTests-1254163555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e07e0488-b8d9-48a3-a76e-30a63968a2d3_ducu4pwsdevstack@QuobyteHD {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:09 devstack sudo[107675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e07e0488-b8d9-48a3-a76e-30a63968a2d3_ducu4pwsdevstack@QuobyteHD Sep 25 12:03:09 devstack sudo[107675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:09 devstack sudo[107673]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-c00c2c8b-b486-4e95-9882-3c863777af49 tempest-CreateVolumesFromSnapshotTest-8387161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.332s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:09 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-c00c2c8b-b486-4e95-9882-3c863777af49 tempest-CreateVolumesFromSnapshotTest-8387161 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:03:10 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-c00c2c8b-b486-4e95-9882-3c863777af49 tempest-CreateVolumesFromSnapshotTest-8387161 None] Deleted volume successfully. Sep 25 12:03:10 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-c00c2c8b-b486-4e95-9882-3c863777af49 tempest-CreateVolumesFromSnapshotTest-8387161 None] Lock "cinder-5f99efd7-a969-4426-901e-b71518535f06-delete_volume" released by "delete_volume" :: held 2.158s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:03:10 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-628be0f3-7ebe-4e87-9a51-4c5aaa1ef0e7 tempest-CreateVolumesFromImageTest-2103843249 None] Acquiring lock "cinder-0ca1bb93-35c8-425a-bc68-51efdfb816c0-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:03:10 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-628be0f3-7ebe-4e87-9a51-4c5aaa1ef0e7 tempest-CreateVolumesFromImageTest-2103843249 None] Lock "cinder-0ca1bb93-35c8-425a-bc68-51efdfb816c0-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:03:10 devstack sudo[107675]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-215c3824-81b8-452a-8105-8a92c313b426 tempest-VolumeImageDependencyTests-1254163555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e07e0488-b8d9-48a3-a76e-30a63968a2d3_ducu4pwsdevstack@QuobyteHD" returned: 0 in 0.442s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-215c3824-81b8-452a-8105-8a92c313b426 tempest-VolumeImageDependencyTests-1254163555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e07e0488-b8d9-48a3-a76e-30a63968a2d3_ducu4pwsdevstack@QuobyteHD {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:10 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-628be0f3-7ebe-4e87-9a51-4c5aaa1ef0e7 tempest-CreateVolumesFromImageTest-2103843249 None] Acquiring lock "cinder-quobyte-0ca1bb93-35c8-425a-bc68-51efdfb816c0" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:03:10 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-628be0f3-7ebe-4e87-9a51-4c5aaa1ef0e7 tempest-CreateVolumesFromImageTest-2103843249 None] Lock "cinder-quobyte-0ca1bb93-35c8-425a-bc68-51efdfb816c0" acquired by "delete_volume" :: waited 0.023s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:03:10 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c3c9374-469b-4f2b-8009-7b8949624299]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:03:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-628be0f3-7ebe-4e87-9a51-4c5aaa1ef0e7 tempest-CreateVolumesFromImageTest-2103843249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0ca1bb93-35c8-425a-bc68-51efdfb816c0 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:10 devstack sudo[107680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e07e0488-b8d9-48a3-a76e-30a63968a2d3_ducu4pwsdevstack@QuobyteHD Sep 25 12:03:10 devstack sudo[107680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:10 devstack sudo[107681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0ca1bb93-35c8-425a-bc68-51efdfb816c0 Sep 25 12:03:10 devstack sudo[107681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:10 devstack sudo[107680]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-215c3824-81b8-452a-8105-8a92c313b426 tempest-VolumeImageDependencyTests-1254163555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e07e0488-b8d9-48a3-a76e-30a63968a2d3_ducu4pwsdevstack@QuobyteHD" returned: 1 in 0.471s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-215c3824-81b8-452a-8105-8a92c313b426 tempest-VolumeImageDependencyTests-1254163555 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e07e0488-b8d9-48a3-a76e-30a63968a2d3_ducu4pwsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 12:03:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-215c3824-81b8-452a-8105-8a92c313b426 tempest-VolumeImageDependencyTests-1254163555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:03:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-215c3824-81b8-452a-8105-8a92c313b426 tempest-VolumeImageDependencyTests-1254163555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:03:10 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-215c3824-81b8-452a-8105-8a92c313b426 tempest-VolumeImageDependencyTests-1254163555 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:03:07Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1a2fa1f-67eb-4d66-9150-d7ab816a9788,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28ab0c68e8fe4d66a925724cdaa58d76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:03:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:03:08Z,use_quota=True,user_id='b1532628bdca4a0ab1910d5a67306e05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:03:10 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-215c3824-81b8-452a-8105-8a92c313b426 tempest-VolumeImageDependencyTests-1254163555 None] Creating volume f1a2fa1f-67eb-4d66-9150-d7ab816a9788 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:03:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-215c3824-81b8-452a-8105-8a92c313b426 tempest-VolumeImageDependencyTests-1254163555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:03:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-215c3824-81b8-452a-8105-8a92c313b426 tempest-VolumeImageDependencyTests-1254163555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:03:10 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-215c3824-81b8-452a-8105-8a92c313b426 tempest-VolumeImageDependencyTests-1254163555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:03:10 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-215c3824-81b8-452a-8105-8a92c313b426 tempest-VolumeImageDependencyTests-1254163555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:03:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-215c3824-81b8-452a-8105-8a92c313b426 tempest-VolumeImageDependencyTests-1254163555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:03:10 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-215c3824-81b8-452a-8105-8a92c313b426 tempest-VolumeImageDependencyTests-1254163555 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:03:10 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-215c3824-81b8-452a-8105-8a92c313b426 tempest-VolumeImageDependencyTests-1254163555 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 12:03:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-215c3824-81b8-452a-8105-8a92c313b426 tempest-VolumeImageDependencyTests-1254163555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f1a2fa1f-67eb-4d66-9150-d7ab816a9788 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:10 devstack sudo[107690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f1a2fa1f-67eb-4d66-9150-d7ab816a9788 1073741824 Sep 25 12:03:10 devstack sudo[107690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:10 devstack sudo[107681]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-628be0f3-7ebe-4e87-9a51-4c5aaa1ef0e7 tempest-CreateVolumesFromImageTest-2103843249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0ca1bb93-35c8-425a-bc68-51efdfb816c0" returned: 0 in 0.445s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-628be0f3-7ebe-4e87-9a51-4c5aaa1ef0e7 tempest-CreateVolumesFromImageTest-2103843249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0ca1bb93-35c8-425a-bc68-51efdfb816c0 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:10 devstack sudo[107692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0ca1bb93-35c8-425a-bc68-51efdfb816c0 Sep 25 12:03:10 devstack sudo[107692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:11 devstack sudo[107692]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-628be0f3-7ebe-4e87-9a51-4c5aaa1ef0e7 tempest-CreateVolumesFromImageTest-2103843249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-0ca1bb93-35c8-425a-bc68-51efdfb816c0" returned: 0 in 0.420s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:11 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-628be0f3-7ebe-4e87-9a51-4c5aaa1ef0e7 tempest-CreateVolumesFromImageTest-2103843249 None] Lock "cinder-quobyte-0ca1bb93-35c8-425a-bc68-51efdfb816c0" released by "delete_volume" :: held 0.938s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:03:11 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-628be0f3-7ebe-4e87-9a51-4c5aaa1ef0e7 tempest-CreateVolumesFromImageTest-2103843249 None] Created reservations ['a57ad1ab-3c0b-4be3-b3e6-3f255fb587ce', '44f57dba-31b3-45ce-9afe-683e0f49fbe2', 'b46b8d30-8b31-42a0-b95b-52c4c8c18628', '1d382884-72ae-4018-9cf2-d86fd5fb9318'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:03:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-628be0f3-7ebe-4e87-9a51-4c5aaa1ef0e7 tempest-CreateVolumesFromImageTest-2103843249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:03:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-628be0f3-7ebe-4e87-9a51-4c5aaa1ef0e7 tempest-CreateVolumesFromImageTest-2103843249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:03:11 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-628be0f3-7ebe-4e87-9a51-4c5aaa1ef0e7 tempest-CreateVolumesFromImageTest-2103843249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:03:11 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-628be0f3-7ebe-4e87-9a51-4c5aaa1ef0e7 tempest-CreateVolumesFromImageTest-2103843249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:03:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-628be0f3-7ebe-4e87-9a51-4c5aaa1ef0e7 tempest-CreateVolumesFromImageTest-2103843249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:03:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-628be0f3-7ebe-4e87-9a51-4c5aaa1ef0e7 tempest-CreateVolumesFromImageTest-2103843249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:11 devstack sudo[107690]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-215c3824-81b8-452a-8105-8a92c313b426 tempest-VolumeImageDependencyTests-1254163555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f1a2fa1f-67eb-4d66-9150-d7ab816a9788 1073741824" returned: 0 in 0.790s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:11 devstack sudo[107699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 12:03:11 devstack sudo[107699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-215c3824-81b8-452a-8105-8a92c313b426 tempest-VolumeImageDependencyTests-1254163555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f1a2fa1f-67eb-4d66-9150-d7ab816a9788 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:11 devstack sudo[107701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f1a2fa1f-67eb-4d66-9150-d7ab816a9788 Sep 25 12:03:11 devstack sudo[107701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:11 devstack sudo[107699]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-628be0f3-7ebe-4e87-9a51-4c5aaa1ef0e7 tempest-CreateVolumesFromImageTest-2103843249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.382s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:11 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-628be0f3-7ebe-4e87-9a51-4c5aaa1ef0e7 tempest-CreateVolumesFromImageTest-2103843249 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:03:11 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-628be0f3-7ebe-4e87-9a51-4c5aaa1ef0e7 tempest-CreateVolumesFromImageTest-2103843249 None] Deleted volume successfully. Sep 25 12:03:11 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-628be0f3-7ebe-4e87-9a51-4c5aaa1ef0e7 tempest-CreateVolumesFromImageTest-2103843249 None] Lock "cinder-0ca1bb93-35c8-425a-bc68-51efdfb816c0-delete_volume" released by "delete_volume" :: held 1.730s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:03:11 devstack sudo[107701]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-215c3824-81b8-452a-8105-8a92c313b426 tempest-VolumeImageDependencyTests-1254163555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f1a2fa1f-67eb-4d66-9150-d7ab816a9788" returned: 0 in 0.383s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:11 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-215c3824-81b8-452a-8105-8a92c313b426 tempest-VolumeImageDependencyTests-1254163555 None] <== create_volume: return (1260ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:03:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-215c3824-81b8-452a-8105-8a92c313b426 tempest-VolumeImageDependencyTests-1254163555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.263s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:03:12 devstack cinder-volume[86984]: DEBUG cinder.volume.volume_utils [None req-215c3824-81b8-452a-8105-8a92c313b426 tempest-VolumeImageDependencyTests-1254163555 None] Attempting download of e07e0488-b8d9-48a3-a76e-30a63968a2d3 ((None, [{'url': 'file:///opt/stack/data/glance/images/e07e0488-b8d9-48a3-a76e-30a63968a2d3', 'metadata': {}}])) to volume f1a2fa1f-67eb-4d66-9150-d7ab816a9788. {{(pid=86984) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 12:03:12 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b96c31-718c-4bf8-b835-db4708e0e43d]: (4, 'raw') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:03:12 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-215c3824-81b8-452a-8105-8a92c313b426 tempest-VolumeImageDependencyTests-1254163555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e07e0488-b8d9-48a3-a76e-30a63968a2d3_4ltx0xre {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:12 devstack sudo[107705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e07e0488-b8d9-48a3-a76e-30a63968a2d3_4ltx0xre Sep 25 12:03:12 devstack sudo[107705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:12 devstack sudo[107705]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:12 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-215c3824-81b8-452a-8105-8a92c313b426 tempest-VolumeImageDependencyTests-1254163555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e07e0488-b8d9-48a3-a76e-30a63968a2d3_4ltx0xre" returned: 0 in 0.406s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:12 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-215c3824-81b8-452a-8105-8a92c313b426 tempest-VolumeImageDependencyTests-1254163555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e07e0488-b8d9-48a3-a76e-30a63968a2d3_4ltx0xre {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:12 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-069867b0-f0b4-495f-9e61-b62d92b66155 tempest-CreateVolumesFromImageTest-2103843249 None] Acquiring lock "cinder-f58904e3-8257-476b-90b2-ce4b41f5da7c-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:03:12 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-069867b0-f0b4-495f-9e61-b62d92b66155 tempest-CreateVolumesFromImageTest-2103843249 None] Lock "cinder-f58904e3-8257-476b-90b2-ce4b41f5da7c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:03:12 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-069867b0-f0b4-495f-9e61-b62d92b66155 tempest-CreateVolumesFromImageTest-2103843249 None] Acquiring lock "cinder-quobyte-f58904e3-8257-476b-90b2-ce4b41f5da7c" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:03:12 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-069867b0-f0b4-495f-9e61-b62d92b66155 tempest-CreateVolumesFromImageTest-2103843249 None] Lock "cinder-quobyte-f58904e3-8257-476b-90b2-ce4b41f5da7c" acquired by "delete_volume" :: waited 0.018s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:03:12 devstack sudo[107709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e07e0488-b8d9-48a3-a76e-30a63968a2d3_4ltx0xre Sep 25 12:03:12 devstack sudo[107709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:12 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[1108f5fa-84b4-4835-939e-1d4d21452db2]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:03:12 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-069867b0-f0b4-495f-9e61-b62d92b66155 tempest-CreateVolumesFromImageTest-2103843249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f58904e3-8257-476b-90b2-ce4b41f5da7c {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:12 devstack sudo[107711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f58904e3-8257-476b-90b2-ce4b41f5da7c Sep 25 12:03:12 devstack sudo[107711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:13 devstack sudo[107709]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:13 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-215c3824-81b8-452a-8105-8a92c313b426 tempest-VolumeImageDependencyTests-1254163555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e07e0488-b8d9-48a3-a76e-30a63968a2d3_4ltx0xre" returned: 1 in 0.546s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:13 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-215c3824-81b8-452a-8105-8a92c313b426 tempest-VolumeImageDependencyTests-1254163555 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e07e0488-b8d9-48a3-a76e-30a63968a2d3_4ltx0xre' failed. Not Retrying. {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 12:03:13 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c8b2d0b-73f8-44da-8cef-4bb745ad0e59]: (4, 'raw') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:03:13 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-215c3824-81b8-452a-8105-8a92c313b426 tempest-VolumeImageDependencyTests-1254163555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e07e0488-b8d9-48a3-a76e-30a63968a2d3_ducu4pwsdevstack@QuobyteHD {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:13 devstack sudo[107715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e07e0488-b8d9-48a3-a76e-30a63968a2d3_ducu4pwsdevstack@QuobyteHD Sep 25 12:03:13 devstack sudo[107715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:13 devstack sudo[107711]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:13 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-069867b0-f0b4-495f-9e61-b62d92b66155 tempest-CreateVolumesFromImageTest-2103843249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f58904e3-8257-476b-90b2-ce4b41f5da7c" returned: 0 in 0.584s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:13 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-069867b0-f0b4-495f-9e61-b62d92b66155 tempest-CreateVolumesFromImageTest-2103843249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f58904e3-8257-476b-90b2-ce4b41f5da7c {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:13 devstack sudo[107720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f58904e3-8257-476b-90b2-ce4b41f5da7c Sep 25 12:03:13 devstack sudo[107720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:13 devstack sudo[107715]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:13 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-215c3824-81b8-452a-8105-8a92c313b426 tempest-VolumeImageDependencyTests-1254163555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e07e0488-b8d9-48a3-a76e-30a63968a2d3_ducu4pwsdevstack@QuobyteHD" returned: 0 in 0.524s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:13 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-215c3824-81b8-452a-8105-8a92c313b426 tempest-VolumeImageDependencyTests-1254163555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e07e0488-b8d9-48a3-a76e-30a63968a2d3_ducu4pwsdevstack@QuobyteHD {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:13 devstack sudo[107720]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:13 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-069867b0-f0b4-495f-9e61-b62d92b66155 tempest-CreateVolumesFromImageTest-2103843249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f58904e3-8257-476b-90b2-ce4b41f5da7c" returned: 0 in 0.400s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:13 devstack sudo[107724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e07e0488-b8d9-48a3-a76e-30a63968a2d3_ducu4pwsdevstack@QuobyteHD Sep 25 12:03:13 devstack sudo[107724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:13 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-069867b0-f0b4-495f-9e61-b62d92b66155 tempest-CreateVolumesFromImageTest-2103843249 None] Lock "cinder-quobyte-f58904e3-8257-476b-90b2-ce4b41f5da7c" released by "delete_volume" :: held 1.075s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:03:13 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-069867b0-f0b4-495f-9e61-b62d92b66155 tempest-CreateVolumesFromImageTest-2103843249 None] Created reservations ['01dbb00a-78b9-4201-9276-dfce4b15d043', '00f6836b-180b-4436-bae5-0eff827bdc19', 'b26718f6-22b4-400d-8791-43ed5ff675ea', '7d228f7f-4b70-45b5-beaa-aa503f79d41f'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:03:14 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-069867b0-f0b4-495f-9e61-b62d92b66155 tempest-CreateVolumesFromImageTest-2103843249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:03:14 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-069867b0-f0b4-495f-9e61-b62d92b66155 tempest-CreateVolumesFromImageTest-2103843249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:03:14 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-069867b0-f0b4-495f-9e61-b62d92b66155 tempest-CreateVolumesFromImageTest-2103843249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:03:14 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-069867b0-f0b4-495f-9e61-b62d92b66155 tempest-CreateVolumesFromImageTest-2103843249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:03:14 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-069867b0-f0b4-495f-9e61-b62d92b66155 tempest-CreateVolumesFromImageTest-2103843249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:03:14 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-069867b0-f0b4-495f-9e61-b62d92b66155 tempest-CreateVolumesFromImageTest-2103843249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:14 devstack sudo[107724]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:14 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-215c3824-81b8-452a-8105-8a92c313b426 tempest-VolumeImageDependencyTests-1254163555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e07e0488-b8d9-48a3-a76e-30a63968a2d3_ducu4pwsdevstack@QuobyteHD" returned: 1 in 0.523s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:14 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-215c3824-81b8-452a-8105-8a92c313b426 tempest-VolumeImageDependencyTests-1254163555 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e07e0488-b8d9-48a3-a76e-30a63968a2d3_ducu4pwsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 12:03:14 devstack cinder-volume[86984]: DEBUG cinder.image.image_utils [None req-215c3824-81b8-452a-8105-8a92c313b426 tempest-VolumeImageDependencyTests-1254163555 None] e07e0488-b8d9-48a3-a76e-30a63968a2d3 was raw, converting to qcow2 {{(pid=86984) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 12:03:14 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-215c3824-81b8-452a-8105-8a92c313b426 tempest-VolumeImageDependencyTests-1254163555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e07e0488-b8d9-48a3-a76e-30a63968a2d3_ducu4pwsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f1a2fa1f-67eb-4d66-9150-d7ab816a9788 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:14 devstack sudo[107731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 12:03:14 devstack sudo[107731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:14 devstack sudo[107733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e07e0488-b8d9-48a3-a76e-30a63968a2d3_ducu4pwsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f1a2fa1f-67eb-4d66-9150-d7ab816a9788 Sep 25 12:03:14 devstack sudo[107733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:14 devstack sudo[107731]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:14 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-069867b0-f0b4-495f-9e61-b62d92b66155 tempest-CreateVolumesFromImageTest-2103843249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.527s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:14 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-069867b0-f0b4-495f-9e61-b62d92b66155 tempest-CreateVolumesFromImageTest-2103843249 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:03:14 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-069867b0-f0b4-495f-9e61-b62d92b66155 tempest-CreateVolumesFromImageTest-2103843249 None] Deleted volume successfully. Sep 25 12:03:14 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-069867b0-f0b4-495f-9e61-b62d92b66155 tempest-CreateVolumesFromImageTest-2103843249 None] Lock "cinder-f58904e3-8257-476b-90b2-ce4b41f5da7c-delete_volume" released by "delete_volume" :: held 2.024s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:03:14 devstack sudo[107733]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:14 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-215c3824-81b8-452a-8105-8a92c313b426 tempest-VolumeImageDependencyTests-1254163555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e07e0488-b8d9-48a3-a76e-30a63968a2d3_ducu4pwsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f1a2fa1f-67eb-4d66-9150-d7ab816a9788" returned: 0 in 0.772s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:14 devstack cinder-volume[86984]: DEBUG cinder.image.image_utils [None req-215c3824-81b8-452a-8105-8a92c313b426 tempest-VolumeImageDependencyTests-1254163555 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e07e0488-b8d9-48a3-a76e-30a63968a2d3_ducu4pwsdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f1a2fa1f-67eb-4d66-9150-d7ab816a9788 {{(pid=86984) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 12:03:14 devstack cinder-volume[86984]: INFO cinder.image.image_utils [None req-215c3824-81b8-452a-8105-8a92c313b426 tempest-VolumeImageDependencyTests-1254163555 None] Converted 0.00 MB image at 0.00 MB/s Sep 25 12:03:14 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-215c3824-81b8-452a-8105-8a92c313b426 tempest-VolumeImageDependencyTests-1254163555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f1a2fa1f-67eb-4d66-9150-d7ab816a9788 1G {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:14 devstack sudo[107740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f1a2fa1f-67eb-4d66-9150-d7ab816a9788 1G Sep 25 12:03:14 devstack sudo[107740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:15 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e566dbd7-b51e-4bf5-beb5-78dabeb5e667 tempest-CreateVolumesFromImageTest-2103843249 None] Acquiring lock "cinder-1d4dfcfe-768a-4a59-a6a5-c6fa616482c9-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:03:15 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e566dbd7-b51e-4bf5-beb5-78dabeb5e667 tempest-CreateVolumesFromImageTest-2103843249 None] Lock "cinder-1d4dfcfe-768a-4a59-a6a5-c6fa616482c9-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:03:15 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e566dbd7-b51e-4bf5-beb5-78dabeb5e667 tempest-CreateVolumesFromImageTest-2103843249 None] Acquiring lock "cinder-quobyte-1d4dfcfe-768a-4a59-a6a5-c6fa616482c9" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:03:15 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e566dbd7-b51e-4bf5-beb5-78dabeb5e667 tempest-CreateVolumesFromImageTest-2103843249 None] Lock "cinder-quobyte-1d4dfcfe-768a-4a59-a6a5-c6fa616482c9" acquired by "delete_volume" :: waited 0.029s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:03:15 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd060cc5-4a9a-467c-a998-931ac79cbf6c]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:03:15 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e566dbd7-b51e-4bf5-beb5-78dabeb5e667 tempest-CreateVolumesFromImageTest-2103843249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1d4dfcfe-768a-4a59-a6a5-c6fa616482c9 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:15 devstack sudo[107744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1d4dfcfe-768a-4a59-a6a5-c6fa616482c9 Sep 25 12:03:15 devstack sudo[107744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:15 devstack sudo[107740]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:15 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-215c3824-81b8-452a-8105-8a92c313b426 tempest-VolumeImageDependencyTests-1254163555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f1a2fa1f-67eb-4d66-9150-d7ab816a9788 1G" returned: 0 in 0.520s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:15 devstack cinder-volume[86984]: DEBUG cinder.volume.volume_utils [None req-215c3824-81b8-452a-8105-8a92c313b426 tempest-VolumeImageDependencyTests-1254163555 None] Downloaded image e07e0488-b8d9-48a3-a76e-30a63968a2d3 ((None, [{'url': 'file:///opt/stack/data/glance/images/e07e0488-b8d9-48a3-a76e-30a63968a2d3', 'metadata': {}}])) to volume f1a2fa1f-67eb-4d66-9150-d7ab816a9788 successfully. {{(pid=86984) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 12:03:15 devstack cinder-volume[86984]: DEBUG cinder.image.image_utils [None req-215c3824-81b8-452a-8105-8a92c313b426 tempest-VolumeImageDependencyTests-1254163555 None] Temporary image e07e0488-b8d9-48a3-a76e-30a63968a2d3 for user b1532628bdca4a0ab1910d5a67306e05 is deleted. {{(pid=86984) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 12:03:15 devstack cinder-volume[86984]: DEBUG cinder.volume.volume_utils [None req-215c3824-81b8-452a-8105-8a92c313b426 tempest-VolumeImageDependencyTests-1254163555 None] Marking volume f1a2fa1f-67eb-4d66-9150-d7ab816a9788 as bootable. {{(pid=86984) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 12:03:15 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-215c3824-81b8-452a-8105-8a92c313b426 tempest-VolumeImageDependencyTests-1254163555 None] Copying metadata from image e07e0488-b8d9-48a3-a76e-30a63968a2d3 to f1a2fa1f-67eb-4d66-9150-d7ab816a9788. {{(pid=86984) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 12:03:15 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-215c3824-81b8-452a-8105-8a92c313b426 tempest-VolumeImageDependencyTests-1254163555 None] Creating volume glance metadata for volume f1a2fa1f-67eb-4d66-9150-d7ab816a9788 backed by image e07e0488-b8d9-48a3-a76e-30a63968a2d3 with: {'image_id': 'e07e0488-b8d9-48a3-a76e-30a63968a2d3', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '48ed88aa0f06001f2cef2a06687a972d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86984) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 12:03:15 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-215c3824-81b8-452a-8105-8a92c313b426 tempest-VolumeImageDependencyTests-1254163555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (691263d2-d062-44da-b9df-3ff30ab33c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1a2fa1f-67eb-4d66-9150-d7ab816a9788', 'volume_size': 1, 'image_id': 'e07e0488-b8d9-48a3-a76e-30a63968a2d3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e07e0488-b8d9-48a3-a76e-30a63968a2d3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '48ed88aa0f06001f2cef2a06687a972d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '28ab0c68e8fe4d66a925724cdaa58d76', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7503116173b9f6a715a599ce3a25c1033ad87363f32a1b4c20a4821e709920ced63b35e85471463acd3e9119949a81efe1d8862aedb225f722f798b36bf570cd', 'id': 'e07e0488-b8d9-48a3-a76e-30a63968a2d3', 'created_at': datetime.datetime(2026, 9, 25, 10, 3, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 10, 3, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e07e0488-b8d9-48a3-a76e-30a63968a2d3/file', 'properties': {}}, 'image_service': }' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:03:15 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-215c3824-81b8-452a-8105-8a92c313b426 tempest-VolumeImageDependencyTests-1254163555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1981fba0-af24-49e2-8988-f30aa0da8ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:03:15 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-215c3824-81b8-452a-8105-8a92c313b426 tempest-VolumeImageDependencyTests-1254163555 None] Volume volume-f1a2fa1f-67eb-4d66-9150-d7ab816a9788 (f1a2fa1f-67eb-4d66-9150-d7ab816a9788): created successfully Sep 25 12:03:15 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-215c3824-81b8-452a-8105-8a92c313b426 tempest-VolumeImageDependencyTests-1254163555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1981fba0-af24-49e2-8988-f30aa0da8ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:03:15 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-215c3824-81b8-452a-8105-8a92c313b426 tempest-VolumeImageDependencyTests-1254163555 None] Flow 'volume_create_manager' (34fb65f7-195c-48eb-9e9f-86a99c122c86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:03:15 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-215c3824-81b8-452a-8105-8a92c313b426 tempest-VolumeImageDependencyTests-1254163555 None] Created volume successfully. Sep 25 12:03:15 devstack sudo[107744]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:15 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e566dbd7-b51e-4bf5-beb5-78dabeb5e667 tempest-CreateVolumesFromImageTest-2103843249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1d4dfcfe-768a-4a59-a6a5-c6fa616482c9" returned: 0 in 0.511s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:15 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e566dbd7-b51e-4bf5-beb5-78dabeb5e667 tempest-CreateVolumesFromImageTest-2103843249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1d4dfcfe-768a-4a59-a6a5-c6fa616482c9 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:15 devstack sudo[107751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1d4dfcfe-768a-4a59-a6a5-c6fa616482c9 Sep 25 12:03:15 devstack sudo[107751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:16 devstack sudo[107751]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:16 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e566dbd7-b51e-4bf5-beb5-78dabeb5e667 tempest-CreateVolumesFromImageTest-2103843249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1d4dfcfe-768a-4a59-a6a5-c6fa616482c9" returned: 0 in 0.365s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:16 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e566dbd7-b51e-4bf5-beb5-78dabeb5e667 tempest-CreateVolumesFromImageTest-2103843249 None] Lock "cinder-quobyte-1d4dfcfe-768a-4a59-a6a5-c6fa616482c9" released by "delete_volume" :: held 0.976s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:03:16 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a65a153-824a-4b8b-a2cc-adcefa7cdc00 tempest-VolumeDependencyTests-1884220744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:03:16 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-5a65a153-824a-4b8b-a2cc-adcefa7cdc00 tempest-VolumeDependencyTests-1884220744 None] Flow 'volume_create_manager' (cd1ac04e-0268-49e2-82ad-4c1198216354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:03:16 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-5a65a153-824a-4b8b-a2cc-adcefa7cdc00 tempest-VolumeDependencyTests-1884220744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc18fb96-1f13-4fef-8ee3-0569fdf698af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:03:16 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-5a65a153-824a-4b8b-a2cc-adcefa7cdc00 tempest-VolumeDependencyTests-1884220744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc18fb96-1f13-4fef-8ee3-0569fdf698af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:03:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-166709948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d00fd22-141f-4510-ad1c-c8553495d390,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9c31aac074743038621babd9915d4ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:03:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:03:16Z,use_quota=True,user_id='35213cd71cc148b6888afb4e00e217c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:03:16 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-5a65a153-824a-4b8b-a2cc-adcefa7cdc00 tempest-VolumeDependencyTests-1884220744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (983200aa-fb33-4634-afef-5f6723c95755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:03:16 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-5a65a153-824a-4b8b-a2cc-adcefa7cdc00 tempest-VolumeDependencyTests-1884220744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (983200aa-fb33-4634-afef-5f6723c95755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:03:16 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-5a65a153-824a-4b8b-a2cc-adcefa7cdc00 tempest-VolumeDependencyTests-1884220744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae236c4e-4fde-411e-81a7-c476f763ea86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:03:16 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-5a65a153-824a-4b8b-a2cc-adcefa7cdc00 tempest-VolumeDependencyTests-1884220744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae236c4e-4fde-411e-81a7-c476f763ea86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d00fd22-141f-4510-ad1c-c8553495d390', 'volume_name': 'volume-5d00fd22-141f-4510-ad1c-c8553495d390', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:03:16 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-5a65a153-824a-4b8b-a2cc-adcefa7cdc00 tempest-VolumeDependencyTests-1884220744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7860a9db-f0b8-4edb-92d4-8741d8a4bd1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:03:16 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-5a65a153-824a-4b8b-a2cc-adcefa7cdc00 tempest-VolumeDependencyTests-1884220744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7860a9db-f0b8-4edb-92d4-8741d8a4bd1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:03:16 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-5a65a153-824a-4b8b-a2cc-adcefa7cdc00 tempest-VolumeDependencyTests-1884220744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46910601-e9ee-45b5-9274-a28ecc3aa85b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:03:16 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-5a65a153-824a-4b8b-a2cc-adcefa7cdc00 tempest-VolumeDependencyTests-1884220744 None] Volume 5d00fd22-141f-4510-ad1c-c8553495d390: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d00fd22-141f-4510-ad1c-c8553495d390', 'volume_size': 1} Sep 25 12:03:16 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-5a65a153-824a-4b8b-a2cc-adcefa7cdc00 tempest-VolumeDependencyTests-1884220744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:03:16 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-5a65a153-824a-4b8b-a2cc-adcefa7cdc00 tempest-VolumeDependencyTests-1884220744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:03:16 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-5a65a153-824a-4b8b-a2cc-adcefa7cdc00 tempest-VolumeDependencyTests-1884220744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:03:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-166709948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d00fd22-141f-4510-ad1c-c8553495d390,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9c31aac074743038621babd9915d4ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:03:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:03:16Z,use_quota=True,user_id='35213cd71cc148b6888afb4e00e217c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:03:16 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-5a65a153-824a-4b8b-a2cc-adcefa7cdc00 tempest-VolumeDependencyTests-1884220744 None] Creating volume 5d00fd22-141f-4510-ad1c-c8553495d390 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:03:16 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-5a65a153-824a-4b8b-a2cc-adcefa7cdc00 tempest-VolumeDependencyTests-1884220744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:03:16 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-5a65a153-824a-4b8b-a2cc-adcefa7cdc00 tempest-VolumeDependencyTests-1884220744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:03:16 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-5a65a153-824a-4b8b-a2cc-adcefa7cdc00 tempest-VolumeDependencyTests-1884220744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:03:16 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-5a65a153-824a-4b8b-a2cc-adcefa7cdc00 tempest-VolumeDependencyTests-1884220744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:03:16 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-5a65a153-824a-4b8b-a2cc-adcefa7cdc00 tempest-VolumeDependencyTests-1884220744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:03:16 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-5a65a153-824a-4b8b-a2cc-adcefa7cdc00 tempest-VolumeDependencyTests-1884220744 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:03:16 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-5a65a153-824a-4b8b-a2cc-adcefa7cdc00 tempest-VolumeDependencyTests-1884220744 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 12:03:16 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-5a65a153-824a-4b8b-a2cc-adcefa7cdc00 tempest-VolumeDependencyTests-1884220744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5d00fd22-141f-4510-ad1c-c8553495d390 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:16 devstack sudo[107754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5d00fd22-141f-4510-ad1c-c8553495d390 1073741824 Sep 25 12:03:16 devstack sudo[107754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:16 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-e566dbd7-b51e-4bf5-beb5-78dabeb5e667 tempest-CreateVolumesFromImageTest-2103843249 None] Created reservations ['3c4dc54f-ba1b-40e7-ad75-bfa9beb34fe3', '8d6d3a9f-3283-49c9-a8a8-4a3e64d2566d', '29c90778-28fd-4516-ab7b-b410deb33a56', '47dc50c6-6398-4307-a168-25e4d3852d80'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:03:16 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-e566dbd7-b51e-4bf5-beb5-78dabeb5e667 tempest-CreateVolumesFromImageTest-2103843249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:03:16 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-e566dbd7-b51e-4bf5-beb5-78dabeb5e667 tempest-CreateVolumesFromImageTest-2103843249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:03:16 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-e566dbd7-b51e-4bf5-beb5-78dabeb5e667 tempest-CreateVolumesFromImageTest-2103843249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:03:16 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-e566dbd7-b51e-4bf5-beb5-78dabeb5e667 tempest-CreateVolumesFromImageTest-2103843249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:03:16 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-e566dbd7-b51e-4bf5-beb5-78dabeb5e667 tempest-CreateVolumesFromImageTest-2103843249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:03:16 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e566dbd7-b51e-4bf5-beb5-78dabeb5e667 tempest-CreateVolumesFromImageTest-2103843249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:16 devstack sudo[107756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 12:03:16 devstack sudo[107756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:16 devstack sudo[107756]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:16 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e566dbd7-b51e-4bf5-beb5-78dabeb5e667 tempest-CreateVolumesFromImageTest-2103843249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.328s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:16 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-e566dbd7-b51e-4bf5-beb5-78dabeb5e667 tempest-CreateVolumesFromImageTest-2103843249 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:03:16 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-e566dbd7-b51e-4bf5-beb5-78dabeb5e667 tempest-CreateVolumesFromImageTest-2103843249 None] Deleted volume successfully. Sep 25 12:03:16 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e566dbd7-b51e-4bf5-beb5-78dabeb5e667 tempest-CreateVolumesFromImageTest-2103843249 None] Lock "cinder-1d4dfcfe-768a-4a59-a6a5-c6fa616482c9-delete_volume" released by "delete_volume" :: held 1.760s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:03:16 devstack sudo[107754]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:16 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-14d11019-730f-4646-9d68-4343dd72fe7a tempest-VolumeImageDependencyTests-1254163555 None] Acquiring lock "cinder-f1a2fa1f-67eb-4d66-9150-d7ab816a9788-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:03:16 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-5a65a153-824a-4b8b-a2cc-adcefa7cdc00 tempest-VolumeDependencyTests-1884220744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5d00fd22-141f-4510-ad1c-c8553495d390 1073741824" returned: 0 in 0.600s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:16 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-14d11019-730f-4646-9d68-4343dd72fe7a tempest-VolumeImageDependencyTests-1254163555 None] Lock "cinder-f1a2fa1f-67eb-4d66-9150-d7ab816a9788-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:03:16 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-14d11019-730f-4646-9d68-4343dd72fe7a tempest-VolumeImageDependencyTests-1254163555 None] Acquiring lock "cinder-quobyte-f1a2fa1f-67eb-4d66-9150-d7ab816a9788" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:03:16 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-14d11019-730f-4646-9d68-4343dd72fe7a tempest-VolumeImageDependencyTests-1254163555 None] Lock "cinder-quobyte-f1a2fa1f-67eb-4d66-9150-d7ab816a9788" acquired by "delete_volume" :: waited 0.016s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:03:16 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[b92ff4c0-3925-4b9e-a44a-2a653fb7d4d5]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:03:16 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-14d11019-730f-4646-9d68-4343dd72fe7a tempest-VolumeImageDependencyTests-1254163555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f1a2fa1f-67eb-4d66-9150-d7ab816a9788 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:17 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-5a65a153-824a-4b8b-a2cc-adcefa7cdc00 tempest-VolumeDependencyTests-1884220744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5d00fd22-141f-4510-ad1c-c8553495d390 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:17 devstack sudo[107764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5d00fd22-141f-4510-ad1c-c8553495d390 Sep 25 12:03:17 devstack sudo[107764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:17 devstack sudo[107763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f1a2fa1f-67eb-4d66-9150-d7ab816a9788 Sep 25 12:03:17 devstack sudo[107763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:17 devstack sudo[107764]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:17 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-5a65a153-824a-4b8b-a2cc-adcefa7cdc00 tempest-VolumeDependencyTests-1884220744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5d00fd22-141f-4510-ad1c-c8553495d390" returned: 0 in 0.441s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:17 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-5a65a153-824a-4b8b-a2cc-adcefa7cdc00 tempest-VolumeDependencyTests-1884220744 None] <== create_volume: return (1194ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:03:17 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-5a65a153-824a-4b8b-a2cc-adcefa7cdc00 tempest-VolumeDependencyTests-1884220744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.196s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:03:17 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-5a65a153-824a-4b8b-a2cc-adcefa7cdc00 tempest-VolumeDependencyTests-1884220744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46910601-e9ee-45b5-9274-a28ecc3aa85b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d00fd22-141f-4510-ad1c-c8553495d390', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:03:17 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-5a65a153-824a-4b8b-a2cc-adcefa7cdc00 tempest-VolumeDependencyTests-1884220744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68a1e37e-bae7-4c6a-a699-c8128f6c90cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:03:17 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-5a65a153-824a-4b8b-a2cc-adcefa7cdc00 tempest-VolumeDependencyTests-1884220744 None] Volume volume-5d00fd22-141f-4510-ad1c-c8553495d390 (5d00fd22-141f-4510-ad1c-c8553495d390): created successfully Sep 25 12:03:17 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-5a65a153-824a-4b8b-a2cc-adcefa7cdc00 tempest-VolumeDependencyTests-1884220744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68a1e37e-bae7-4c6a-a699-c8128f6c90cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:03:17 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-5a65a153-824a-4b8b-a2cc-adcefa7cdc00 tempest-VolumeDependencyTests-1884220744 None] Flow 'volume_create_manager' (cd1ac04e-0268-49e2-82ad-4c1198216354) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:03:17 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-6c437631-03ca-4703-a0ae-a0b32c00832b tempest-CreateVolumesFromImageTest-2103843249 None] Acquiring lock "cinder-3b9c60c7-bf91-45c9-b8fb-5f4a482d2d53-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:03:17 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-6c437631-03ca-4703-a0ae-a0b32c00832b tempest-CreateVolumesFromImageTest-2103843249 None] Lock "cinder-3b9c60c7-bf91-45c9-b8fb-5f4a482d2d53-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:03:17 devstack sudo[107763]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:17 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-14d11019-730f-4646-9d68-4343dd72fe7a tempest-VolumeImageDependencyTests-1254163555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f1a2fa1f-67eb-4d66-9150-d7ab816a9788" returned: 0 in 0.631s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:17 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-14d11019-730f-4646-9d68-4343dd72fe7a tempest-VolumeImageDependencyTests-1254163555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f1a2fa1f-67eb-4d66-9150-d7ab816a9788 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:17 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-5a65a153-824a-4b8b-a2cc-adcefa7cdc00 tempest-VolumeDependencyTests-1884220744 None] Created volume successfully. Sep 25 12:03:17 devstack sudo[107772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f1a2fa1f-67eb-4d66-9150-d7ab816a9788 Sep 25 12:03:17 devstack sudo[107772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:17 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-6c437631-03ca-4703-a0ae-a0b32c00832b tempest-CreateVolumesFromImageTest-2103843249 None] Acquiring lock "cinder-quobyte-3b9c60c7-bf91-45c9-b8fb-5f4a482d2d53" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:03:17 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-6c437631-03ca-4703-a0ae-a0b32c00832b tempest-CreateVolumesFromImageTest-2103843249 None] Lock "cinder-quobyte-3b9c60c7-bf91-45c9-b8fb-5f4a482d2d53" acquired by "delete_volume" :: waited 0.022s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:03:17 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5f304f-c13d-4d84-9d43-4bbdae66a50e]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:03:17 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6c437631-03ca-4703-a0ae-a0b32c00832b tempest-CreateVolumesFromImageTest-2103843249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-3b9c60c7-bf91-45c9-b8fb-5f4a482d2d53 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:17 devstack sudo[107774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-3b9c60c7-bf91-45c9-b8fb-5f4a482d2d53 Sep 25 12:03:17 devstack sudo[107774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:17 devstack sudo[107772]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:17 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-14d11019-730f-4646-9d68-4343dd72fe7a tempest-VolumeImageDependencyTests-1254163555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f1a2fa1f-67eb-4d66-9150-d7ab816a9788" returned: 0 in 0.329s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:17 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-14d11019-730f-4646-9d68-4343dd72fe7a tempest-VolumeImageDependencyTests-1254163555 None] Lock "cinder-quobyte-f1a2fa1f-67eb-4d66-9150-d7ab816a9788" released by "delete_volume" :: held 1.016s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:03:18 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-14d11019-730f-4646-9d68-4343dd72fe7a tempest-VolumeImageDependencyTests-1254163555 None] Created reservations ['602dae25-d40f-45a5-bbf3-696183a44a43', 'f0ac716f-0b8e-4d89-a46a-0816165b7c1a', '64d2e2fa-7456-48de-8afd-594ceceb7705', '57cae5ea-01c7-4d61-8691-a561b4adc53a'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:03:18 devstack sudo[107774]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6c437631-03ca-4703-a0ae-a0b32c00832b tempest-CreateVolumesFromImageTest-2103843249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-3b9c60c7-bf91-45c9-b8fb-5f4a482d2d53" returned: 0 in 0.522s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6c437631-03ca-4703-a0ae-a0b32c00832b tempest-CreateVolumesFromImageTest-2103843249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-3b9c60c7-bf91-45c9-b8fb-5f4a482d2d53 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:18 devstack sudo[107780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-3b9c60c7-bf91-45c9-b8fb-5f4a482d2d53 Sep 25 12:03:18 devstack sudo[107780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-14d11019-730f-4646-9d68-4343dd72fe7a tempest-VolumeImageDependencyTests-1254163555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:03:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-14d11019-730f-4646-9d68-4343dd72fe7a tempest-VolumeImageDependencyTests-1254163555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:03:18 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-14d11019-730f-4646-9d68-4343dd72fe7a tempest-VolumeImageDependencyTests-1254163555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:03:18 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-14d11019-730f-4646-9d68-4343dd72fe7a tempest-VolumeImageDependencyTests-1254163555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:03:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-14d11019-730f-4646-9d68-4343dd72fe7a tempest-VolumeImageDependencyTests-1254163555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:03:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-14d11019-730f-4646-9d68-4343dd72fe7a tempest-VolumeImageDependencyTests-1254163555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:18 devstack sudo[107782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 12:03:18 devstack sudo[107782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:18 devstack sudo[107780]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6c437631-03ca-4703-a0ae-a0b32c00832b tempest-CreateVolumesFromImageTest-2103843249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-3b9c60c7-bf91-45c9-b8fb-5f4a482d2d53" returned: 0 in 0.308s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:18 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-6c437631-03ca-4703-a0ae-a0b32c00832b tempest-CreateVolumesFromImageTest-2103843249 None] Lock "cinder-quobyte-3b9c60c7-bf91-45c9-b8fb-5f4a482d2d53" released by "delete_volume" :: held 0.899s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:03:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-15ffdf5b-d076-4b07-9331-60ef914c370a tempest-VolumeDependencyTests-1884220744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:03:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-15ffdf5b-d076-4b07-9331-60ef914c370a tempest-VolumeDependencyTests-1884220744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:03:18 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-15ffdf5b-d076-4b07-9331-60ef914c370a tempest-VolumeDependencyTests-1884220744 None] Creating offline snapshot f1469612-691f-4b53-8f46-8ba09e771942 of volume 5d00fd22-141f-4510-ad1c-c8553495d390 {{(pid=86984) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 12:03:18 devstack sudo[107782]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:18 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-6c437631-03ca-4703-a0ae-a0b32c00832b tempest-CreateVolumesFromImageTest-2103843249 None] Created reservations ['246530ae-b706-4a12-936a-d1349f20d93e', '9a395fde-4e57-45c8-8e5c-21b2f1aca550', 'a5dc0bc2-09f4-4660-a659-1fd65950c11e', '56357428-eb2c-49ec-b945-41efcd2fe032'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:03:18 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[64272a4c-5f0d-4d89-83c5-0494b18f5bf9]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:03:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-14d11019-730f-4646-9d68-4343dd72fe7a tempest-VolumeImageDependencyTests-1254163555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.363s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-15ffdf5b-d076-4b07-9331-60ef914c370a tempest-VolumeDependencyTests-1884220744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5d00fd22-141f-4510-ad1c-c8553495d390 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:18 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-14d11019-730f-4646-9d68-4343dd72fe7a tempest-VolumeImageDependencyTests-1254163555 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:03:18 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-14d11019-730f-4646-9d68-4343dd72fe7a tempest-VolumeImageDependencyTests-1254163555 None] Deleted volume successfully. Sep 25 12:03:18 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-14d11019-730f-4646-9d68-4343dd72fe7a tempest-VolumeImageDependencyTests-1254163555 None] Lock "cinder-f1a2fa1f-67eb-4d66-9150-d7ab816a9788-delete_volume" released by "delete_volume" :: held 1.940s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:03:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-6c437631-03ca-4703-a0ae-a0b32c00832b tempest-CreateVolumesFromImageTest-2103843249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:03:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-6c437631-03ca-4703-a0ae-a0b32c00832b tempest-CreateVolumesFromImageTest-2103843249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:03:18 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-6c437631-03ca-4703-a0ae-a0b32c00832b tempest-CreateVolumesFromImageTest-2103843249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:03:18 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-6c437631-03ca-4703-a0ae-a0b32c00832b tempest-CreateVolumesFromImageTest-2103843249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:03:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-6c437631-03ca-4703-a0ae-a0b32c00832b tempest-CreateVolumesFromImageTest-2103843249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:03:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6c437631-03ca-4703-a0ae-a0b32c00832b tempest-CreateVolumesFromImageTest-2103843249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:18 devstack sudo[107786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5d00fd22-141f-4510-ad1c-c8553495d390 Sep 25 12:03:18 devstack sudo[107786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:18 devstack sudo[107787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 12:03:18 devstack sudo[107787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:19 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-b00f7b95-6ec2-43eb-8503-d3058d1fa0d0 tempest-SnapshotDependencyTests-1212110797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:03:19 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b00f7b95-6ec2-43eb-8503-d3058d1fa0d0 tempest-SnapshotDependencyTests-1212110797 None] Flow 'volume_create_manager' (62844679-99b5-4251-8280-24c5dc08fa26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:03:19 devstack sudo[107787]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:19 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b00f7b95-6ec2-43eb-8503-d3058d1fa0d0 tempest-SnapshotDependencyTests-1212110797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b03051f-f538-40c1-b8d1-67623d32e817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:03:19 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6c437631-03ca-4703-a0ae-a0b32c00832b tempest-CreateVolumesFromImageTest-2103843249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.322s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:19 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-6c437631-03ca-4703-a0ae-a0b32c00832b tempest-CreateVolumesFromImageTest-2103843249 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:03:19 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-6c437631-03ca-4703-a0ae-a0b32c00832b tempest-CreateVolumesFromImageTest-2103843249 None] Deleted volume successfully. Sep 25 12:03:19 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b00f7b95-6ec2-43eb-8503-d3058d1fa0d0 tempest-SnapshotDependencyTests-1212110797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b03051f-f538-40c1-b8d1-67623d32e817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:03:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1652914401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=917e295f-7879-44f1-be88-59994a18112b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e56bc3f6ec642c6a5c0c9a98c09c544',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:03:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:03:19Z,use_quota=True,user_id='97891207543f4b65b973bd5ba815bb0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:03:19 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b00f7b95-6ec2-43eb-8503-d3058d1fa0d0 tempest-SnapshotDependencyTests-1212110797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d50ae6b5-74b2-4ec3-8c3b-f746ae89da30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:03:19 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b00f7b95-6ec2-43eb-8503-d3058d1fa0d0 tempest-SnapshotDependencyTests-1212110797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d50ae6b5-74b2-4ec3-8c3b-f746ae89da30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:03:19 devstack sudo[107786]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:19 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b00f7b95-6ec2-43eb-8503-d3058d1fa0d0 tempest-SnapshotDependencyTests-1212110797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd1a13a3-986f-44dc-9e41-a0a64d36eb29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:03:19 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b00f7b95-6ec2-43eb-8503-d3058d1fa0d0 tempest-SnapshotDependencyTests-1212110797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd1a13a3-986f-44dc-9e41-a0a64d36eb29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '917e295f-7879-44f1-be88-59994a18112b', 'volume_name': 'volume-917e295f-7879-44f1-be88-59994a18112b', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:03:19 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b00f7b95-6ec2-43eb-8503-d3058d1fa0d0 tempest-SnapshotDependencyTests-1212110797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcb539e8-f913-4229-8d73-5cd00a3cc616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:03:19 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b00f7b95-6ec2-43eb-8503-d3058d1fa0d0 tempest-SnapshotDependencyTests-1212110797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcb539e8-f913-4229-8d73-5cd00a3cc616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:03:19 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b00f7b95-6ec2-43eb-8503-d3058d1fa0d0 tempest-SnapshotDependencyTests-1212110797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cdd5cf9-8056-4499-97a4-54ad84f0ab78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:03:19 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-b00f7b95-6ec2-43eb-8503-d3058d1fa0d0 tempest-SnapshotDependencyTests-1212110797 None] Volume 917e295f-7879-44f1-be88-59994a18112b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-917e295f-7879-44f1-be88-59994a18112b', 'volume_size': 1} Sep 25 12:03:19 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-b00f7b95-6ec2-43eb-8503-d3058d1fa0d0 tempest-SnapshotDependencyTests-1212110797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:03:19 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-15ffdf5b-d076-4b07-9331-60ef914c370a tempest-VolumeDependencyTests-1884220744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5d00fd22-141f-4510-ad1c-c8553495d390" returned: 0 in 0.534s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:19 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-15ffdf5b-d076-4b07-9331-60ef914c370a tempest-VolumeDependencyTests-1884220744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5d00fd22-141f-4510-ad1c-c8553495d390,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5d00fd22-141f-4510-ad1c-c8553495d390.f1469612-691f-4b53-8f46-8ba09e771942 1G {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:19 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-6c437631-03ca-4703-a0ae-a0b32c00832b tempest-CreateVolumesFromImageTest-2103843249 None] Lock "cinder-3b9c60c7-bf91-45c9-b8fb-5f4a482d2d53-delete_volume" released by "delete_volume" :: held 1.749s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:03:19 devstack sudo[107794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5d00fd22-141f-4510-ad1c-c8553495d390,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5d00fd22-141f-4510-ad1c-c8553495d390.f1469612-691f-4b53-8f46-8ba09e771942 1G Sep 25 12:03:19 devstack sudo[107794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:19 devstack sudo[107794]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:19 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-15ffdf5b-d076-4b07-9331-60ef914c370a tempest-VolumeDependencyTests-1884220744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5d00fd22-141f-4510-ad1c-c8553495d390,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5d00fd22-141f-4510-ad1c-c8553495d390.f1469612-691f-4b53-8f46-8ba09e771942 1G" returned: 0 in 0.498s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:19 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-15ffdf5b-d076-4b07-9331-60ef914c370a tempest-VolumeDependencyTests-1884220744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d00fd22-141f-4510-ad1c-c8553495d390 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5d00fd22-141f-4510-ad1c-c8553495d390.f1469612-691f-4b53-8f46-8ba09e771942 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:19 devstack sudo[107799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d00fd22-141f-4510-ad1c-c8553495d390 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5d00fd22-141f-4510-ad1c-c8553495d390.f1469612-691f-4b53-8f46-8ba09e771942 Sep 25 12:03:19 devstack sudo[107799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:19 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-652f75b9-cf94-46ef-a2d9-8433a017a665 tempest-CreateVolumesFromImageTest-2103843249 None] Acquiring lock "cinder-62714e30-e4ac-4743-be8d-3c7900670a6c-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:03:19 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-652f75b9-cf94-46ef-a2d9-8433a017a665 tempest-CreateVolumesFromImageTest-2103843249 None] Lock "cinder-62714e30-e4ac-4743-be8d-3c7900670a6c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:03:19 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-652f75b9-cf94-46ef-a2d9-8433a017a665 tempest-CreateVolumesFromImageTest-2103843249 None] Acquiring lock "cinder-quobyte-62714e30-e4ac-4743-be8d-3c7900670a6c" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:03:19 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-652f75b9-cf94-46ef-a2d9-8433a017a665 tempest-CreateVolumesFromImageTest-2103843249 None] Lock "cinder-quobyte-62714e30-e4ac-4743-be8d-3c7900670a6c" acquired by "delete_volume" :: waited 0.022s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:03:19 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff925ce-e045-4ea4-8dcc-c1bea2a4701d]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:03:19 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-652f75b9-cf94-46ef-a2d9-8433a017a665 tempest-CreateVolumesFromImageTest-2103843249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-62714e30-e4ac-4743-be8d-3c7900670a6c {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:20 devstack sudo[107799]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-15ffdf5b-d076-4b07-9331-60ef914c370a tempest-VolumeDependencyTests-1884220744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d00fd22-141f-4510-ad1c-c8553495d390 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5d00fd22-141f-4510-ad1c-c8553495d390.f1469612-691f-4b53-8f46-8ba09e771942" returned: 0 in 0.355s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:20 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-15ffdf5b-d076-4b07-9331-60ef914c370a tempest-VolumeDependencyTests-1884220744 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5d00fd22-141f-4510-ad1c-c8553495d390.f1469612-691f-4b53-8f46-8ba09e771942 is being set with open permissions: ugo+rw Sep 25 12:03:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-15ffdf5b-d076-4b07-9331-60ef914c370a tempest-VolumeDependencyTests-1884220744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5d00fd22-141f-4510-ad1c-c8553495d390.f1469612-691f-4b53-8f46-8ba09e771942 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:20 devstack sudo[107801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-62714e30-e4ac-4743-be8d-3c7900670a6c Sep 25 12:03:20 devstack sudo[107801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:20 devstack sudo[107806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5d00fd22-141f-4510-ad1c-c8553495d390.f1469612-691f-4b53-8f46-8ba09e771942 Sep 25 12:03:20 devstack sudo[107806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:20 devstack sudo[107806]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:20 devstack sudo[107801]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-15ffdf5b-d076-4b07-9331-60ef914c370a tempest-VolumeDependencyTests-1884220744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5d00fd22-141f-4510-ad1c-c8553495d390.f1469612-691f-4b53-8f46-8ba09e771942" returned: 0 in 0.326s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-652f75b9-cf94-46ef-a2d9-8433a017a665 tempest-CreateVolumesFromImageTest-2103843249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-62714e30-e4ac-4743-be8d-3c7900670a6c" returned: 0 in 0.521s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-652f75b9-cf94-46ef-a2d9-8433a017a665 tempest-CreateVolumesFromImageTest-2103843249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-62714e30-e4ac-4743-be8d-3c7900670a6c {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:20 devstack sudo[107812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-62714e30-e4ac-4743-be8d-3c7900670a6c Sep 25 12:03:20 devstack sudo[107812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-15ffdf5b-d076-4b07-9331-60ef914c370a tempest-VolumeDependencyTests-1884220744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5d00fd22-141f-4510-ad1c-c8553495d390.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:20 devstack sudo[107814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5d00fd22-141f-4510-ad1c-c8553495d390.info Sep 25 12:03:20 devstack sudo[107814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:20 devstack sudo[107812]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-652f75b9-cf94-46ef-a2d9-8433a017a665 tempest-CreateVolumesFromImageTest-2103843249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-62714e30-e4ac-4743-be8d-3c7900670a6c" returned: 0 in 0.347s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:20 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-652f75b9-cf94-46ef-a2d9-8433a017a665 tempest-CreateVolumesFromImageTest-2103843249 None] Lock "cinder-quobyte-62714e30-e4ac-4743-be8d-3c7900670a6c" released by "delete_volume" :: held 0.928s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:03:20 devstack sudo[107814]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-15ffdf5b-d076-4b07-9331-60ef914c370a tempest-VolumeDependencyTests-1884220744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5d00fd22-141f-4510-ad1c-c8553495d390.info" returned: 0 in 0.327s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:20 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-15ffdf5b-d076-4b07-9331-60ef914c370a tempest-VolumeDependencyTests-1884220744 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5d00fd22-141f-4510-ad1c-c8553495d390.info is being set with open permissions: ugo+rw Sep 25 12:03:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-15ffdf5b-d076-4b07-9331-60ef914c370a tempest-VolumeDependencyTests-1884220744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5d00fd22-141f-4510-ad1c-c8553495d390.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:20 devstack sudo[107818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5d00fd22-141f-4510-ad1c-c8553495d390.info Sep 25 12:03:20 devstack sudo[107818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:20 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-652f75b9-cf94-46ef-a2d9-8433a017a665 tempest-CreateVolumesFromImageTest-2103843249 None] Created reservations ['60d2574a-c3c9-4ea3-847f-f0b183051da5', '460a0852-337f-48d6-a58b-2a04857b7d70', 'd3f9a731-298d-4274-9267-952c0b0a4338', '495d7f24-3254-4fc4-86ba-c0a7a8ab3c25'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:03:21 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-652f75b9-cf94-46ef-a2d9-8433a017a665 tempest-CreateVolumesFromImageTest-2103843249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:03:21 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-652f75b9-cf94-46ef-a2d9-8433a017a665 tempest-CreateVolumesFromImageTest-2103843249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:03:21 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-652f75b9-cf94-46ef-a2d9-8433a017a665 tempest-CreateVolumesFromImageTest-2103843249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:03:21 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-652f75b9-cf94-46ef-a2d9-8433a017a665 tempest-CreateVolumesFromImageTest-2103843249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:03:21 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-652f75b9-cf94-46ef-a2d9-8433a017a665 tempest-CreateVolumesFromImageTest-2103843249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:03:21 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-652f75b9-cf94-46ef-a2d9-8433a017a665 tempest-CreateVolumesFromImageTest-2103843249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:21 devstack sudo[107820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 12:03:21 devstack sudo[107820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:21 devstack sudo[107818]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:21 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-15ffdf5b-d076-4b07-9331-60ef914c370a tempest-VolumeDependencyTests-1884220744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5d00fd22-141f-4510-ad1c-c8553495d390.info" returned: 0 in 0.314s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:21 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-15ffdf5b-d076-4b07-9331-60ef914c370a tempest-VolumeDependencyTests-1884220744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.500s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:03:21 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-b00f7b95-6ec2-43eb-8503-d3058d1fa0d0 tempest-SnapshotDependencyTests-1212110797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.918s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:03:21 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-b00f7b95-6ec2-43eb-8503-d3058d1fa0d0 tempest-SnapshotDependencyTests-1212110797 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:03:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1652914401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=917e295f-7879-44f1-be88-59994a18112b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e56bc3f6ec642c6a5c0c9a98c09c544',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:03:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:03:19Z,use_quota=True,user_id='97891207543f4b65b973bd5ba815bb0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:03:21 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-b00f7b95-6ec2-43eb-8503-d3058d1fa0d0 tempest-SnapshotDependencyTests-1212110797 None] Creating volume 917e295f-7879-44f1-be88-59994a18112b {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:03:21 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-b00f7b95-6ec2-43eb-8503-d3058d1fa0d0 tempest-SnapshotDependencyTests-1212110797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:03:21 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-b00f7b95-6ec2-43eb-8503-d3058d1fa0d0 tempest-SnapshotDependencyTests-1212110797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:03:21 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-b00f7b95-6ec2-43eb-8503-d3058d1fa0d0 tempest-SnapshotDependencyTests-1212110797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:03:21 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-b00f7b95-6ec2-43eb-8503-d3058d1fa0d0 tempest-SnapshotDependencyTests-1212110797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:03:21 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-b00f7b95-6ec2-43eb-8503-d3058d1fa0d0 tempest-SnapshotDependencyTests-1212110797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:03:21 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-b00f7b95-6ec2-43eb-8503-d3058d1fa0d0 tempest-SnapshotDependencyTests-1212110797 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:03:21 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-b00f7b95-6ec2-43eb-8503-d3058d1fa0d0 tempest-SnapshotDependencyTests-1212110797 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 12:03:21 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-b00f7b95-6ec2-43eb-8503-d3058d1fa0d0 tempest-SnapshotDependencyTests-1212110797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-917e295f-7879-44f1-be88-59994a18112b 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:21 devstack sudo[107823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-917e295f-7879-44f1-be88-59994a18112b 1073741824 Sep 25 12:03:21 devstack sudo[107823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:21 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-15ffdf5b-d076-4b07-9331-60ef914c370a tempest-VolumeDependencyTests-1884220744 None] Create snapshot completed successfully Sep 25 12:03:21 devstack sudo[107820]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:21 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-652f75b9-cf94-46ef-a2d9-8433a017a665 tempest-CreateVolumesFromImageTest-2103843249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.301s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:21 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-652f75b9-cf94-46ef-a2d9-8433a017a665 tempest-CreateVolumesFromImageTest-2103843249 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:03:21 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-652f75b9-cf94-46ef-a2d9-8433a017a665 tempest-CreateVolumesFromImageTest-2103843249 None] Deleted volume successfully. Sep 25 12:03:21 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-652f75b9-cf94-46ef-a2d9-8433a017a665 tempest-CreateVolumesFromImageTest-2103843249 None] Lock "cinder-62714e30-e4ac-4743-be8d-3c7900670a6c-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:03:21 devstack sudo[107823]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:21 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-b00f7b95-6ec2-43eb-8503-d3058d1fa0d0 tempest-SnapshotDependencyTests-1212110797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-917e295f-7879-44f1-be88-59994a18112b 1073741824" returned: 0 in 0.516s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:21 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-b00f7b95-6ec2-43eb-8503-d3058d1fa0d0 tempest-SnapshotDependencyTests-1212110797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-917e295f-7879-44f1-be88-59994a18112b {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:21 devstack sudo[107830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-917e295f-7879-44f1-be88-59994a18112b Sep 25 12:03:21 devstack sudo[107830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:22 devstack sudo[107830]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:22 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-b00f7b95-6ec2-43eb-8503-d3058d1fa0d0 tempest-SnapshotDependencyTests-1212110797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-917e295f-7879-44f1-be88-59994a18112b" returned: 0 in 0.266s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:22 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-b00f7b95-6ec2-43eb-8503-d3058d1fa0d0 tempest-SnapshotDependencyTests-1212110797 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:03:22 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-b00f7b95-6ec2-43eb-8503-d3058d1fa0d0 tempest-SnapshotDependencyTests-1212110797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:03:22 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b00f7b95-6ec2-43eb-8503-d3058d1fa0d0 tempest-SnapshotDependencyTests-1212110797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cdd5cf9-8056-4499-97a4-54ad84f0ab78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-917e295f-7879-44f1-be88-59994a18112b', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:03:22 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b00f7b95-6ec2-43eb-8503-d3058d1fa0d0 tempest-SnapshotDependencyTests-1212110797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c4d8385-6f80-49f8-aff9-0e83c118cc0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:03:23 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-b00f7b95-6ec2-43eb-8503-d3058d1fa0d0 tempest-SnapshotDependencyTests-1212110797 None] Volume volume-917e295f-7879-44f1-be88-59994a18112b (917e295f-7879-44f1-be88-59994a18112b): created successfully Sep 25 12:03:23 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b00f7b95-6ec2-43eb-8503-d3058d1fa0d0 tempest-SnapshotDependencyTests-1212110797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c4d8385-6f80-49f8-aff9-0e83c118cc0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:03:23 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b00f7b95-6ec2-43eb-8503-d3058d1fa0d0 tempest-SnapshotDependencyTests-1212110797 None] Flow 'volume_create_manager' (62844679-99b5-4251-8280-24c5dc08fa26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:03:24 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-b00f7b95-6ec2-43eb-8503-d3058d1fa0d0 tempest-SnapshotDependencyTests-1212110797 None] Created volume successfully. Sep 25 12:03:27 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-697c6ad2-95db-4051-97f4-cd25eabe58c4 tempest-VolumeDependencyTests-1884220744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:03:27 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-9da6ff39-8f51-4636-bc09-ac36ce9fe075 tempest-SnapshotDependencyTests-1212110797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:03:27 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-9da6ff39-8f51-4636-bc09-ac36ce9fe075 tempest-SnapshotDependencyTests-1212110797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:03:27 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ccc8c7a-1432-4a18-8f7e-4733f9f8cd38 tempest-CinderUnicodeTest-1542186967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:03:27 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2ccc8c7a-1432-4a18-8f7e-4733f9f8cd38 tempest-CinderUnicodeTest-1542186967 None] Flow 'volume_create_manager' (461e968c-6ab9-4764-9116-324311b1f614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:03:27 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2ccc8c7a-1432-4a18-8f7e-4733f9f8cd38 tempest-CinderUnicodeTest-1542186967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f387375-5fc1-4243-872a-a7d1473a56ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:03:27 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2ccc8c7a-1432-4a18-8f7e-4733f9f8cd38 tempest-CinderUnicodeTest-1542186967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f387375-5fc1-4243-872a-a7d1473a56ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:03:26Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df81102f-3178-47b9-9ae3-60b57d7dd3ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dc0ff1f5ba54af6b590c488cc8e0733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:03:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:03:27Z,use_quota=True,user_id='119c20416a814d79821c2f06b6584220',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:03:27 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2ccc8c7a-1432-4a18-8f7e-4733f9f8cd38 tempest-CinderUnicodeTest-1542186967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06ba1cdc-674f-4f7a-be17-ee3ed1736bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:03:27 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2ccc8c7a-1432-4a18-8f7e-4733f9f8cd38 tempest-CinderUnicodeTest-1542186967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06ba1cdc-674f-4f7a-be17-ee3ed1736bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:03:27 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2ccc8c7a-1432-4a18-8f7e-4733f9f8cd38 tempest-CinderUnicodeTest-1542186967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2c66399-6ed1-45ce-9af7-1c23349cac36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:03:27 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2ccc8c7a-1432-4a18-8f7e-4733f9f8cd38 tempest-CinderUnicodeTest-1542186967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2c66399-6ed1-45ce-9af7-1c23349cac36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df81102f-3178-47b9-9ae3-60b57d7dd3ce', 'volume_name': 'volume-df81102f-3178-47b9-9ae3-60b57d7dd3ce', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:03:27 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2ccc8c7a-1432-4a18-8f7e-4733f9f8cd38 tempest-CinderUnicodeTest-1542186967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c003405-dcff-49c2-836b-7ba70ef6b542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:03:27 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2ccc8c7a-1432-4a18-8f7e-4733f9f8cd38 tempest-CinderUnicodeTest-1542186967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c003405-dcff-49c2-836b-7ba70ef6b542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:03:27 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2ccc8c7a-1432-4a18-8f7e-4733f9f8cd38 tempest-CinderUnicodeTest-1542186967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b0012bf-2dd1-4752-a734-8841bf6123c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:03:27 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-2ccc8c7a-1432-4a18-8f7e-4733f9f8cd38 tempest-CinderUnicodeTest-1542186967 None] Volume df81102f-3178-47b9-9ae3-60b57d7dd3ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df81102f-3178-47b9-9ae3-60b57d7dd3ce', 'volume_size': 1} Sep 25 12:03:27 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-2ccc8c7a-1432-4a18-8f7e-4733f9f8cd38 tempest-CinderUnicodeTest-1542186967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:03:27 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-697c6ad2-95db-4051-97f4-cd25eabe58c4 tempest-VolumeDependencyTests-1884220744 None] Flow 'volume_create_manager' (ef789017-742e-4a6c-a93b-2f6eb98d2cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:03:27 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-697c6ad2-95db-4051-97f4-cd25eabe58c4 tempest-VolumeDependencyTests-1884220744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (497f0764-d8d6-44c4-af16-4d17e01c5f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:03:27 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-9da6ff39-8f51-4636-bc09-ac36ce9fe075 tempest-SnapshotDependencyTests-1212110797 None] Creating offline snapshot f071096b-6860-4e29-bb5d-e78885f2e703 of volume 917e295f-7879-44f1-be88-59994a18112b {{(pid=86984) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 12:03:27 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-697c6ad2-95db-4051-97f4-cd25eabe58c4 tempest-VolumeDependencyTests-1884220744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (497f0764-d8d6-44c4-af16-4d17e01c5f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:03:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1300933936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03868ded-4b84-46c8-96e4-da612d86fc3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9c31aac074743038621babd9915d4ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:03:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f1469612-691f-4b53-8f46-8ba09e771942,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:03:27Z,use_quota=True,user_id='35213cd71cc148b6888afb4e00e217c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:03:27 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-697c6ad2-95db-4051-97f4-cd25eabe58c4 tempest-VolumeDependencyTests-1884220744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f111e2ea-5c37-4845-a8a0-807a412a3992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:03:27 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-697c6ad2-95db-4051-97f4-cd25eabe58c4 tempest-VolumeDependencyTests-1884220744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f111e2ea-5c37-4845-a8a0-807a412a3992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:03:27 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-697c6ad2-95db-4051-97f4-cd25eabe58c4 tempest-VolumeDependencyTests-1884220744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22ce8951-4189-4664-98ef-e7e92d96e919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:03:27 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-697c6ad2-95db-4051-97f4-cd25eabe58c4 tempest-VolumeDependencyTests-1884220744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22ce8951-4189-4664-98ef-e7e92d96e919) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '03868ded-4b84-46c8-96e4-da612d86fc3c', 'volume_name': 'volume-03868ded-4b84-46c8-96e4-da612d86fc3c', 'volume_size': 1, 'snapshot_id': 'f1469612-691f-4b53-8f46-8ba09e771942'}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:03:27 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-697c6ad2-95db-4051-97f4-cd25eabe58c4 tempest-VolumeDependencyTests-1884220744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0b3991d-0566-4d43-9957-1094d82f4f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:03:27 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-697c6ad2-95db-4051-97f4-cd25eabe58c4 tempest-VolumeDependencyTests-1884220744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0b3991d-0566-4d43-9957-1094d82f4f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:03:27 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-697c6ad2-95db-4051-97f4-cd25eabe58c4 tempest-VolumeDependencyTests-1884220744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c8a91ea-2782-4704-84cf-bafe10e40b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:03:27 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-697c6ad2-95db-4051-97f4-cd25eabe58c4 tempest-VolumeDependencyTests-1884220744 None] Volume 03868ded-4b84-46c8-96e4-da612d86fc3c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-03868ded-4b84-46c8-96e4-da612d86fc3c', 'volume_size': 1, 'snapshot_id': 'f1469612-691f-4b53-8f46-8ba09e771942'} Sep 25 12:03:27 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[e85ded19-bf5d-4cf9-8459-596f342a844a]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:03:27 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-9da6ff39-8f51-4636-bc09-ac36ce9fe075 tempest-SnapshotDependencyTests-1212110797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-917e295f-7879-44f1-be88-59994a18112b {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:27 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-697c6ad2-95db-4051-97f4-cd25eabe58c4 tempest-VolumeDependencyTests-1884220744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:03:27 devstack sudo[107835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-917e295f-7879-44f1-be88-59994a18112b Sep 25 12:03:27 devstack sudo[107835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:27 devstack sudo[107835]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:27 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-9da6ff39-8f51-4636-bc09-ac36ce9fe075 tempest-SnapshotDependencyTests-1212110797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-917e295f-7879-44f1-be88-59994a18112b" returned: 0 in 0.463s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:27 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-9da6ff39-8f51-4636-bc09-ac36ce9fe075 tempest-SnapshotDependencyTests-1212110797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-917e295f-7879-44f1-be88-59994a18112b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-917e295f-7879-44f1-be88-59994a18112b.f071096b-6860-4e29-bb5d-e78885f2e703 1G {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:27 devstack sudo[107841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-917e295f-7879-44f1-be88-59994a18112b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-917e295f-7879-44f1-be88-59994a18112b.f071096b-6860-4e29-bb5d-e78885f2e703 1G Sep 25 12:03:27 devstack sudo[107841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:28 devstack sudo[107841]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:28 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-9da6ff39-8f51-4636-bc09-ac36ce9fe075 tempest-SnapshotDependencyTests-1212110797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-917e295f-7879-44f1-be88-59994a18112b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-917e295f-7879-44f1-be88-59994a18112b.f071096b-6860-4e29-bb5d-e78885f2e703 1G" returned: 0 in 0.478s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:28 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-9da6ff39-8f51-4636-bc09-ac36ce9fe075 tempest-SnapshotDependencyTests-1212110797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-917e295f-7879-44f1-be88-59994a18112b -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-917e295f-7879-44f1-be88-59994a18112b.f071096b-6860-4e29-bb5d-e78885f2e703 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:28 devstack sudo[107847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-917e295f-7879-44f1-be88-59994a18112b -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-917e295f-7879-44f1-be88-59994a18112b.f071096b-6860-4e29-bb5d-e78885f2e703 Sep 25 12:03:28 devstack sudo[107847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:28 devstack sudo[107847]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:28 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-9da6ff39-8f51-4636-bc09-ac36ce9fe075 tempest-SnapshotDependencyTests-1212110797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-917e295f-7879-44f1-be88-59994a18112b -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-917e295f-7879-44f1-be88-59994a18112b.f071096b-6860-4e29-bb5d-e78885f2e703" returned: 0 in 0.327s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:28 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-9da6ff39-8f51-4636-bc09-ac36ce9fe075 tempest-SnapshotDependencyTests-1212110797 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-917e295f-7879-44f1-be88-59994a18112b.f071096b-6860-4e29-bb5d-e78885f2e703 is being set with open permissions: ugo+rw Sep 25 12:03:28 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-9da6ff39-8f51-4636-bc09-ac36ce9fe075 tempest-SnapshotDependencyTests-1212110797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-917e295f-7879-44f1-be88-59994a18112b.f071096b-6860-4e29-bb5d-e78885f2e703 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:28 devstack sudo[107852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-917e295f-7879-44f1-be88-59994a18112b.f071096b-6860-4e29-bb5d-e78885f2e703 Sep 25 12:03:28 devstack sudo[107852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:28 devstack sudo[107852]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:28 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-9da6ff39-8f51-4636-bc09-ac36ce9fe075 tempest-SnapshotDependencyTests-1212110797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-917e295f-7879-44f1-be88-59994a18112b.f071096b-6860-4e29-bb5d-e78885f2e703" returned: 0 in 0.285s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:28 devstack cinder-volume[86984]: DEBUG dbcounter [-] [86984] Writing DB stats cinder:SELECT=162,cinder:INSERT=64,cinder:UPDATE=236,cinder:DELETE=25 {{(pid=86984) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:03:28 devstack cinder-volume[86984]: DEBUG dbcounter [-] [86984] Writing DB stats cinder:UPDATE=220,cinder:SELECT=169,cinder:DELETE=17,cinder:INSERT=58 {{(pid=86984) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:03:29 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-9da6ff39-8f51-4636-bc09-ac36ce9fe075 tempest-SnapshotDependencyTests-1212110797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-917e295f-7879-44f1-be88-59994a18112b.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:29 devstack sudo[107855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-917e295f-7879-44f1-be88-59994a18112b.info Sep 25 12:03:29 devstack sudo[107855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:29 devstack sudo[107855]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:29 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-9da6ff39-8f51-4636-bc09-ac36ce9fe075 tempest-SnapshotDependencyTests-1212110797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-917e295f-7879-44f1-be88-59994a18112b.info" returned: 0 in 0.270s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:29 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-9da6ff39-8f51-4636-bc09-ac36ce9fe075 tempest-SnapshotDependencyTests-1212110797 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-917e295f-7879-44f1-be88-59994a18112b.info is being set with open permissions: ugo+rw Sep 25 12:03:29 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-9da6ff39-8f51-4636-bc09-ac36ce9fe075 tempest-SnapshotDependencyTests-1212110797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-917e295f-7879-44f1-be88-59994a18112b.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:29 devstack sudo[107858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-917e295f-7879-44f1-be88-59994a18112b.info Sep 25 12:03:29 devstack sudo[107858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:29 devstack sudo[107858]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:29 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-9da6ff39-8f51-4636-bc09-ac36ce9fe075 tempest-SnapshotDependencyTests-1212110797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-917e295f-7879-44f1-be88-59994a18112b.info" returned: 0 in 0.256s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:29 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-9da6ff39-8f51-4636-bc09-ac36ce9fe075 tempest-SnapshotDependencyTests-1212110797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.359s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:03:29 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-2ccc8c7a-1432-4a18-8f7e-4733f9f8cd38 tempest-CinderUnicodeTest-1542186967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.269s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:03:29 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-2ccc8c7a-1432-4a18-8f7e-4733f9f8cd38 tempest-CinderUnicodeTest-1542186967 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:03:26Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df81102f-3178-47b9-9ae3-60b57d7dd3ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dc0ff1f5ba54af6b590c488cc8e0733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:03:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:03:27Z,use_quota=True,user_id='119c20416a814d79821c2f06b6584220',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:03:29 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-2ccc8c7a-1432-4a18-8f7e-4733f9f8cd38 tempest-CinderUnicodeTest-1542186967 None] Creating volume df81102f-3178-47b9-9ae3-60b57d7dd3ce {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:03:29 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-2ccc8c7a-1432-4a18-8f7e-4733f9f8cd38 tempest-CinderUnicodeTest-1542186967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:03:29 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-2ccc8c7a-1432-4a18-8f7e-4733f9f8cd38 tempest-CinderUnicodeTest-1542186967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:03:29 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-2ccc8c7a-1432-4a18-8f7e-4733f9f8cd38 tempest-CinderUnicodeTest-1542186967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:03:29 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-2ccc8c7a-1432-4a18-8f7e-4733f9f8cd38 tempest-CinderUnicodeTest-1542186967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:03:29 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-2ccc8c7a-1432-4a18-8f7e-4733f9f8cd38 tempest-CinderUnicodeTest-1542186967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:03:29 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-2ccc8c7a-1432-4a18-8f7e-4733f9f8cd38 tempest-CinderUnicodeTest-1542186967 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:03:29 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-2ccc8c7a-1432-4a18-8f7e-4733f9f8cd38 tempest-CinderUnicodeTest-1542186967 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 12:03:29 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2ccc8c7a-1432-4a18-8f7e-4733f9f8cd38 tempest-CinderUnicodeTest-1542186967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-df81102f-3178-47b9-9ae3-60b57d7dd3ce 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:29 devstack sudo[107861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-df81102f-3178-47b9-9ae3-60b57d7dd3ce 1073741824 Sep 25 12:03:29 devstack sudo[107861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:29 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-9da6ff39-8f51-4636-bc09-ac36ce9fe075 tempest-SnapshotDependencyTests-1212110797 None] Create snapshot completed successfully Sep 25 12:03:30 devstack sudo[107861]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:30 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2ccc8c7a-1432-4a18-8f7e-4733f9f8cd38 tempest-CinderUnicodeTest-1542186967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-df81102f-3178-47b9-9ae3-60b57d7dd3ce 1073741824" returned: 0 in 0.487s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:30 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2ccc8c7a-1432-4a18-8f7e-4733f9f8cd38 tempest-CinderUnicodeTest-1542186967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-df81102f-3178-47b9-9ae3-60b57d7dd3ce {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:30 devstack sudo[107867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-df81102f-3178-47b9-9ae3-60b57d7dd3ce Sep 25 12:03:30 devstack sudo[107867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:30 devstack sudo[107867]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:30 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2ccc8c7a-1432-4a18-8f7e-4733f9f8cd38 tempest-CinderUnicodeTest-1542186967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-df81102f-3178-47b9-9ae3-60b57d7dd3ce" returned: 0 in 0.310s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:30 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-2ccc8c7a-1432-4a18-8f7e-4733f9f8cd38 tempest-CinderUnicodeTest-1542186967 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:03:30 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-2ccc8c7a-1432-4a18-8f7e-4733f9f8cd38 tempest-CinderUnicodeTest-1542186967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:03:30 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-697c6ad2-95db-4051-97f4-cd25eabe58c4 tempest-VolumeDependencyTests-1884220744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.011s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:03:30 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-697c6ad2-95db-4051-97f4-cd25eabe58c4 tempest-VolumeDependencyTests-1884220744 None] Acquiring lock "cinder-quobyte-f1469612-691f-4b53-8f46-8ba09e771942-03868ded-4b84-46c8-96e4-da612d86fc3c" by "_create_volume_from_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:03:30 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2ccc8c7a-1432-4a18-8f7e-4733f9f8cd38 tempest-CinderUnicodeTest-1542186967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b0012bf-2dd1-4752-a734-8841bf6123c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df81102f-3178-47b9-9ae3-60b57d7dd3ce', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:03:30 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2ccc8c7a-1432-4a18-8f7e-4733f9f8cd38 tempest-CinderUnicodeTest-1542186967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fff5b45-1950-4bc6-913b-fd8ad7360c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:03:30 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-697c6ad2-95db-4051-97f4-cd25eabe58c4 tempest-VolumeDependencyTests-1884220744 None] Lock "cinder-quobyte-f1469612-691f-4b53-8f46-8ba09e771942-03868ded-4b84-46c8-96e4-da612d86fc3c" acquired by "_create_volume_from_snapshot" :: waited 0.059s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:03:30 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-697c6ad2-95db-4051-97f4-cd25eabe58c4 tempest-VolumeDependencyTests-1884220744 None] Creating volume 03868ded-4b84-46c8-96e4-da612d86fc3c from snapshot f1469612-691f-4b53-8f46-8ba09e771942 {{(pid=86984) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 12:03:30 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-697c6ad2-95db-4051-97f4-cd25eabe58c4 tempest-VolumeDependencyTests-1884220744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:03:30 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-697c6ad2-95db-4051-97f4-cd25eabe58c4 tempest-VolumeDependencyTests-1884220744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:03:30 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-697c6ad2-95db-4051-97f4-cd25eabe58c4 tempest-VolumeDependencyTests-1884220744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:03:30 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-697c6ad2-95db-4051-97f4-cd25eabe58c4 tempest-VolumeDependencyTests-1884220744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:03:30 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-697c6ad2-95db-4051-97f4-cd25eabe58c4 tempest-VolumeDependencyTests-1884220744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:03:30 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-697c6ad2-95db-4051-97f4-cd25eabe58c4 tempest-VolumeDependencyTests-1884220744 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:03:30 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-697c6ad2-95db-4051-97f4-cd25eabe58c4 tempest-VolumeDependencyTests-1884220744 None] Acquiring lock "cinder-quobyte-03868ded-4b84-46c8-96e4-da612d86fc3c" by "_copy_volume_from_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:03:30 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-2ccc8c7a-1432-4a18-8f7e-4733f9f8cd38 tempest-CinderUnicodeTest-1542186967 None] Volume volume-df81102f-3178-47b9-9ae3-60b57d7dd3ce (df81102f-3178-47b9-9ae3-60b57d7dd3ce): created successfully Sep 25 12:03:30 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2ccc8c7a-1432-4a18-8f7e-4733f9f8cd38 tempest-CinderUnicodeTest-1542186967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fff5b45-1950-4bc6-913b-fd8ad7360c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:03:30 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-2ccc8c7a-1432-4a18-8f7e-4733f9f8cd38 tempest-CinderUnicodeTest-1542186967 None] Flow 'volume_create_manager' (461e968c-6ab9-4764-9116-324311b1f614) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:03:30 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-697c6ad2-95db-4051-97f4-cd25eabe58c4 tempest-VolumeDependencyTests-1884220744 None] Lock "cinder-quobyte-03868ded-4b84-46c8-96e4-da612d86fc3c" acquired by "_copy_volume_from_snapshot" :: waited 0.058s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:03:30 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-697c6ad2-95db-4051-97f4-cd25eabe58c4 tempest-VolumeDependencyTests-1884220744 None] snapshot: f1469612-691f-4b53-8f46-8ba09e771942, volume: 03868ded-4b84-46c8-96e4-da612d86fc3c, {{(pid=86984) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 12:03:30 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-2ccc8c7a-1432-4a18-8f7e-4733f9f8cd38 tempest-CinderUnicodeTest-1542186967 None] Created volume successfully. Sep 25 12:03:30 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-697c6ad2-95db-4051-97f4-cd25eabe58c4 tempest-VolumeDependencyTests-1884220744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:03:30 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-697c6ad2-95db-4051-97f4-cd25eabe58c4 tempest-VolumeDependencyTests-1884220744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:03:30 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-697c6ad2-95db-4051-97f4-cd25eabe58c4 tempest-VolumeDependencyTests-1884220744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:03:30 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-697c6ad2-95db-4051-97f4-cd25eabe58c4 tempest-VolumeDependencyTests-1884220744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:03:30 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-697c6ad2-95db-4051-97f4-cd25eabe58c4 tempest-VolumeDependencyTests-1884220744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:03:30 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ea7755-7238-4616-88f1-65b0cd5a5b24]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:03:30 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-697c6ad2-95db-4051-97f4-cd25eabe58c4 tempest-VolumeDependencyTests-1884220744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5d00fd22-141f-4510-ad1c-c8553495d390.f1469612-691f-4b53-8f46-8ba09e771942 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:30 devstack sudo[107872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5d00fd22-141f-4510-ad1c-c8553495d390.f1469612-691f-4b53-8f46-8ba09e771942 Sep 25 12:03:30 devstack sudo[107872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:30 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-b51c7138-0216-40e1-8e13-d5ac88c7d273 tempest-SnapshotDependencyTests-1212110797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:03:30 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b51c7138-0216-40e1-8e13-d5ac88c7d273 tempest-SnapshotDependencyTests-1212110797 None] Flow 'volume_create_manager' (493eb5c1-11fa-4115-bbd4-31279eac3de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:03:31 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b51c7138-0216-40e1-8e13-d5ac88c7d273 tempest-SnapshotDependencyTests-1212110797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca390be2-87ae-4e5a-bbee-9848c35c9f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:03:31 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b51c7138-0216-40e1-8e13-d5ac88c7d273 tempest-SnapshotDependencyTests-1212110797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca390be2-87ae-4e5a-bbee-9848c35c9f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:03:30Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ddbe814-9ac9-4c17-83a9-79075da92e5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e56bc3f6ec642c6a5c0c9a98c09c544',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:03:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f071096b-6860-4e29-bb5d-e78885f2e703,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:03:31Z,use_quota=True,user_id='97891207543f4b65b973bd5ba815bb0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:03:31 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b51c7138-0216-40e1-8e13-d5ac88c7d273 tempest-SnapshotDependencyTests-1212110797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80d893fa-3dd5-408b-8aa5-a18fcab5cb09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:03:31 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b51c7138-0216-40e1-8e13-d5ac88c7d273 tempest-SnapshotDependencyTests-1212110797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80d893fa-3dd5-408b-8aa5-a18fcab5cb09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:03:31 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b51c7138-0216-40e1-8e13-d5ac88c7d273 tempest-SnapshotDependencyTests-1212110797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a455046-1372-4dec-8f4d-b6a8f43ac6b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:03:31 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b51c7138-0216-40e1-8e13-d5ac88c7d273 tempest-SnapshotDependencyTests-1212110797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a455046-1372-4dec-8f4d-b6a8f43ac6b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5ddbe814-9ac9-4c17-83a9-79075da92e5a', 'volume_name': 'volume-5ddbe814-9ac9-4c17-83a9-79075da92e5a', 'volume_size': 1, 'snapshot_id': 'f071096b-6860-4e29-bb5d-e78885f2e703'}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:03:31 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b51c7138-0216-40e1-8e13-d5ac88c7d273 tempest-SnapshotDependencyTests-1212110797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1264c2ea-5e3a-4eb3-b8c8-3c4d66893f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:03:31 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b51c7138-0216-40e1-8e13-d5ac88c7d273 tempest-SnapshotDependencyTests-1212110797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1264c2ea-5e3a-4eb3-b8c8-3c4d66893f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:03:31 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b51c7138-0216-40e1-8e13-d5ac88c7d273 tempest-SnapshotDependencyTests-1212110797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b42ef498-82a7-4a67-88eb-b2651bb6572b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:03:31 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-b51c7138-0216-40e1-8e13-d5ac88c7d273 tempest-SnapshotDependencyTests-1212110797 None] Volume 5ddbe814-9ac9-4c17-83a9-79075da92e5a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5ddbe814-9ac9-4c17-83a9-79075da92e5a', 'volume_size': 1, 'snapshot_id': 'f071096b-6860-4e29-bb5d-e78885f2e703'} Sep 25 12:03:31 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-b51c7138-0216-40e1-8e13-d5ac88c7d273 tempest-SnapshotDependencyTests-1212110797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:03:31 devstack sudo[107872]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:31 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-697c6ad2-95db-4051-97f4-cd25eabe58c4 tempest-VolumeDependencyTests-1884220744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5d00fd22-141f-4510-ad1c-c8553495d390.f1469612-691f-4b53-8f46-8ba09e771942" returned: 0 in 0.491s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:31 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-697c6ad2-95db-4051-97f4-cd25eabe58c4 tempest-VolumeDependencyTests-1884220744 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d00fd22-141f-4510-ad1c-c8553495d390(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86984) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:03:31 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[3142cfb3-9d29-4fe7-a4b5-9160b4bf9c3e]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:03:31 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-697c6ad2-95db-4051-97f4-cd25eabe58c4 tempest-VolumeDependencyTests-1884220744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5d00fd22-141f-4510-ad1c-c8553495d390 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:31 devstack sudo[107878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5d00fd22-141f-4510-ad1c-c8553495d390 Sep 25 12:03:31 devstack sudo[107878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:31 devstack sudo[107878]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:31 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-697c6ad2-95db-4051-97f4-cd25eabe58c4 tempest-VolumeDependencyTests-1884220744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5d00fd22-141f-4510-ad1c-c8553495d390" returned: 0 in 0.469s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:31 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-697c6ad2-95db-4051-97f4-cd25eabe58c4 tempest-VolumeDependencyTests-1884220744 None] will copy from snapshot at /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5d00fd22-141f-4510-ad1c-c8553495d390 {{(pid=86984) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 12:03:31 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-697c6ad2-95db-4051-97f4-cd25eabe58c4 tempest-VolumeDependencyTests-1884220744 None] Creating direct copy from snapshot {{(pid=86984) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 12:03:31 devstack cinder-volume[86984]: DEBUG cinder.utils [None req-697c6ad2-95db-4051-97f4-cd25eabe58c4 tempest-VolumeDependencyTests-1884220744 None] Path /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-03868ded-4b84-46c8-96e4-da612d86fc3c not found in is_blk_device check {{(pid=86984) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 12:03:31 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-697c6ad2-95db-4051-97f4-cd25eabe58c4 tempest-VolumeDependencyTests-1884220744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5d00fd22-141f-4510-ad1c-c8553495d390 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-03868ded-4b84-46c8-96e4-da612d86fc3c {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:31 devstack sudo[107883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5d00fd22-141f-4510-ad1c-c8553495d390 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-03868ded-4b84-46c8-96e4-da612d86fc3c Sep 25 12:03:31 devstack sudo[107883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:31 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cc9db44-7224-4ffb-901f-77554be3a94d tempest-CinderUnicodeTest-1542186967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:03:31 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-1cc9db44-7224-4ffb-901f-77554be3a94d tempest-CinderUnicodeTest-1542186967 None] Flow 'volume_create_manager' (c5ce86eb-a62b-4bba-9d62-32ee93438668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:03:31 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-1cc9db44-7224-4ffb-901f-77554be3a94d tempest-CinderUnicodeTest-1542186967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c93e92f-4ea2-4116-893e-4659abed25aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:03:31 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-1cc9db44-7224-4ffb-901f-77554be3a94d tempest-CinderUnicodeTest-1542186967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c93e92f-4ea2-4116-893e-4659abed25aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:03:31Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1408968602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa511b7a-949a-4eef-928d-6016c97a3730,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dc0ff1f5ba54af6b590c488cc8e0733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:03:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:03:32Z,use_quota=True,user_id='119c20416a814d79821c2f06b6584220',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:03:31 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-1cc9db44-7224-4ffb-901f-77554be3a94d tempest-CinderUnicodeTest-1542186967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b41d84c8-0002-4251-87d9-e9b521dcf690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:03:31 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-1cc9db44-7224-4ffb-901f-77554be3a94d tempest-CinderUnicodeTest-1542186967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b41d84c8-0002-4251-87d9-e9b521dcf690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:03:31 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-1cc9db44-7224-4ffb-901f-77554be3a94d tempest-CinderUnicodeTest-1542186967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9de3028a-92f4-43ad-b202-8169b8a49f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:03:31 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-1cc9db44-7224-4ffb-901f-77554be3a94d tempest-CinderUnicodeTest-1542186967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9de3028a-92f4-43ad-b202-8169b8a49f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa511b7a-949a-4eef-928d-6016c97a3730', 'volume_name': 'volume-fa511b7a-949a-4eef-928d-6016c97a3730', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:03:31 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-1cc9db44-7224-4ffb-901f-77554be3a94d tempest-CinderUnicodeTest-1542186967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1c201cf-1beb-45ea-90a9-046f4e121441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:03:31 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-1cc9db44-7224-4ffb-901f-77554be3a94d tempest-CinderUnicodeTest-1542186967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1c201cf-1beb-45ea-90a9-046f4e121441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:03:31 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-1cc9db44-7224-4ffb-901f-77554be3a94d tempest-CinderUnicodeTest-1542186967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (639f5251-c43f-4041-973e-537ac1e1bbe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:03:31 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-1cc9db44-7224-4ffb-901f-77554be3a94d tempest-CinderUnicodeTest-1542186967 None] Volume fa511b7a-949a-4eef-928d-6016c97a3730: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa511b7a-949a-4eef-928d-6016c97a3730', 'volume_size': 1} Sep 25 12:03:31 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-1cc9db44-7224-4ffb-901f-77554be3a94d tempest-CinderUnicodeTest-1542186967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:03:37 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-808a9312-7b5b-4726-895c-09c50fa0c958 tempest-ProjectMemberTests-1434405994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:03:37 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-808a9312-7b5b-4726-895c-09c50fa0c958 tempest-ProjectMemberTests-1434405994 None] Flow 'volume_create_manager' (c700a3d4-fefc-4fc3-81ae-9b3342747328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:03:37 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-808a9312-7b5b-4726-895c-09c50fa0c958 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83183186-ec8c-43a5-999a-b1cca602d8cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:03:37 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-808a9312-7b5b-4726-895c-09c50fa0c958 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83183186-ec8c-43a5-999a-b1cca602d8cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:03:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1184723967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07158b61-1934-4e95-a1f9-9d0d9f057009,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c75afeac65f84f13b7d0325fa4b21b65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:03:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:03:38Z,use_quota=True,user_id='770f7e0a81074bae8bcd048c8d7f7347',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:03:37 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-808a9312-7b5b-4726-895c-09c50fa0c958 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e831e7f-6bc2-4ae2-be91-46e4403bafc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:03:37 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-808a9312-7b5b-4726-895c-09c50fa0c958 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e831e7f-6bc2-4ae2-be91-46e4403bafc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:03:37 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-808a9312-7b5b-4726-895c-09c50fa0c958 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a07e638-98bc-4905-9409-c0447eb6c877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:03:37 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-808a9312-7b5b-4726-895c-09c50fa0c958 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a07e638-98bc-4905-9409-c0447eb6c877) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07158b61-1934-4e95-a1f9-9d0d9f057009', 'volume_name': 'volume-07158b61-1934-4e95-a1f9-9d0d9f057009', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:03:37 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-808a9312-7b5b-4726-895c-09c50fa0c958 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21296e4f-0ae8-4578-86cb-5cc47a23101f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:03:37 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-808a9312-7b5b-4726-895c-09c50fa0c958 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21296e4f-0ae8-4578-86cb-5cc47a23101f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:03:37 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-808a9312-7b5b-4726-895c-09c50fa0c958 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74a811c2-bc01-4a55-b4bd-82fc4763d180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:03:37 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-808a9312-7b5b-4726-895c-09c50fa0c958 tempest-ProjectMemberTests-1434405994 None] Volume 07158b61-1934-4e95-a1f9-9d0d9f057009: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07158b61-1934-4e95-a1f9-9d0d9f057009', 'volume_size': 1} Sep 25 12:03:37 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-808a9312-7b5b-4726-895c-09c50fa0c958 tempest-ProjectMemberTests-1434405994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:03:38 devstack cinder-volume[86984]: DEBUG oslo_service.periodic_task [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:03:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:03:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:03:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:03:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:03:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:03:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:38 devstack sudo[107899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 12:03:38 devstack sudo[107899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:39 devstack sudo[107883]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-697c6ad2-95db-4051-97f4-cd25eabe58c4 tempest-VolumeDependencyTests-1884220744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5d00fd22-141f-4510-ad1c-c8553495d390 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-03868ded-4b84-46c8-96e4-da612d86fc3c" returned: 0 in 7.423s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:39 devstack cinder-volume[86984]: DEBUG cinder.image.image_utils [None req-697c6ad2-95db-4051-97f4-cd25eabe58c4 tempest-VolumeDependencyTests-1884220744 None] Image conversion details: src /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5d00fd22-141f-4510-ad1c-c8553495d390, size 1024.00 MB, duration 7.42 sec, destination /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-03868ded-4b84-46c8-96e4-da612d86fc3c {{(pid=86984) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 12:03:39 devstack cinder-volume[86984]: INFO cinder.image.image_utils [None req-697c6ad2-95db-4051-97f4-cd25eabe58c4 tempest-VolumeDependencyTests-1884220744 None] Converted 1024.00 MB image at 137.93 MB/s Sep 25 12:03:39 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-697c6ad2-95db-4051-97f4-cd25eabe58c4 tempest-VolumeDependencyTests-1884220744 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-03868ded-4b84-46c8-96e4-da612d86fc3c is being set with open permissions: ugo+rw Sep 25 12:03:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-697c6ad2-95db-4051-97f4-cd25eabe58c4 tempest-VolumeDependencyTests-1884220744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-03868ded-4b84-46c8-96e4-da612d86fc3c {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:39 devstack sudo[107901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-03868ded-4b84-46c8-96e4-da612d86fc3c Sep 25 12:03:39 devstack sudo[107901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:39 devstack sudo[107899]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.489s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:39 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:03:39 devstack cinder-volume[86984]: DEBUG oslo_service.periodic_task [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running periodic task VolumeManager._thread_info {{(pid=86984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:03:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] thread count: 28 {{(pid=86984) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 12:03:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] thread info: [<_MainThread(MainThread, started 132046492332160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86984) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 12:03:39 devstack sudo[107901]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-697c6ad2-95db-4051-97f4-cd25eabe58c4 tempest-VolumeDependencyTests-1884220744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-03868ded-4b84-46c8-96e4-da612d86fc3c" returned: 0 in 0.276s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:39 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-697c6ad2-95db-4051-97f4-cd25eabe58c4 tempest-VolumeDependencyTests-1884220744 None] Lock "cinder-quobyte-03868ded-4b84-46c8-96e4-da612d86fc3c" released by "_copy_volume_from_snapshot" :: held 8.800s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:03:39 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-697c6ad2-95db-4051-97f4-cd25eabe58c4 tempest-VolumeDependencyTests-1884220744 None] Lock "cinder-quobyte-f1469612-691f-4b53-8f46-8ba09e771942-03868ded-4b84-46c8-96e4-da612d86fc3c" released by "_create_volume_from_snapshot" :: held 8.918s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:03:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-697c6ad2-95db-4051-97f4-cd25eabe58c4 tempest-VolumeDependencyTests-1884220744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.978s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:03:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-b51c7138-0216-40e1-8e13-d5ac88c7d273 tempest-SnapshotDependencyTests-1212110797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 8.306s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:03:39 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-b51c7138-0216-40e1-8e13-d5ac88c7d273 tempest-SnapshotDependencyTests-1212110797 None] Acquiring lock "cinder-quobyte-f071096b-6860-4e29-bb5d-e78885f2e703-5ddbe814-9ac9-4c17-83a9-79075da92e5a" by "_create_volume_from_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:03:39 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-b51c7138-0216-40e1-8e13-d5ac88c7d273 tempest-SnapshotDependencyTests-1212110797 None] Lock "cinder-quobyte-f071096b-6860-4e29-bb5d-e78885f2e703-5ddbe814-9ac9-4c17-83a9-79075da92e5a" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:03:39 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-b51c7138-0216-40e1-8e13-d5ac88c7d273 tempest-SnapshotDependencyTests-1212110797 None] Creating volume 5ddbe814-9ac9-4c17-83a9-79075da92e5a from snapshot f071096b-6860-4e29-bb5d-e78885f2e703 {{(pid=86984) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 12:03:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-b51c7138-0216-40e1-8e13-d5ac88c7d273 tempest-SnapshotDependencyTests-1212110797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:03:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-b51c7138-0216-40e1-8e13-d5ac88c7d273 tempest-SnapshotDependencyTests-1212110797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:03:39 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-b51c7138-0216-40e1-8e13-d5ac88c7d273 tempest-SnapshotDependencyTests-1212110797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:03:39 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-b51c7138-0216-40e1-8e13-d5ac88c7d273 tempest-SnapshotDependencyTests-1212110797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:03:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-b51c7138-0216-40e1-8e13-d5ac88c7d273 tempest-SnapshotDependencyTests-1212110797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:03:39 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-b51c7138-0216-40e1-8e13-d5ac88c7d273 tempest-SnapshotDependencyTests-1212110797 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:03:39 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-b51c7138-0216-40e1-8e13-d5ac88c7d273 tempest-SnapshotDependencyTests-1212110797 None] Acquiring lock "cinder-quobyte-5ddbe814-9ac9-4c17-83a9-79075da92e5a" by "_copy_volume_from_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:03:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-697c6ad2-95db-4051-97f4-cd25eabe58c4 tempest-VolumeDependencyTests-1884220744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c8a91ea-2782-4704-84cf-bafe10e40b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03868ded-4b84-46c8-96e4-da612d86fc3c', 'volume_size': 1, 'snapshot_id': 'f1469612-691f-4b53-8f46-8ba09e771942'}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:03:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-697c6ad2-95db-4051-97f4-cd25eabe58c4 tempest-VolumeDependencyTests-1884220744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21635257-07b2-417c-959c-9759a112a014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:03:39 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-b51c7138-0216-40e1-8e13-d5ac88c7d273 tempest-SnapshotDependencyTests-1212110797 None] Lock "cinder-quobyte-5ddbe814-9ac9-4c17-83a9-79075da92e5a" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:03:39 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-b51c7138-0216-40e1-8e13-d5ac88c7d273 tempest-SnapshotDependencyTests-1212110797 None] snapshot: f071096b-6860-4e29-bb5d-e78885f2e703, volume: 5ddbe814-9ac9-4c17-83a9-79075da92e5a, {{(pid=86984) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 12:03:39 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-697c6ad2-95db-4051-97f4-cd25eabe58c4 tempest-VolumeDependencyTests-1884220744 None] Volume volume-03868ded-4b84-46c8-96e4-da612d86fc3c (03868ded-4b84-46c8-96e4-da612d86fc3c): created successfully Sep 25 12:03:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-697c6ad2-95db-4051-97f4-cd25eabe58c4 tempest-VolumeDependencyTests-1884220744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21635257-07b2-417c-959c-9759a112a014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:03:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-697c6ad2-95db-4051-97f4-cd25eabe58c4 tempest-VolumeDependencyTests-1884220744 None] Flow 'volume_create_manager' (ef789017-742e-4a6c-a93b-2f6eb98d2cd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:03:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-b51c7138-0216-40e1-8e13-d5ac88c7d273 tempest-SnapshotDependencyTests-1212110797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:03:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-b51c7138-0216-40e1-8e13-d5ac88c7d273 tempest-SnapshotDependencyTests-1212110797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:03:39 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-b51c7138-0216-40e1-8e13-d5ac88c7d273 tempest-SnapshotDependencyTests-1212110797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:03:39 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-b51c7138-0216-40e1-8e13-d5ac88c7d273 tempest-SnapshotDependencyTests-1212110797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:03:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-b51c7138-0216-40e1-8e13-d5ac88c7d273 tempest-SnapshotDependencyTests-1212110797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:03:39 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-697c6ad2-95db-4051-97f4-cd25eabe58c4 tempest-VolumeDependencyTests-1884220744 None] Created volume successfully. Sep 25 12:03:39 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9cd0019-0fc4-455e-9f2e-f8c0995df489]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:03:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-b51c7138-0216-40e1-8e13-d5ac88c7d273 tempest-SnapshotDependencyTests-1212110797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-917e295f-7879-44f1-be88-59994a18112b.f071096b-6860-4e29-bb5d-e78885f2e703 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:39 devstack sudo[107905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-917e295f-7879-44f1-be88-59994a18112b.f071096b-6860-4e29-bb5d-e78885f2e703 Sep 25 12:03:39 devstack sudo[107905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:40 devstack sudo[107905]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:40 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-b51c7138-0216-40e1-8e13-d5ac88c7d273 tempest-SnapshotDependencyTests-1212110797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-917e295f-7879-44f1-be88-59994a18112b.f071096b-6860-4e29-bb5d-e78885f2e703" returned: 0 in 0.436s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:40 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-b51c7138-0216-40e1-8e13-d5ac88c7d273 tempest-SnapshotDependencyTests-1212110797 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-917e295f-7879-44f1-be88-59994a18112b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86984) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:03:40 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf60429-b276-4b93-9bf1-77deada16dbf]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:03:40 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-b51c7138-0216-40e1-8e13-d5ac88c7d273 tempest-SnapshotDependencyTests-1212110797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-917e295f-7879-44f1-be88-59994a18112b {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:40 devstack sudo[107916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-917e295f-7879-44f1-be88-59994a18112b Sep 25 12:03:40 devstack sudo[107916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:40 devstack sudo[107916]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:40 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-b51c7138-0216-40e1-8e13-d5ac88c7d273 tempest-SnapshotDependencyTests-1212110797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-917e295f-7879-44f1-be88-59994a18112b" returned: 0 in 0.434s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:40 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-b51c7138-0216-40e1-8e13-d5ac88c7d273 tempest-SnapshotDependencyTests-1212110797 None] will copy from snapshot at /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-917e295f-7879-44f1-be88-59994a18112b {{(pid=86984) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 12:03:40 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-b51c7138-0216-40e1-8e13-d5ac88c7d273 tempest-SnapshotDependencyTests-1212110797 None] Creating direct copy from snapshot {{(pid=86984) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 12:03:40 devstack cinder-volume[86984]: DEBUG cinder.utils [None req-b51c7138-0216-40e1-8e13-d5ac88c7d273 tempest-SnapshotDependencyTests-1212110797 None] Path /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5ddbe814-9ac9-4c17-83a9-79075da92e5a not found in is_blk_device check {{(pid=86984) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 12:03:40 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-b51c7138-0216-40e1-8e13-d5ac88c7d273 tempest-SnapshotDependencyTests-1212110797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-917e295f-7879-44f1-be88-59994a18112b /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5ddbe814-9ac9-4c17-83a9-79075da92e5a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:40 devstack sudo[107921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-917e295f-7879-44f1-be88-59994a18112b /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5ddbe814-9ac9-4c17-83a9-79075da92e5a Sep 25 12:03:40 devstack sudo[107921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:40 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f8941f32-73e8-4182-83bd-4ddcb96e513d tempest-VolumeDependencyTests-1884220744 None] Acquiring lock "cinder-f1469612-691f-4b53-8f46-8ba09e771942-delete_snapshot" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:03:40 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f8941f32-73e8-4182-83bd-4ddcb96e513d tempest-VolumeDependencyTests-1884220744 None] Lock "cinder-f1469612-691f-4b53-8f46-8ba09e771942-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:03:40 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f8941f32-73e8-4182-83bd-4ddcb96e513d tempest-VolumeDependencyTests-1884220744 None] Acquiring lock "cinder-quobyte-5d00fd22-141f-4510-ad1c-c8553495d390" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:03:40 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f8941f32-73e8-4182-83bd-4ddcb96e513d tempest-VolumeDependencyTests-1884220744 None] Lock "cinder-quobyte-5d00fd22-141f-4510-ad1c-c8553495d390" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:03:40 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f8941f32-73e8-4182-83bd-4ddcb96e513d tempest-VolumeDependencyTests-1884220744 None] Acquiring lock "cinder-quobyte-f1469612-691f-4b53-8f46-8ba09e771942" by "_delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:03:40 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f8941f32-73e8-4182-83bd-4ddcb96e513d tempest-VolumeDependencyTests-1884220744 None] Lock "cinder-quobyte-f1469612-691f-4b53-8f46-8ba09e771942" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:03:40 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-f8941f32-73e8-4182-83bd-4ddcb96e513d tempest-VolumeDependencyTests-1884220744 None] Deleting offline snapshot f1469612-691f-4b53-8f46-8ba09e771942 of volume 5d00fd22-141f-4510-ad1c-c8553495d390 {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 12:03:40 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-f8941f32-73e8-4182-83bd-4ddcb96e513d tempest-VolumeDependencyTests-1884220744 None] snapshot_file for this snap is: volume-5d00fd22-141f-4510-ad1c-c8553495d390.f1469612-691f-4b53-8f46-8ba09e771942 {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 12:03:40 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbe2d7ea-cbb8-4af3-b3f9-1f9cb05f2b6f]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:03:40 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f8941f32-73e8-4182-83bd-4ddcb96e513d tempest-VolumeDependencyTests-1884220744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5d00fd22-141f-4510-ad1c-c8553495d390.f1469612-691f-4b53-8f46-8ba09e771942 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:40 devstack sudo[107927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5d00fd22-141f-4510-ad1c-c8553495d390.f1469612-691f-4b53-8f46-8ba09e771942 Sep 25 12:03:40 devstack sudo[107927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:41 devstack sudo[107927]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f8941f32-73e8-4182-83bd-4ddcb96e513d tempest-VolumeDependencyTests-1884220744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5d00fd22-141f-4510-ad1c-c8553495d390.f1469612-691f-4b53-8f46-8ba09e771942" returned: 0 in 0.459s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:41 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-f8941f32-73e8-4182-83bd-4ddcb96e513d tempest-VolumeDependencyTests-1884220744 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d00fd22-141f-4510-ad1c-c8553495d390(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86984) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:03:41 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6cb77e2-28cd-4b09-9dcf-98372d945214]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:03:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f8941f32-73e8-4182-83bd-4ddcb96e513d tempest-VolumeDependencyTests-1884220744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5d00fd22-141f-4510-ad1c-c8553495d390 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:41 devstack sudo[107938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5d00fd22-141f-4510-ad1c-c8553495d390 Sep 25 12:03:41 devstack sudo[107938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:42 devstack sudo[107938]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:42 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f8941f32-73e8-4182-83bd-4ddcb96e513d tempest-VolumeDependencyTests-1884220744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5d00fd22-141f-4510-ad1c-c8553495d390" returned: 0 in 1.129s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:42 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f8941f32-73e8-4182-83bd-4ddcb96e513d tempest-VolumeDependencyTests-1884220744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5d00fd22-141f-4510-ad1c-c8553495d390.f1469612-691f-4b53-8f46-8ba09e771942 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:42 devstack sudo[107943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5d00fd22-141f-4510-ad1c-c8553495d390.f1469612-691f-4b53-8f46-8ba09e771942 Sep 25 12:03:42 devstack sudo[107943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:43 devstack sudo[107943]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f8941f32-73e8-4182-83bd-4ddcb96e513d tempest-VolumeDependencyTests-1884220744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5d00fd22-141f-4510-ad1c-c8553495d390.f1469612-691f-4b53-8f46-8ba09e771942" returned: 0 in 0.656s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f8941f32-73e8-4182-83bd-4ddcb96e513d tempest-VolumeDependencyTests-1884220744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5d00fd22-141f-4510-ad1c-c8553495d390.f1469612-691f-4b53-8f46-8ba09e771942 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:43 devstack sudo[107949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5d00fd22-141f-4510-ad1c-c8553495d390.f1469612-691f-4b53-8f46-8ba09e771942 Sep 25 12:03:43 devstack sudo[107949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:43 devstack sudo[107949]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f8941f32-73e8-4182-83bd-4ddcb96e513d tempest-VolumeDependencyTests-1884220744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5d00fd22-141f-4510-ad1c-c8553495d390.f1469612-691f-4b53-8f46-8ba09e771942" returned: 0 in 0.421s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:43 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f8941f32-73e8-4182-83bd-4ddcb96e513d tempest-VolumeDependencyTests-1884220744 None] Lock "cinder-quobyte-f1469612-691f-4b53-8f46-8ba09e771942" released by "_delete_snapshot" :: held 2.864s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:03:43 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f8941f32-73e8-4182-83bd-4ddcb96e513d tempest-VolumeDependencyTests-1884220744 None] Lock "cinder-quobyte-5d00fd22-141f-4510-ad1c-c8553495d390" released by "delete_snapshot" :: held 2.901s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:03:44 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-f8941f32-73e8-4182-83bd-4ddcb96e513d tempest-VolumeDependencyTests-1884220744 None] Created reservations ['488bc4d1-1479-4431-8c05-1f73909f954d', '0efb3dd6-c909-4bcf-8385-87372342360b', '7bd154a4-d5d1-46aa-b5a3-7a086b5e8598', '76d4e2f3-e92b-4d8e-b283-36c40c044010'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:03:45 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-f8941f32-73e8-4182-83bd-4ddcb96e513d tempest-VolumeDependencyTests-1884220744 None] Delete snapshot completed successfully. Sep 25 12:03:45 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f8941f32-73e8-4182-83bd-4ddcb96e513d tempest-VolumeDependencyTests-1884220744 None] Lock "cinder-f1469612-691f-4b53-8f46-8ba09e771942-delete_snapshot" released by "delete_snapshot" :: held 5.117s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:03:46 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-af7f81c6-ca8c-4bef-bfb4-27ceb39e600f tempest-VolumeDependencyTests-1884220744 None] Acquiring lock "cinder-5d00fd22-141f-4510-ad1c-c8553495d390-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:03:46 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-af7f81c6-ca8c-4bef-bfb4-27ceb39e600f tempest-VolumeDependencyTests-1884220744 None] Lock "cinder-5d00fd22-141f-4510-ad1c-c8553495d390-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:03:46 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-af7f81c6-ca8c-4bef-bfb4-27ceb39e600f tempest-VolumeDependencyTests-1884220744 None] Acquiring lock "cinder-quobyte-5d00fd22-141f-4510-ad1c-c8553495d390" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:03:46 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-af7f81c6-ca8c-4bef-bfb4-27ceb39e600f tempest-VolumeDependencyTests-1884220744 None] Lock "cinder-quobyte-5d00fd22-141f-4510-ad1c-c8553495d390" acquired by "delete_volume" :: waited 0.042s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:03:46 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ae77fd-7fee-4fb0-8d2f-e052633d1225]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:03:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-af7f81c6-ca8c-4bef-bfb4-27ceb39e600f tempest-VolumeDependencyTests-1884220744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5d00fd22-141f-4510-ad1c-c8553495d390 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:46 devstack sudo[107953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5d00fd22-141f-4510-ad1c-c8553495d390 Sep 25 12:03:46 devstack sudo[107953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:47 devstack sudo[107953]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-af7f81c6-ca8c-4bef-bfb4-27ceb39e600f tempest-VolumeDependencyTests-1884220744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5d00fd22-141f-4510-ad1c-c8553495d390" returned: 0 in 0.632s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-af7f81c6-ca8c-4bef-bfb4-27ceb39e600f tempest-VolumeDependencyTests-1884220744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5d00fd22-141f-4510-ad1c-c8553495d390 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:47 devstack sudo[107958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5d00fd22-141f-4510-ad1c-c8553495d390 Sep 25 12:03:47 devstack sudo[107958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:47 devstack sudo[107958]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-af7f81c6-ca8c-4bef-bfb4-27ceb39e600f tempest-VolumeDependencyTests-1884220744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5d00fd22-141f-4510-ad1c-c8553495d390" returned: 0 in 0.618s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:47 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-af7f81c6-ca8c-4bef-bfb4-27ceb39e600f tempest-VolumeDependencyTests-1884220744 None] Lock "cinder-quobyte-5d00fd22-141f-4510-ad1c-c8553495d390" released by "delete_volume" :: held 1.424s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:03:47 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-af7f81c6-ca8c-4bef-bfb4-27ceb39e600f tempest-VolumeDependencyTests-1884220744 None] Created reservations ['c07036e2-2c83-43c1-9a71-a14536a5d72c', 'e5cc83b0-403d-4583-8dde-f473723a5b02', '46863747-50a0-4887-afab-f2f83eb90ed7', 'b40249d7-daa9-435f-b41b-651ec171102a'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:03:48 devstack sudo[107921]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-b51c7138-0216-40e1-8e13-d5ac88c7d273 tempest-SnapshotDependencyTests-1212110797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-917e295f-7879-44f1-be88-59994a18112b /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5ddbe814-9ac9-4c17-83a9-79075da92e5a" returned: 0 in 7.563s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:48 devstack cinder-volume[86984]: DEBUG cinder.image.image_utils [None req-b51c7138-0216-40e1-8e13-d5ac88c7d273 tempest-SnapshotDependencyTests-1212110797 None] Image conversion details: src /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-917e295f-7879-44f1-be88-59994a18112b, size 1024.00 MB, duration 7.57 sec, destination /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5ddbe814-9ac9-4c17-83a9-79075da92e5a {{(pid=86984) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 12:03:48 devstack cinder-volume[86984]: INFO cinder.image.image_utils [None req-b51c7138-0216-40e1-8e13-d5ac88c7d273 tempest-SnapshotDependencyTests-1212110797 None] Converted 1024.00 MB image at 135.36 MB/s Sep 25 12:03:48 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-b51c7138-0216-40e1-8e13-d5ac88c7d273 tempest-SnapshotDependencyTests-1212110797 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5ddbe814-9ac9-4c17-83a9-79075da92e5a is being set with open permissions: ugo+rw Sep 25 12:03:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-b51c7138-0216-40e1-8e13-d5ac88c7d273 tempest-SnapshotDependencyTests-1212110797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5ddbe814-9ac9-4c17-83a9-79075da92e5a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:48 devstack sudo[107961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5ddbe814-9ac9-4c17-83a9-79075da92e5a Sep 25 12:03:48 devstack sudo[107961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-af7f81c6-ca8c-4bef-bfb4-27ceb39e600f tempest-VolumeDependencyTests-1884220744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:03:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-af7f81c6-ca8c-4bef-bfb4-27ceb39e600f tempest-VolumeDependencyTests-1884220744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:03:48 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-af7f81c6-ca8c-4bef-bfb4-27ceb39e600f tempest-VolumeDependencyTests-1884220744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:03:48 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-af7f81c6-ca8c-4bef-bfb4-27ceb39e600f tempest-VolumeDependencyTests-1884220744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:03:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-af7f81c6-ca8c-4bef-bfb4-27ceb39e600f tempest-VolumeDependencyTests-1884220744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:03:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-af7f81c6-ca8c-4bef-bfb4-27ceb39e600f tempest-VolumeDependencyTests-1884220744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:48 devstack sudo[107963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 12:03:48 devstack sudo[107963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:48 devstack sudo[107961]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-b51c7138-0216-40e1-8e13-d5ac88c7d273 tempest-SnapshotDependencyTests-1212110797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5ddbe814-9ac9-4c17-83a9-79075da92e5a" returned: 0 in 0.337s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:48 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-b51c7138-0216-40e1-8e13-d5ac88c7d273 tempest-SnapshotDependencyTests-1212110797 None] Lock "cinder-quobyte-5ddbe814-9ac9-4c17-83a9-79075da92e5a" released by "_copy_volume_from_snapshot" :: held 8.906s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:03:48 devstack sudo[107963]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-af7f81c6-ca8c-4bef-bfb4-27ceb39e600f tempest-VolumeDependencyTests-1884220744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.317s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:48 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-af7f81c6-ca8c-4bef-bfb4-27ceb39e600f tempest-VolumeDependencyTests-1884220744 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:03:48 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-af7f81c6-ca8c-4bef-bfb4-27ceb39e600f tempest-VolumeDependencyTests-1884220744 None] Deleted volume successfully. Sep 25 12:03:48 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-b51c7138-0216-40e1-8e13-d5ac88c7d273 tempest-SnapshotDependencyTests-1212110797 None] Lock "cinder-quobyte-f071096b-6860-4e29-bb5d-e78885f2e703-5ddbe814-9ac9-4c17-83a9-79075da92e5a" released by "_create_volume_from_snapshot" :: held 9.016s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:03:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-b51c7138-0216-40e1-8e13-d5ac88c7d273 tempest-SnapshotDependencyTests-1212110797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.039s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:03:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-1cc9db44-7224-4ffb-901f-77554be3a94d tempest-CinderUnicodeTest-1542186967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.615s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:03:48 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-1cc9db44-7224-4ffb-901f-77554be3a94d tempest-CinderUnicodeTest-1542186967 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:03:31Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1408968602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa511b7a-949a-4eef-928d-6016c97a3730,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dc0ff1f5ba54af6b590c488cc8e0733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:03:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:03:32Z,use_quota=True,user_id='119c20416a814d79821c2f06b6584220',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:03:48 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-1cc9db44-7224-4ffb-901f-77554be3a94d tempest-CinderUnicodeTest-1542186967 None] Creating volume fa511b7a-949a-4eef-928d-6016c97a3730 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:03:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-1cc9db44-7224-4ffb-901f-77554be3a94d tempest-CinderUnicodeTest-1542186967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:03:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-1cc9db44-7224-4ffb-901f-77554be3a94d tempest-CinderUnicodeTest-1542186967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:03:48 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-1cc9db44-7224-4ffb-901f-77554be3a94d tempest-CinderUnicodeTest-1542186967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:03:48 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-1cc9db44-7224-4ffb-901f-77554be3a94d tempest-CinderUnicodeTest-1542186967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:03:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-1cc9db44-7224-4ffb-901f-77554be3a94d tempest-CinderUnicodeTest-1542186967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:03:48 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-1cc9db44-7224-4ffb-901f-77554be3a94d tempest-CinderUnicodeTest-1542186967 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:03:48 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-1cc9db44-7224-4ffb-901f-77554be3a94d tempest-CinderUnicodeTest-1542186967 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 12:03:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-1cc9db44-7224-4ffb-901f-77554be3a94d tempest-CinderUnicodeTest-1542186967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fa511b7a-949a-4eef-928d-6016c97a3730 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:48 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-af7f81c6-ca8c-4bef-bfb4-27ceb39e600f tempest-VolumeDependencyTests-1884220744 None] Lock "cinder-5d00fd22-141f-4510-ad1c-c8553495d390-delete_volume" released by "delete_volume" :: held 2.224s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:03:48 devstack sudo[107967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fa511b7a-949a-4eef-928d-6016c97a3730 1073741824 Sep 25 12:03:48 devstack sudo[107967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:48 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b51c7138-0216-40e1-8e13-d5ac88c7d273 tempest-SnapshotDependencyTests-1212110797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b42ef498-82a7-4a67-88eb-b2651bb6572b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ddbe814-9ac9-4c17-83a9-79075da92e5a', 'volume_size': 1, 'snapshot_id': 'f071096b-6860-4e29-bb5d-e78885f2e703'}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:03:48 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b51c7138-0216-40e1-8e13-d5ac88c7d273 tempest-SnapshotDependencyTests-1212110797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af5f8901-7591-4ed8-ab9d-b6095147058f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:03:48 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-b51c7138-0216-40e1-8e13-d5ac88c7d273 tempest-SnapshotDependencyTests-1212110797 None] Volume volume-5ddbe814-9ac9-4c17-83a9-79075da92e5a (5ddbe814-9ac9-4c17-83a9-79075da92e5a): created successfully Sep 25 12:03:48 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b51c7138-0216-40e1-8e13-d5ac88c7d273 tempest-SnapshotDependencyTests-1212110797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af5f8901-7591-4ed8-ab9d-b6095147058f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:03:48 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b51c7138-0216-40e1-8e13-d5ac88c7d273 tempest-SnapshotDependencyTests-1212110797 None] Flow 'volume_create_manager' (493eb5c1-11fa-4115-bbd4-31279eac3de7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:03:48 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-b51c7138-0216-40e1-8e13-d5ac88c7d273 tempest-SnapshotDependencyTests-1212110797 None] Created volume successfully. Sep 25 12:03:48 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f5cc072f-76a3-4648-89c0-a9366c935127 tempest-VolumeDependencyTests-1884220744 None] Acquiring lock "cinder-03868ded-4b84-46c8-96e4-da612d86fc3c-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:03:48 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f5cc072f-76a3-4648-89c0-a9366c935127 tempest-VolumeDependencyTests-1884220744 None] Lock "cinder-03868ded-4b84-46c8-96e4-da612d86fc3c-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:03:48 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f5cc072f-76a3-4648-89c0-a9366c935127 tempest-VolumeDependencyTests-1884220744 None] Acquiring lock "cinder-quobyte-03868ded-4b84-46c8-96e4-da612d86fc3c" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:03:48 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f5cc072f-76a3-4648-89c0-a9366c935127 tempest-VolumeDependencyTests-1884220744 None] Lock "cinder-quobyte-03868ded-4b84-46c8-96e4-da612d86fc3c" acquired by "delete_volume" :: waited 0.019s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:03:48 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9d5d62-a1c3-4a15-a60a-b32917b5e9e1]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:03:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f5cc072f-76a3-4648-89c0-a9366c935127 tempest-VolumeDependencyTests-1884220744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-03868ded-4b84-46c8-96e4-da612d86fc3c {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:48 devstack sudo[107972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-03868ded-4b84-46c8-96e4-da612d86fc3c Sep 25 12:03:48 devstack sudo[107972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:49 devstack sudo[107967]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-1cc9db44-7224-4ffb-901f-77554be3a94d tempest-CinderUnicodeTest-1542186967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fa511b7a-949a-4eef-928d-6016c97a3730 1073741824" returned: 0 in 0.582s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-1cc9db44-7224-4ffb-901f-77554be3a94d tempest-CinderUnicodeTest-1542186967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fa511b7a-949a-4eef-928d-6016c97a3730 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:49 devstack sudo[107975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fa511b7a-949a-4eef-928d-6016c97a3730 Sep 25 12:03:49 devstack sudo[107975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:49 devstack sudo[107972]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f5cc072f-76a3-4648-89c0-a9366c935127 tempest-VolumeDependencyTests-1884220744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-03868ded-4b84-46c8-96e4-da612d86fc3c" returned: 0 in 0.409s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f5cc072f-76a3-4648-89c0-a9366c935127 tempest-VolumeDependencyTests-1884220744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-03868ded-4b84-46c8-96e4-da612d86fc3c {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:49 devstack sudo[107980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-03868ded-4b84-46c8-96e4-da612d86fc3c Sep 25 12:03:49 devstack sudo[107980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:49 devstack sudo[107975]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-1cc9db44-7224-4ffb-901f-77554be3a94d tempest-CinderUnicodeTest-1542186967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fa511b7a-949a-4eef-928d-6016c97a3730" returned: 0 in 0.286s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:49 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-1cc9db44-7224-4ffb-901f-77554be3a94d tempest-CinderUnicodeTest-1542186967 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:03:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-1cc9db44-7224-4ffb-901f-77554be3a94d tempest-CinderUnicodeTest-1542186967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:03:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-808a9312-7b5b-4726-895c-09c50fa0c958 tempest-ProjectMemberTests-1434405994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.453s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:03:49 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-808a9312-7b5b-4726-895c-09c50fa0c958 tempest-ProjectMemberTests-1434405994 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:03:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1184723967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07158b61-1934-4e95-a1f9-9d0d9f057009,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c75afeac65f84f13b7d0325fa4b21b65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:03:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:03:38Z,use_quota=True,user_id='770f7e0a81074bae8bcd048c8d7f7347',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:03:49 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-808a9312-7b5b-4726-895c-09c50fa0c958 tempest-ProjectMemberTests-1434405994 None] Creating volume 07158b61-1934-4e95-a1f9-9d0d9f057009 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:03:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-808a9312-7b5b-4726-895c-09c50fa0c958 tempest-ProjectMemberTests-1434405994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:03:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-808a9312-7b5b-4726-895c-09c50fa0c958 tempest-ProjectMemberTests-1434405994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:03:49 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-808a9312-7b5b-4726-895c-09c50fa0c958 tempest-ProjectMemberTests-1434405994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:03:49 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-808a9312-7b5b-4726-895c-09c50fa0c958 tempest-ProjectMemberTests-1434405994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:03:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-808a9312-7b5b-4726-895c-09c50fa0c958 tempest-ProjectMemberTests-1434405994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:03:49 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-808a9312-7b5b-4726-895c-09c50fa0c958 tempest-ProjectMemberTests-1434405994 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:03:49 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-808a9312-7b5b-4726-895c-09c50fa0c958 tempest-ProjectMemberTests-1434405994 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 12:03:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-808a9312-7b5b-4726-895c-09c50fa0c958 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07158b61-1934-4e95-a1f9-9d0d9f057009 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-1cc9db44-7224-4ffb-901f-77554be3a94d tempest-CinderUnicodeTest-1542186967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (639f5251-c43f-4041-973e-537ac1e1bbe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa511b7a-949a-4eef-928d-6016c97a3730', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:03:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-1cc9db44-7224-4ffb-901f-77554be3a94d tempest-CinderUnicodeTest-1542186967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cd9c03c-28f2-41e6-95f6-6029d030bfc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:03:49 devstack sudo[107983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07158b61-1934-4e95-a1f9-9d0d9f057009 1073741824 Sep 25 12:03:49 devstack sudo[107983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:49 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-1cc9db44-7224-4ffb-901f-77554be3a94d tempest-CinderUnicodeTest-1542186967 None] Volume volume-fa511b7a-949a-4eef-928d-6016c97a3730 (fa511b7a-949a-4eef-928d-6016c97a3730): created successfully Sep 25 12:03:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-1cc9db44-7224-4ffb-901f-77554be3a94d tempest-CinderUnicodeTest-1542186967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cd9c03c-28f2-41e6-95f6-6029d030bfc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:03:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-1cc9db44-7224-4ffb-901f-77554be3a94d tempest-CinderUnicodeTest-1542186967 None] Flow 'volume_create_manager' (c5ce86eb-a62b-4bba-9d62-32ee93438668) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:03:49 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-1cc9db44-7224-4ffb-901f-77554be3a94d tempest-CinderUnicodeTest-1542186967 None] Created volume successfully. Sep 25 12:03:49 devstack sudo[107980]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f5cc072f-76a3-4648-89c0-a9366c935127 tempest-VolumeDependencyTests-1884220744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-03868ded-4b84-46c8-96e4-da612d86fc3c" returned: 0 in 0.278s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:49 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f5cc072f-76a3-4648-89c0-a9366c935127 tempest-VolumeDependencyTests-1884220744 None] Lock "cinder-quobyte-03868ded-4b84-46c8-96e4-da612d86fc3c" released by "delete_volume" :: held 0.746s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:03:49 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-f5cc072f-76a3-4648-89c0-a9366c935127 tempest-VolumeDependencyTests-1884220744 None] Created reservations ['8fa5c467-4a99-40e1-97fc-aac2e3a33eb8', '03420341-12f4-4df0-9b28-09d954c61bb9', '08da777c-b117-469d-b79e-e4d9ac274322', '96d535fc-f7ea-4174-9552-28afb1d4a4b8'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:03:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f5cc072f-76a3-4648-89c0-a9366c935127 tempest-VolumeDependencyTests-1884220744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:03:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f5cc072f-76a3-4648-89c0-a9366c935127 tempest-VolumeDependencyTests-1884220744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:03:49 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-f5cc072f-76a3-4648-89c0-a9366c935127 tempest-VolumeDependencyTests-1884220744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:03:49 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-f5cc072f-76a3-4648-89c0-a9366c935127 tempest-VolumeDependencyTests-1884220744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:03:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f5cc072f-76a3-4648-89c0-a9366c935127 tempest-VolumeDependencyTests-1884220744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:03:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f5cc072f-76a3-4648-89c0-a9366c935127 tempest-VolumeDependencyTests-1884220744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:49 devstack sudo[107988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 12:03:49 devstack sudo[107988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:49 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ec4965e3-61fe-4fa6-a207-2c263f56d947 tempest-SnapshotDependencyTests-1212110797 None] Acquiring lock "cinder-f071096b-6860-4e29-bb5d-e78885f2e703-delete_snapshot" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:03:49 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ec4965e3-61fe-4fa6-a207-2c263f56d947 tempest-SnapshotDependencyTests-1212110797 None] Lock "cinder-f071096b-6860-4e29-bb5d-e78885f2e703-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:03:49 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ec4965e3-61fe-4fa6-a207-2c263f56d947 tempest-SnapshotDependencyTests-1212110797 None] Acquiring lock "cinder-quobyte-917e295f-7879-44f1-be88-59994a18112b" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:03:49 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ec4965e3-61fe-4fa6-a207-2c263f56d947 tempest-SnapshotDependencyTests-1212110797 None] Lock "cinder-quobyte-917e295f-7879-44f1-be88-59994a18112b" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:03:49 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ec4965e3-61fe-4fa6-a207-2c263f56d947 tempest-SnapshotDependencyTests-1212110797 None] Acquiring lock "cinder-quobyte-f071096b-6860-4e29-bb5d-e78885f2e703" by "_delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:03:49 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ec4965e3-61fe-4fa6-a207-2c263f56d947 tempest-SnapshotDependencyTests-1212110797 None] Lock "cinder-quobyte-f071096b-6860-4e29-bb5d-e78885f2e703" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:03:49 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-ec4965e3-61fe-4fa6-a207-2c263f56d947 tempest-SnapshotDependencyTests-1212110797 None] Deleting offline snapshot f071096b-6860-4e29-bb5d-e78885f2e703 of volume 917e295f-7879-44f1-be88-59994a18112b {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 12:03:49 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-ec4965e3-61fe-4fa6-a207-2c263f56d947 tempest-SnapshotDependencyTests-1212110797 None] snapshot_file for this snap is: volume-917e295f-7879-44f1-be88-59994a18112b.f071096b-6860-4e29-bb5d-e78885f2e703 {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 12:03:49 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae02ab2-9344-417a-9327-6d097fdd1681]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:03:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ec4965e3-61fe-4fa6-a207-2c263f56d947 tempest-SnapshotDependencyTests-1212110797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-917e295f-7879-44f1-be88-59994a18112b.f071096b-6860-4e29-bb5d-e78885f2e703 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:50 devstack sudo[107988]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f5cc072f-76a3-4648-89c0-a9366c935127 tempest-VolumeDependencyTests-1884220744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.360s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:50 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-f5cc072f-76a3-4648-89c0-a9366c935127 tempest-VolumeDependencyTests-1884220744 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:03:50 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-f5cc072f-76a3-4648-89c0-a9366c935127 tempest-VolumeDependencyTests-1884220744 None] Deleted volume successfully. Sep 25 12:03:50 devstack sudo[107992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-917e295f-7879-44f1-be88-59994a18112b.f071096b-6860-4e29-bb5d-e78885f2e703 Sep 25 12:03:50 devstack sudo[107992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:50 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f5cc072f-76a3-4648-89c0-a9366c935127 tempest-VolumeDependencyTests-1884220744 None] Lock "cinder-03868ded-4b84-46c8-96e4-da612d86fc3c-delete_volume" released by "delete_volume" :: held 1.378s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:03:50 devstack sudo[107983]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-808a9312-7b5b-4726-895c-09c50fa0c958 tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07158b61-1934-4e95-a1f9-9d0d9f057009 1073741824" returned: 0 in 0.726s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-808a9312-7b5b-4726-895c-09c50fa0c958 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07158b61-1934-4e95-a1f9-9d0d9f057009 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:50 devstack sudo[107995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07158b61-1934-4e95-a1f9-9d0d9f057009 Sep 25 12:03:50 devstack sudo[107995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:50 devstack sudo[107992]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ec4965e3-61fe-4fa6-a207-2c263f56d947 tempest-SnapshotDependencyTests-1212110797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-917e295f-7879-44f1-be88-59994a18112b.f071096b-6860-4e29-bb5d-e78885f2e703" returned: 0 in 0.513s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:50 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-ec4965e3-61fe-4fa6-a207-2c263f56d947 tempest-SnapshotDependencyTests-1212110797 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-917e295f-7879-44f1-be88-59994a18112b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86984) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:03:50 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[00104c50-2f2a-47d4-9ffa-f01f0a7b765d]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:03:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ec4965e3-61fe-4fa6-a207-2c263f56d947 tempest-SnapshotDependencyTests-1212110797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-917e295f-7879-44f1-be88-59994a18112b {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:50 devstack sudo[107995]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-808a9312-7b5b-4726-895c-09c50fa0c958 tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07158b61-1934-4e95-a1f9-9d0d9f057009" returned: 0 in 0.357s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:50 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-808a9312-7b5b-4726-895c-09c50fa0c958 tempest-ProjectMemberTests-1434405994 None] <== create_volume: return (1145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:03:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-808a9312-7b5b-4726-895c-09c50fa0c958 tempest-ProjectMemberTests-1434405994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:03:50 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-808a9312-7b5b-4726-895c-09c50fa0c958 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74a811c2-bc01-4a55-b4bd-82fc4763d180) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07158b61-1934-4e95-a1f9-9d0d9f057009', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:03:50 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-808a9312-7b5b-4726-895c-09c50fa0c958 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4c7ec4a-eac9-4ad9-a485-18bdef6c1312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:03:50 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-808a9312-7b5b-4726-895c-09c50fa0c958 tempest-ProjectMemberTests-1434405994 None] Volume volume-07158b61-1934-4e95-a1f9-9d0d9f057009 (07158b61-1934-4e95-a1f9-9d0d9f057009): created successfully Sep 25 12:03:50 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-808a9312-7b5b-4726-895c-09c50fa0c958 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4c7ec4a-eac9-4ad9-a485-18bdef6c1312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:03:50 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-808a9312-7b5b-4726-895c-09c50fa0c958 tempest-ProjectMemberTests-1434405994 None] Flow 'volume_create_manager' (c700a3d4-fefc-4fc3-81ae-9b3342747328) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:03:50 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-808a9312-7b5b-4726-895c-09c50fa0c958 tempest-ProjectMemberTests-1434405994 None] Created volume successfully. Sep 25 12:03:50 devstack sudo[108001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-917e295f-7879-44f1-be88-59994a18112b Sep 25 12:03:50 devstack sudo[108001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-0e00e91a-051f-462d-8d8f-1685416f0fed tempest-CinderUnicodeTest-1542186967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:03:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-0e00e91a-051f-462d-8d8f-1685416f0fed tempest-CinderUnicodeTest-1542186967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:03:51 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-0e00e91a-051f-462d-8d8f-1685416f0fed tempest-CinderUnicodeTest-1542186967 None] Creating offline snapshot 062ca100-01e1-4110-860a-11fa1a854dd9 of volume fa511b7a-949a-4eef-928d-6016c97a3730 {{(pid=86984) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 12:03:51 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[89317381-89e3-4adc-af24-cc364788f474]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:03:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-0e00e91a-051f-462d-8d8f-1685416f0fed tempest-CinderUnicodeTest-1542186967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fa511b7a-949a-4eef-928d-6016c97a3730 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:51 devstack sudo[108001]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ec4965e3-61fe-4fa6-a207-2c263f56d947 tempest-SnapshotDependencyTests-1212110797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-917e295f-7879-44f1-be88-59994a18112b" returned: 0 in 0.723s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ec4965e3-61fe-4fa6-a207-2c263f56d947 tempest-SnapshotDependencyTests-1212110797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-917e295f-7879-44f1-be88-59994a18112b.f071096b-6860-4e29-bb5d-e78885f2e703 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:51 devstack sudo[108005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fa511b7a-949a-4eef-928d-6016c97a3730 Sep 25 12:03:51 devstack sudo[108005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:51 devstack sudo[108007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-917e295f-7879-44f1-be88-59994a18112b.f071096b-6860-4e29-bb5d-e78885f2e703 Sep 25 12:03:51 devstack sudo[108007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:51 devstack sudo[108005]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-0e00e91a-051f-462d-8d8f-1685416f0fed tempest-CinderUnicodeTest-1542186967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fa511b7a-949a-4eef-928d-6016c97a3730" returned: 0 in 0.669s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-0e00e91a-051f-462d-8d8f-1685416f0fed tempest-CinderUnicodeTest-1542186967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fa511b7a-949a-4eef-928d-6016c97a3730,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fa511b7a-949a-4eef-928d-6016c97a3730.062ca100-01e1-4110-860a-11fa1a854dd9 1G {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:51 devstack sudo[108018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fa511b7a-949a-4eef-928d-6016c97a3730,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fa511b7a-949a-4eef-928d-6016c97a3730.062ca100-01e1-4110-860a-11fa1a854dd9 1G Sep 25 12:03:51 devstack sudo[108018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d0efb316-7635-486c-90f0-772712b707a8 tempest-ProjectMemberTests-1434405994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:03:51 devstack sudo[108007]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ec4965e3-61fe-4fa6-a207-2c263f56d947 tempest-SnapshotDependencyTests-1212110797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-917e295f-7879-44f1-be88-59994a18112b.f071096b-6860-4e29-bb5d-e78885f2e703" returned: 0 in 0.597s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ec4965e3-61fe-4fa6-a207-2c263f56d947 tempest-SnapshotDependencyTests-1212110797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-917e295f-7879-44f1-be88-59994a18112b.f071096b-6860-4e29-bb5d-e78885f2e703 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:51 devstack sudo[108020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-917e295f-7879-44f1-be88-59994a18112b.f071096b-6860-4e29-bb5d-e78885f2e703 Sep 25 12:03:51 devstack sudo[108020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:52 devstack sudo[108020]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ec4965e3-61fe-4fa6-a207-2c263f56d947 tempest-SnapshotDependencyTests-1212110797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-917e295f-7879-44f1-be88-59994a18112b.f071096b-6860-4e29-bb5d-e78885f2e703" returned: 0 in 0.426s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:52 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ec4965e3-61fe-4fa6-a207-2c263f56d947 tempest-SnapshotDependencyTests-1212110797 None] Lock "cinder-quobyte-f071096b-6860-4e29-bb5d-e78885f2e703" released by "_delete_snapshot" :: held 2.450s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:03:52 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ec4965e3-61fe-4fa6-a207-2c263f56d947 tempest-SnapshotDependencyTests-1212110797 None] Lock "cinder-quobyte-917e295f-7879-44f1-be88-59994a18112b" released by "delete_snapshot" :: held 2.485s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:03:52 devstack sudo[108018]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-0e00e91a-051f-462d-8d8f-1685416f0fed tempest-CinderUnicodeTest-1542186967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fa511b7a-949a-4eef-928d-6016c97a3730,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fa511b7a-949a-4eef-928d-6016c97a3730.062ca100-01e1-4110-860a-11fa1a854dd9 1G" returned: 0 in 0.669s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-0e00e91a-051f-462d-8d8f-1685416f0fed tempest-CinderUnicodeTest-1542186967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa511b7a-949a-4eef-928d-6016c97a3730 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fa511b7a-949a-4eef-928d-6016c97a3730.062ca100-01e1-4110-860a-11fa1a854dd9 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:52 devstack sudo[108029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa511b7a-949a-4eef-928d-6016c97a3730 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fa511b7a-949a-4eef-928d-6016c97a3730.062ca100-01e1-4110-860a-11fa1a854dd9 Sep 25 12:03:52 devstack sudo[108029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:52 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-ec4965e3-61fe-4fa6-a207-2c263f56d947 tempest-SnapshotDependencyTests-1212110797 None] Created reservations ['a31a13b6-619b-4a6a-aa3c-2582037e33c3', 'af9fb609-ebfe-4185-b0a2-b6362d8fb29f', 'c498cb57-3048-443e-b5e0-a412aa0f1522', '38ed0857-800c-4818-992b-1a2bff5f7a96'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:03:52 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-ec4965e3-61fe-4fa6-a207-2c263f56d947 tempest-SnapshotDependencyTests-1212110797 None] Delete snapshot completed successfully. Sep 25 12:03:52 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ec4965e3-61fe-4fa6-a207-2c263f56d947 tempest-SnapshotDependencyTests-1212110797 None] Lock "cinder-f071096b-6860-4e29-bb5d-e78885f2e703-delete_snapshot" released by "delete_snapshot" :: held 2.741s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:03:52 devstack sudo[108029]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-0e00e91a-051f-462d-8d8f-1685416f0fed tempest-CinderUnicodeTest-1542186967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa511b7a-949a-4eef-928d-6016c97a3730 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fa511b7a-949a-4eef-928d-6016c97a3730.062ca100-01e1-4110-860a-11fa1a854dd9" returned: 0 in 0.464s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:52 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-0e00e91a-051f-462d-8d8f-1685416f0fed tempest-CinderUnicodeTest-1542186967 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fa511b7a-949a-4eef-928d-6016c97a3730.062ca100-01e1-4110-860a-11fa1a854dd9 is being set with open permissions: ugo+rw Sep 25 12:03:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-0e00e91a-051f-462d-8d8f-1685416f0fed tempest-CinderUnicodeTest-1542186967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fa511b7a-949a-4eef-928d-6016c97a3730.062ca100-01e1-4110-860a-11fa1a854dd9 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:52 devstack sudo[108034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fa511b7a-949a-4eef-928d-6016c97a3730.062ca100-01e1-4110-860a-11fa1a854dd9 Sep 25 12:03:52 devstack sudo[108034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:53 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-b6376f57-2752-44c7-809a-622c28117558 tempest-SnapshotDependencyTests-1212110797 None] Acquiring lock "cinder-917e295f-7879-44f1-be88-59994a18112b-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:03:53 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-b6376f57-2752-44c7-809a-622c28117558 tempest-SnapshotDependencyTests-1212110797 None] Lock "cinder-917e295f-7879-44f1-be88-59994a18112b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:03:53 devstack sudo[108034]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:53 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-b6376f57-2752-44c7-809a-622c28117558 tempest-SnapshotDependencyTests-1212110797 None] Acquiring lock "cinder-quobyte-917e295f-7879-44f1-be88-59994a18112b" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:03:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-0e00e91a-051f-462d-8d8f-1685416f0fed tempest-CinderUnicodeTest-1542186967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fa511b7a-949a-4eef-928d-6016c97a3730.062ca100-01e1-4110-860a-11fa1a854dd9" returned: 0 in 0.382s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:53 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-b6376f57-2752-44c7-809a-622c28117558 tempest-SnapshotDependencyTests-1212110797 None] Lock "cinder-quobyte-917e295f-7879-44f1-be88-59994a18112b" acquired by "delete_volume" :: waited 0.027s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:03:53 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef81400-d649-4e40-81d1-30ce80a3c8b7]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:03:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-b6376f57-2752-44c7-809a-622c28117558 tempest-SnapshotDependencyTests-1212110797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-917e295f-7879-44f1-be88-59994a18112b {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-0e00e91a-051f-462d-8d8f-1685416f0fed tempest-CinderUnicodeTest-1542186967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fa511b7a-949a-4eef-928d-6016c97a3730.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:53 devstack sudo[108038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fa511b7a-949a-4eef-928d-6016c97a3730.info Sep 25 12:03:53 devstack sudo[108038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:53 devstack sudo[108037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-917e295f-7879-44f1-be88-59994a18112b Sep 25 12:03:53 devstack sudo[108037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:53 devstack sudo[108038]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-0e00e91a-051f-462d-8d8f-1685416f0fed tempest-CinderUnicodeTest-1542186967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fa511b7a-949a-4eef-928d-6016c97a3730.info" returned: 0 in 0.326s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:53 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-0e00e91a-051f-462d-8d8f-1685416f0fed tempest-CinderUnicodeTest-1542186967 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fa511b7a-949a-4eef-928d-6016c97a3730.info is being set with open permissions: ugo+rw Sep 25 12:03:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-0e00e91a-051f-462d-8d8f-1685416f0fed tempest-CinderUnicodeTest-1542186967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fa511b7a-949a-4eef-928d-6016c97a3730.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:53 devstack sudo[108042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fa511b7a-949a-4eef-928d-6016c97a3730.info Sep 25 12:03:53 devstack sudo[108042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:53 devstack sudo[108037]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-b6376f57-2752-44c7-809a-622c28117558 tempest-SnapshotDependencyTests-1212110797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-917e295f-7879-44f1-be88-59994a18112b" returned: 0 in 0.493s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-b6376f57-2752-44c7-809a-622c28117558 tempest-SnapshotDependencyTests-1212110797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-917e295f-7879-44f1-be88-59994a18112b {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:53 devstack sudo[108047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-917e295f-7879-44f1-be88-59994a18112b Sep 25 12:03:53 devstack sudo[108047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:54 devstack sudo[108042]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-0e00e91a-051f-462d-8d8f-1685416f0fed tempest-CinderUnicodeTest-1542186967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fa511b7a-949a-4eef-928d-6016c97a3730.info" returned: 0 in 0.337s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-0e00e91a-051f-462d-8d8f-1685416f0fed tempest-CinderUnicodeTest-1542186967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.035s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:03:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d0efb316-7635-486c-90f0-772712b707a8 tempest-ProjectMemberTests-1434405994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.245s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:03:54 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-d0efb316-7635-486c-90f0-772712b707a8 tempest-ProjectMemberTests-1434405994 None] Creating offline snapshot 8e0ba3de-5ce1-4283-95d0-797852c26966 of volume 07158b61-1934-4e95-a1f9-9d0d9f057009 {{(pid=86984) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 12:03:54 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-0e00e91a-051f-462d-8d8f-1685416f0fed tempest-CinderUnicodeTest-1542186967 None] Create snapshot completed successfully Sep 25 12:03:54 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[93adbc18-d282-432b-abbb-aafbb94e62e0]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:03:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d0efb316-7635-486c-90f0-772712b707a8 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07158b61-1934-4e95-a1f9-9d0d9f057009 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:54 devstack sudo[108047]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-b6376f57-2752-44c7-809a-622c28117558 tempest-SnapshotDependencyTests-1212110797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-917e295f-7879-44f1-be88-59994a18112b" returned: 0 in 0.367s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:54 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-b6376f57-2752-44c7-809a-622c28117558 tempest-SnapshotDependencyTests-1212110797 None] Lock "cinder-quobyte-917e295f-7879-44f1-be88-59994a18112b" released by "delete_volume" :: held 0.959s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:03:54 devstack sudo[108052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07158b61-1934-4e95-a1f9-9d0d9f057009 Sep 25 12:03:54 devstack sudo[108052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:54 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-b6376f57-2752-44c7-809a-622c28117558 tempest-SnapshotDependencyTests-1212110797 None] Created reservations ['605312a9-966c-4cd4-a06c-66aa0d8670cc', '78aa622f-39d5-43b2-b4c5-6b9d48a3b357', '86311553-108d-428a-a938-913fbf8e9fb2', '8fb32ff5-c372-4192-a3cd-bdd8126160d2'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:03:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-b6376f57-2752-44c7-809a-622c28117558 tempest-SnapshotDependencyTests-1212110797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:03:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-b6376f57-2752-44c7-809a-622c28117558 tempest-SnapshotDependencyTests-1212110797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:03:54 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-b6376f57-2752-44c7-809a-622c28117558 tempest-SnapshotDependencyTests-1212110797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:03:54 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-b6376f57-2752-44c7-809a-622c28117558 tempest-SnapshotDependencyTests-1212110797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:03:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-b6376f57-2752-44c7-809a-622c28117558 tempest-SnapshotDependencyTests-1212110797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:03:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-b6376f57-2752-44c7-809a-622c28117558 tempest-SnapshotDependencyTests-1212110797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:54 devstack sudo[108054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 12:03:54 devstack sudo[108054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:54 devstack sudo[108052]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d0efb316-7635-486c-90f0-772712b707a8 tempest-ProjectMemberTests-1434405994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07158b61-1934-4e95-a1f9-9d0d9f057009" returned: 0 in 0.536s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d0efb316-7635-486c-90f0-772712b707a8 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07158b61-1934-4e95-a1f9-9d0d9f057009,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07158b61-1934-4e95-a1f9-9d0d9f057009.8e0ba3de-5ce1-4283-95d0-797852c26966 1G {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:54 devstack sudo[108060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07158b61-1934-4e95-a1f9-9d0d9f057009,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07158b61-1934-4e95-a1f9-9d0d9f057009.8e0ba3de-5ce1-4283-95d0-797852c26966 1G Sep 25 12:03:54 devstack sudo[108060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:54 devstack sudo[108054]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-b6376f57-2752-44c7-809a-622c28117558 tempest-SnapshotDependencyTests-1212110797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.318s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:54 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-b6376f57-2752-44c7-809a-622c28117558 tempest-SnapshotDependencyTests-1212110797 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:03:54 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-b6376f57-2752-44c7-809a-622c28117558 tempest-SnapshotDependencyTests-1212110797 None] Deleted volume successfully. Sep 25 12:03:54 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-b6376f57-2752-44c7-809a-622c28117558 tempest-SnapshotDependencyTests-1212110797 None] Lock "cinder-917e295f-7879-44f1-be88-59994a18112b-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:03:55 devstack sudo[108060]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d0efb316-7635-486c-90f0-772712b707a8 tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07158b61-1934-4e95-a1f9-9d0d9f057009,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07158b61-1934-4e95-a1f9-9d0d9f057009.8e0ba3de-5ce1-4283-95d0-797852c26966 1G" returned: 0 in 0.571s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d0efb316-7635-486c-90f0-772712b707a8 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07158b61-1934-4e95-a1f9-9d0d9f057009 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07158b61-1934-4e95-a1f9-9d0d9f057009.8e0ba3de-5ce1-4283-95d0-797852c26966 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:55 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-0311aec8-2176-4002-9c32-d0fadff30d04 tempest-CinderUnicodeTest-1542186967 None] Acquiring lock "cinder-062ca100-01e1-4110-860a-11fa1a854dd9-delete_snapshot" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:03:55 devstack sudo[108067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07158b61-1934-4e95-a1f9-9d0d9f057009 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07158b61-1934-4e95-a1f9-9d0d9f057009.8e0ba3de-5ce1-4283-95d0-797852c26966 Sep 25 12:03:55 devstack sudo[108067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:55 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-0311aec8-2176-4002-9c32-d0fadff30d04 tempest-CinderUnicodeTest-1542186967 None] Lock "cinder-062ca100-01e1-4110-860a-11fa1a854dd9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:03:55 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-0311aec8-2176-4002-9c32-d0fadff30d04 tempest-CinderUnicodeTest-1542186967 None] Acquiring lock "cinder-quobyte-fa511b7a-949a-4eef-928d-6016c97a3730" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:03:55 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-0311aec8-2176-4002-9c32-d0fadff30d04 tempest-CinderUnicodeTest-1542186967 None] Lock "cinder-quobyte-fa511b7a-949a-4eef-928d-6016c97a3730" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:03:55 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-0311aec8-2176-4002-9c32-d0fadff30d04 tempest-CinderUnicodeTest-1542186967 None] Acquiring lock "cinder-quobyte-062ca100-01e1-4110-860a-11fa1a854dd9" by "_delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:03:55 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-0311aec8-2176-4002-9c32-d0fadff30d04 tempest-CinderUnicodeTest-1542186967 None] Lock "cinder-quobyte-062ca100-01e1-4110-860a-11fa1a854dd9" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:03:55 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-0311aec8-2176-4002-9c32-d0fadff30d04 tempest-CinderUnicodeTest-1542186967 None] Deleting offline snapshot 062ca100-01e1-4110-860a-11fa1a854dd9 of volume fa511b7a-949a-4eef-928d-6016c97a3730 {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 12:03:55 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-0311aec8-2176-4002-9c32-d0fadff30d04 tempest-CinderUnicodeTest-1542186967 None] snapshot_file for this snap is: volume-fa511b7a-949a-4eef-928d-6016c97a3730.062ca100-01e1-4110-860a-11fa1a854dd9 {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 12:03:55 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d08bc2-38d7-4cee-92e4-382783dd973e]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:03:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-0311aec8-2176-4002-9c32-d0fadff30d04 tempest-CinderUnicodeTest-1542186967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fa511b7a-949a-4eef-928d-6016c97a3730.062ca100-01e1-4110-860a-11fa1a854dd9 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:55 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-4ce81558-2d4e-4ef8-8267-5549ff300aa7 tempest-SnapshotDependencyTests-1212110797 None] Acquiring lock "cinder-5ddbe814-9ac9-4c17-83a9-79075da92e5a-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:03:55 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-4ce81558-2d4e-4ef8-8267-5549ff300aa7 tempest-SnapshotDependencyTests-1212110797 None] Lock "cinder-5ddbe814-9ac9-4c17-83a9-79075da92e5a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:03:55 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-4ce81558-2d4e-4ef8-8267-5549ff300aa7 tempest-SnapshotDependencyTests-1212110797 None] Acquiring lock "cinder-quobyte-5ddbe814-9ac9-4c17-83a9-79075da92e5a" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:03:55 devstack sudo[108067]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:55 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-4ce81558-2d4e-4ef8-8267-5549ff300aa7 tempest-SnapshotDependencyTests-1212110797 None] Lock "cinder-quobyte-5ddbe814-9ac9-4c17-83a9-79075da92e5a" acquired by "delete_volume" :: waited 0.034s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:03:55 devstack sudo[108069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fa511b7a-949a-4eef-928d-6016c97a3730.062ca100-01e1-4110-860a-11fa1a854dd9 Sep 25 12:03:55 devstack sudo[108069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d0efb316-7635-486c-90f0-772712b707a8 tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07158b61-1934-4e95-a1f9-9d0d9f057009 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07158b61-1934-4e95-a1f9-9d0d9f057009.8e0ba3de-5ce1-4283-95d0-797852c26966" returned: 0 in 0.453s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:55 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-d0efb316-7635-486c-90f0-772712b707a8 tempest-ProjectMemberTests-1434405994 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07158b61-1934-4e95-a1f9-9d0d9f057009.8e0ba3de-5ce1-4283-95d0-797852c26966 is being set with open permissions: ugo+rw Sep 25 12:03:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d0efb316-7635-486c-90f0-772712b707a8 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07158b61-1934-4e95-a1f9-9d0d9f057009.8e0ba3de-5ce1-4283-95d0-797852c26966 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:55 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a79ebfb-df50-4f31-a5d8-20aff4d53350]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:03:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-4ce81558-2d4e-4ef8-8267-5549ff300aa7 tempest-SnapshotDependencyTests-1212110797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5ddbe814-9ac9-4c17-83a9-79075da92e5a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:55 devstack sudo[108076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07158b61-1934-4e95-a1f9-9d0d9f057009.8e0ba3de-5ce1-4283-95d0-797852c26966 Sep 25 12:03:55 devstack sudo[108076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:55 devstack sudo[108077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5ddbe814-9ac9-4c17-83a9-79075da92e5a Sep 25 12:03:55 devstack sudo[108077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:56 devstack sudo[108069]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:56 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-0311aec8-2176-4002-9c32-d0fadff30d04 tempest-CinderUnicodeTest-1542186967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fa511b7a-949a-4eef-928d-6016c97a3730.062ca100-01e1-4110-860a-11fa1a854dd9" returned: 0 in 0.621s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:56 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-0311aec8-2176-4002-9c32-d0fadff30d04 tempest-CinderUnicodeTest-1542186967 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa511b7a-949a-4eef-928d-6016c97a3730(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86984) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:03:56 devstack sudo[108076]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:56 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed5c2087-3595-4d85-824b-2228272ee9de]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:03:56 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-0311aec8-2176-4002-9c32-d0fadff30d04 tempest-CinderUnicodeTest-1542186967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fa511b7a-949a-4eef-928d-6016c97a3730 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:56 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d0efb316-7635-486c-90f0-772712b707a8 tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07158b61-1934-4e95-a1f9-9d0d9f057009.8e0ba3de-5ce1-4283-95d0-797852c26966" returned: 0 in 0.429s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:56 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d0efb316-7635-486c-90f0-772712b707a8 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07158b61-1934-4e95-a1f9-9d0d9f057009.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:56 devstack sudo[108090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07158b61-1934-4e95-a1f9-9d0d9f057009.info Sep 25 12:03:56 devstack sudo[108090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:56 devstack sudo[108077]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:56 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-4ce81558-2d4e-4ef8-8267-5549ff300aa7 tempest-SnapshotDependencyTests-1212110797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5ddbe814-9ac9-4c17-83a9-79075da92e5a" returned: 0 in 0.522s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:56 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-4ce81558-2d4e-4ef8-8267-5549ff300aa7 tempest-SnapshotDependencyTests-1212110797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5ddbe814-9ac9-4c17-83a9-79075da92e5a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:56 devstack sudo[108092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5ddbe814-9ac9-4c17-83a9-79075da92e5a Sep 25 12:03:56 devstack sudo[108092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:56 devstack sudo[108086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fa511b7a-949a-4eef-928d-6016c97a3730 Sep 25 12:03:56 devstack sudo[108086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:56 devstack sudo[108092]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:56 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-4ce81558-2d4e-4ef8-8267-5549ff300aa7 tempest-SnapshotDependencyTests-1212110797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-5ddbe814-9ac9-4c17-83a9-79075da92e5a" returned: 0 in 0.295s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:56 devstack sudo[108090]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:56 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d0efb316-7635-486c-90f0-772712b707a8 tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07158b61-1934-4e95-a1f9-9d0d9f057009.info" returned: 0 in 0.378s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:56 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-d0efb316-7635-486c-90f0-772712b707a8 tempest-ProjectMemberTests-1434405994 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07158b61-1934-4e95-a1f9-9d0d9f057009.info is being set with open permissions: ugo+rw Sep 25 12:03:56 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d0efb316-7635-486c-90f0-772712b707a8 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07158b61-1934-4e95-a1f9-9d0d9f057009.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:56 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-4ce81558-2d4e-4ef8-8267-5549ff300aa7 tempest-SnapshotDependencyTests-1212110797 None] Lock "cinder-quobyte-5ddbe814-9ac9-4c17-83a9-79075da92e5a" released by "delete_volume" :: held 0.901s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:03:56 devstack sudo[108099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07158b61-1934-4e95-a1f9-9d0d9f057009.info Sep 25 12:03:56 devstack sudo[108099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:56 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-4ce81558-2d4e-4ef8-8267-5549ff300aa7 tempest-SnapshotDependencyTests-1212110797 None] Created reservations ['d3da670d-c9cf-4ffa-8080-6d35a3599f62', '84dc821f-4d09-47a9-b2c3-be97f6f6588f', '920e0a17-44ef-42c0-bea8-8c58c35c5742', '6d5f4063-0225-496c-9ae5-96fd47c3abdf'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:03:56 devstack sudo[108086]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:56 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-0311aec8-2176-4002-9c32-d0fadff30d04 tempest-CinderUnicodeTest-1542186967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fa511b7a-949a-4eef-928d-6016c97a3730" returned: 0 in 0.601s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:56 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-0311aec8-2176-4002-9c32-d0fadff30d04 tempest-CinderUnicodeTest-1542186967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fa511b7a-949a-4eef-928d-6016c97a3730.062ca100-01e1-4110-860a-11fa1a854dd9 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:56 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-4ce81558-2d4e-4ef8-8267-5549ff300aa7 tempest-SnapshotDependencyTests-1212110797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:03:56 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-4ce81558-2d4e-4ef8-8267-5549ff300aa7 tempest-SnapshotDependencyTests-1212110797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:03:56 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-4ce81558-2d4e-4ef8-8267-5549ff300aa7 tempest-SnapshotDependencyTests-1212110797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:03:56 devstack sudo[108103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fa511b7a-949a-4eef-928d-6016c97a3730.062ca100-01e1-4110-860a-11fa1a854dd9 Sep 25 12:03:56 devstack sudo[108103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:56 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-4ce81558-2d4e-4ef8-8267-5549ff300aa7 tempest-SnapshotDependencyTests-1212110797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:03:56 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-4ce81558-2d4e-4ef8-8267-5549ff300aa7 tempest-SnapshotDependencyTests-1212110797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:03:56 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-4ce81558-2d4e-4ef8-8267-5549ff300aa7 tempest-SnapshotDependencyTests-1212110797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:56 devstack sudo[108105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 12:03:56 devstack sudo[108105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:57 devstack sudo[108099]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:57 devstack sudo[108105]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:57 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d0efb316-7635-486c-90f0-772712b707a8 tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07158b61-1934-4e95-a1f9-9d0d9f057009.info" returned: 0 in 0.521s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:57 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d0efb316-7635-486c-90f0-772712b707a8 tempest-ProjectMemberTests-1434405994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.065s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:03:57 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-4ce81558-2d4e-4ef8-8267-5549ff300aa7 tempest-SnapshotDependencyTests-1212110797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.364s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:57 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-4ce81558-2d4e-4ef8-8267-5549ff300aa7 tempest-SnapshotDependencyTests-1212110797 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:03:57 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-4ce81558-2d4e-4ef8-8267-5549ff300aa7 tempest-SnapshotDependencyTests-1212110797 None] Deleted volume successfully. Sep 25 12:03:57 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-d0efb316-7635-486c-90f0-772712b707a8 tempest-ProjectMemberTests-1434405994 None] Create snapshot completed successfully Sep 25 12:03:57 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-4ce81558-2d4e-4ef8-8267-5549ff300aa7 tempest-SnapshotDependencyTests-1212110797 None] Lock "cinder-5ddbe814-9ac9-4c17-83a9-79075da92e5a-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:03:57 devstack sudo[108103]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:57 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-0311aec8-2176-4002-9c32-d0fadff30d04 tempest-CinderUnicodeTest-1542186967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fa511b7a-949a-4eef-928d-6016c97a3730.062ca100-01e1-4110-860a-11fa1a854dd9" returned: 0 in 0.609s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:57 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-0311aec8-2176-4002-9c32-d0fadff30d04 tempest-CinderUnicodeTest-1542186967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fa511b7a-949a-4eef-928d-6016c97a3730.062ca100-01e1-4110-860a-11fa1a854dd9 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:57 devstack sudo[108112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fa511b7a-949a-4eef-928d-6016c97a3730.062ca100-01e1-4110-860a-11fa1a854dd9 Sep 25 12:03:57 devstack sudo[108112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:57 devstack sudo[108112]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:57 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-0311aec8-2176-4002-9c32-d0fadff30d04 tempest-CinderUnicodeTest-1542186967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fa511b7a-949a-4eef-928d-6016c97a3730.062ca100-01e1-4110-860a-11fa1a854dd9" returned: 0 in 0.343s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:57 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-0311aec8-2176-4002-9c32-d0fadff30d04 tempest-CinderUnicodeTest-1542186967 None] Lock "cinder-quobyte-062ca100-01e1-4110-860a-11fa1a854dd9" released by "_delete_snapshot" :: held 2.373s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:03:57 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-0311aec8-2176-4002-9c32-d0fadff30d04 tempest-CinderUnicodeTest-1542186967 None] Lock "cinder-quobyte-fa511b7a-949a-4eef-928d-6016c97a3730" released by "delete_snapshot" :: held 2.411s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:03:57 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-0311aec8-2176-4002-9c32-d0fadff30d04 tempest-CinderUnicodeTest-1542186967 None] Created reservations ['26b01226-7cb6-4625-8c11-d6d9836b050a', 'accc5ec3-eb69-437f-b908-13f3055cfbb5', 'ab787a89-a8ca-48cd-b43d-004db25417dc', '70bab67a-f803-4822-aa2a-b14001ce4ca3'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:03:57 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-0311aec8-2176-4002-9c32-d0fadff30d04 tempest-CinderUnicodeTest-1542186967 None] Delete snapshot completed successfully. Sep 25 12:03:57 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-0311aec8-2176-4002-9c32-d0fadff30d04 tempest-CinderUnicodeTest-1542186967 None] Lock "cinder-062ca100-01e1-4110-860a-11fa1a854dd9-delete_snapshot" released by "delete_snapshot" :: held 2.665s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:03:58 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ffc7a014-1019-461c-9e54-7cc3b66a8376 tempest-ProjectMemberTests-1434405994 None] Acquiring lock "cinder-8e0ba3de-5ce1-4283-95d0-797852c26966-delete_snapshot" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:03:58 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ffc7a014-1019-461c-9e54-7cc3b66a8376 tempest-ProjectMemberTests-1434405994 None] Lock "cinder-8e0ba3de-5ce1-4283-95d0-797852c26966-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:03:58 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ffc7a014-1019-461c-9e54-7cc3b66a8376 tempest-ProjectMemberTests-1434405994 None] Acquiring lock "cinder-quobyte-07158b61-1934-4e95-a1f9-9d0d9f057009" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:03:58 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ffc7a014-1019-461c-9e54-7cc3b66a8376 tempest-ProjectMemberTests-1434405994 None] Lock "cinder-quobyte-07158b61-1934-4e95-a1f9-9d0d9f057009" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:03:58 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ffc7a014-1019-461c-9e54-7cc3b66a8376 tempest-ProjectMemberTests-1434405994 None] Acquiring lock "cinder-quobyte-8e0ba3de-5ce1-4283-95d0-797852c26966" by "_delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:03:58 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ffc7a014-1019-461c-9e54-7cc3b66a8376 tempest-ProjectMemberTests-1434405994 None] Lock "cinder-quobyte-8e0ba3de-5ce1-4283-95d0-797852c26966" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:03:58 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-ffc7a014-1019-461c-9e54-7cc3b66a8376 tempest-ProjectMemberTests-1434405994 None] Deleting offline snapshot 8e0ba3de-5ce1-4283-95d0-797852c26966 of volume 07158b61-1934-4e95-a1f9-9d0d9f057009 {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 12:03:58 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-ffc7a014-1019-461c-9e54-7cc3b66a8376 tempest-ProjectMemberTests-1434405994 None] snapshot_file for this snap is: volume-07158b61-1934-4e95-a1f9-9d0d9f057009.8e0ba3de-5ce1-4283-95d0-797852c26966 {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 12:03:58 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be43aa7-96fd-4310-b133-dc373a67cf83]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:03:58 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ffc7a014-1019-461c-9e54-7cc3b66a8376 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07158b61-1934-4e95-a1f9-9d0d9f057009.8e0ba3de-5ce1-4283-95d0-797852c26966 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:58 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-eec61af3-024b-4ae5-984c-f477d88ff521 tempest-CinderUnicodeTest-1542186967 None] Acquiring lock "cinder-fa511b7a-949a-4eef-928d-6016c97a3730-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:03:58 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-eec61af3-024b-4ae5-984c-f477d88ff521 tempest-CinderUnicodeTest-1542186967 None] Lock "cinder-fa511b7a-949a-4eef-928d-6016c97a3730-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:03:58 devstack sudo[108129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07158b61-1934-4e95-a1f9-9d0d9f057009.8e0ba3de-5ce1-4283-95d0-797852c26966 Sep 25 12:03:58 devstack sudo[108129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:58 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-eec61af3-024b-4ae5-984c-f477d88ff521 tempest-CinderUnicodeTest-1542186967 None] Acquiring lock "cinder-quobyte-fa511b7a-949a-4eef-928d-6016c97a3730" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:03:58 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-eec61af3-024b-4ae5-984c-f477d88ff521 tempest-CinderUnicodeTest-1542186967 None] Lock "cinder-quobyte-fa511b7a-949a-4eef-928d-6016c97a3730" acquired by "delete_volume" :: waited 0.027s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:03:58 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a8b446-b467-4f39-af43-2079b32cf7e9]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:03:58 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-eec61af3-024b-4ae5-984c-f477d88ff521 tempest-CinderUnicodeTest-1542186967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fa511b7a-949a-4eef-928d-6016c97a3730 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:59 devstack sudo[108151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fa511b7a-949a-4eef-928d-6016c97a3730 Sep 25 12:03:59 devstack sudo[108151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:59 devstack sudo[108129]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:59 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ffc7a014-1019-461c-9e54-7cc3b66a8376 tempest-ProjectMemberTests-1434405994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07158b61-1934-4e95-a1f9-9d0d9f057009.8e0ba3de-5ce1-4283-95d0-797852c26966" returned: 0 in 0.784s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:59 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-ffc7a014-1019-461c-9e54-7cc3b66a8376 tempest-ProjectMemberTests-1434405994 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-07158b61-1934-4e95-a1f9-9d0d9f057009(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86984) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:03:59 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3717f48-f9be-4e1d-be55-512d08955c3b]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:03:59 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ffc7a014-1019-461c-9e54-7cc3b66a8376 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07158b61-1934-4e95-a1f9-9d0d9f057009 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:59 devstack sudo[108151]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:59 devstack sudo[108158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07158b61-1934-4e95-a1f9-9d0d9f057009 Sep 25 12:03:59 devstack sudo[108158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:59 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-eec61af3-024b-4ae5-984c-f477d88ff521 tempest-CinderUnicodeTest-1542186967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fa511b7a-949a-4eef-928d-6016c97a3730" returned: 0 in 0.612s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:59 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-eec61af3-024b-4ae5-984c-f477d88ff521 tempest-CinderUnicodeTest-1542186967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fa511b7a-949a-4eef-928d-6016c97a3730 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:59 devstack sudo[108163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fa511b7a-949a-4eef-928d-6016c97a3730 Sep 25 12:03:59 devstack sudo[108163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:59 devstack sudo[108163]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:59 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-eec61af3-024b-4ae5-984c-f477d88ff521 tempest-CinderUnicodeTest-1542186967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-fa511b7a-949a-4eef-928d-6016c97a3730" returned: 0 in 0.374s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:59 devstack sudo[108158]: pam_unix(sudo:session): session closed for user root Sep 25 12:03:59 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ffc7a014-1019-461c-9e54-7cc3b66a8376 tempest-ProjectMemberTests-1434405994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07158b61-1934-4e95-a1f9-9d0d9f057009" returned: 0 in 0.584s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:03:59 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ffc7a014-1019-461c-9e54-7cc3b66a8376 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07158b61-1934-4e95-a1f9-9d0d9f057009.8e0ba3de-5ce1-4283-95d0-797852c26966 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:03:59 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-eec61af3-024b-4ae5-984c-f477d88ff521 tempest-CinderUnicodeTest-1542186967 None] Lock "cinder-quobyte-fa511b7a-949a-4eef-928d-6016c97a3730" released by "delete_volume" :: held 1.165s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:03:59 devstack sudo[108171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07158b61-1934-4e95-a1f9-9d0d9f057009.8e0ba3de-5ce1-4283-95d0-797852c26966 Sep 25 12:03:59 devstack sudo[108171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:03:59 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-eec61af3-024b-4ae5-984c-f477d88ff521 tempest-CinderUnicodeTest-1542186967 None] Created reservations ['f1836aa4-da47-4dc9-a8b1-98f7d9716f9a', '9148b71a-0377-4019-9062-237033f706ca', '17f68ac8-2c5e-42f9-a9a4-dfce936672b7', '168952d6-867f-4022-a761-dfa475fced4d'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:04:00 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-eec61af3-024b-4ae5-984c-f477d88ff521 tempest-CinderUnicodeTest-1542186967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:04:00 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-eec61af3-024b-4ae5-984c-f477d88ff521 tempest-CinderUnicodeTest-1542186967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:04:00 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-eec61af3-024b-4ae5-984c-f477d88ff521 tempest-CinderUnicodeTest-1542186967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:04:00 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-eec61af3-024b-4ae5-984c-f477d88ff521 tempest-CinderUnicodeTest-1542186967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:04:00 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-eec61af3-024b-4ae5-984c-f477d88ff521 tempest-CinderUnicodeTest-1542186967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:04:00 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-eec61af3-024b-4ae5-984c-f477d88ff521 tempest-CinderUnicodeTest-1542186967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:00 devstack sudo[108173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 12:04:00 devstack sudo[108173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:00 devstack sudo[108171]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:00 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ffc7a014-1019-461c-9e54-7cc3b66a8376 tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07158b61-1934-4e95-a1f9-9d0d9f057009.8e0ba3de-5ce1-4283-95d0-797852c26966" returned: 0 in 0.552s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:00 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ffc7a014-1019-461c-9e54-7cc3b66a8376 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07158b61-1934-4e95-a1f9-9d0d9f057009.8e0ba3de-5ce1-4283-95d0-797852c26966 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:00 devstack sudo[108173]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:00 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-eec61af3-024b-4ae5-984c-f477d88ff521 tempest-CinderUnicodeTest-1542186967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.370s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:00 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-eec61af3-024b-4ae5-984c-f477d88ff521 tempest-CinderUnicodeTest-1542186967 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:04:00 devstack sudo[108180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07158b61-1934-4e95-a1f9-9d0d9f057009.8e0ba3de-5ce1-4283-95d0-797852c26966 Sep 25 12:04:00 devstack sudo[108180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:00 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-eec61af3-024b-4ae5-984c-f477d88ff521 tempest-CinderUnicodeTest-1542186967 None] Deleted volume successfully. Sep 25 12:04:00 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-eec61af3-024b-4ae5-984c-f477d88ff521 tempest-CinderUnicodeTest-1542186967 None] Lock "cinder-fa511b7a-949a-4eef-928d-6016c97a3730-delete_volume" released by "delete_volume" :: held 1.861s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:04:00 devstack sudo[108180]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:00 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ffc7a014-1019-461c-9e54-7cc3b66a8376 tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07158b61-1934-4e95-a1f9-9d0d9f057009.8e0ba3de-5ce1-4283-95d0-797852c26966" returned: 0 in 0.306s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:00 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ffc7a014-1019-461c-9e54-7cc3b66a8376 tempest-ProjectMemberTests-1434405994 None] Lock "cinder-quobyte-8e0ba3de-5ce1-4283-95d0-797852c26966" released by "_delete_snapshot" :: held 2.417s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:04:00 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ffc7a014-1019-461c-9e54-7cc3b66a8376 tempest-ProjectMemberTests-1434405994 None] Lock "cinder-quobyte-07158b61-1934-4e95-a1f9-9d0d9f057009" released by "delete_snapshot" :: held 2.453s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:04:00 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-ffc7a014-1019-461c-9e54-7cc3b66a8376 tempest-ProjectMemberTests-1434405994 None] Created reservations ['ebe61b3e-06ae-4425-a087-6e36377c02dd', '87a0e10d-8bd4-4442-8b81-1450a4cf5da7', 'dbd56494-5cd3-4f01-9c12-8f7b271ff387', '3c36efe7-b324-4fd5-ba01-9ac410e337c7'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:04:00 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-ffc7a014-1019-461c-9e54-7cc3b66a8376 tempest-ProjectMemberTests-1434405994 None] Delete snapshot completed successfully. Sep 25 12:04:00 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ffc7a014-1019-461c-9e54-7cc3b66a8376 tempest-ProjectMemberTests-1434405994 None] Lock "cinder-8e0ba3de-5ce1-4283-95d0-797852c26966-delete_snapshot" released by "delete_snapshot" :: held 2.678s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:04:01 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-a022f259-ddc0-4a5b-8c66-31e56d6767b1 tempest-CinderUnicodeTest-1542186967 None] Acquiring lock "cinder-df81102f-3178-47b9-9ae3-60b57d7dd3ce-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:04:01 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-a022f259-ddc0-4a5b-8c66-31e56d6767b1 tempest-CinderUnicodeTest-1542186967 None] Lock "cinder-df81102f-3178-47b9-9ae3-60b57d7dd3ce-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:04:01 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-a022f259-ddc0-4a5b-8c66-31e56d6767b1 tempest-CinderUnicodeTest-1542186967 None] Acquiring lock "cinder-quobyte-df81102f-3178-47b9-9ae3-60b57d7dd3ce" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:04:01 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-a022f259-ddc0-4a5b-8c66-31e56d6767b1 tempest-CinderUnicodeTest-1542186967 None] Lock "cinder-quobyte-df81102f-3178-47b9-9ae3-60b57d7dd3ce" acquired by "delete_volume" :: waited 0.020s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:04:01 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[76678776-5358-47cd-9636-30a1767ce93a]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:04:01 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a022f259-ddc0-4a5b-8c66-31e56d6767b1 tempest-CinderUnicodeTest-1542186967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-df81102f-3178-47b9-9ae3-60b57d7dd3ce {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:01 devstack sudo[108183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-df81102f-3178-47b9-9ae3-60b57d7dd3ce Sep 25 12:04:01 devstack sudo[108183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:01 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-2752b1b6-d480-4548-9d27-bd4b52f1fa5b tempest-ProjectMemberTests-1434405994 None] Acquiring lock "cinder-07158b61-1934-4e95-a1f9-9d0d9f057009-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:04:01 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-2752b1b6-d480-4548-9d27-bd4b52f1fa5b tempest-ProjectMemberTests-1434405994 None] Lock "cinder-07158b61-1934-4e95-a1f9-9d0d9f057009-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:04:01 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-2752b1b6-d480-4548-9d27-bd4b52f1fa5b tempest-ProjectMemberTests-1434405994 None] Acquiring lock "cinder-quobyte-07158b61-1934-4e95-a1f9-9d0d9f057009" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:04:01 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-2752b1b6-d480-4548-9d27-bd4b52f1fa5b tempest-ProjectMemberTests-1434405994 None] Lock "cinder-quobyte-07158b61-1934-4e95-a1f9-9d0d9f057009" acquired by "delete_volume" :: waited 0.019s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:04:01 devstack sudo[108183]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:01 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a022f259-ddc0-4a5b-8c66-31e56d6767b1 tempest-CinderUnicodeTest-1542186967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-df81102f-3178-47b9-9ae3-60b57d7dd3ce" returned: 0 in 0.480s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:01 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a022f259-ddc0-4a5b-8c66-31e56d6767b1 tempest-CinderUnicodeTest-1542186967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-df81102f-3178-47b9-9ae3-60b57d7dd3ce {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:01 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[7990252e-b2ef-4cf8-adb4-f2ea35585302]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:04:01 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2752b1b6-d480-4548-9d27-bd4b52f1fa5b tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07158b61-1934-4e95-a1f9-9d0d9f057009 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:01 devstack sudo[108188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-df81102f-3178-47b9-9ae3-60b57d7dd3ce Sep 25 12:04:01 devstack sudo[108188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:01 devstack sudo[108189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07158b61-1934-4e95-a1f9-9d0d9f057009 Sep 25 12:04:01 devstack sudo[108189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:01 devstack sudo[108188]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:01 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a022f259-ddc0-4a5b-8c66-31e56d6767b1 tempest-CinderUnicodeTest-1542186967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-df81102f-3178-47b9-9ae3-60b57d7dd3ce" returned: 0 in 0.319s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:02 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-a022f259-ddc0-4a5b-8c66-31e56d6767b1 tempest-CinderUnicodeTest-1542186967 None] Lock "cinder-quobyte-df81102f-3178-47b9-9ae3-60b57d7dd3ce" released by "delete_volume" :: held 0.899s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:04:02 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-a022f259-ddc0-4a5b-8c66-31e56d6767b1 tempest-CinderUnicodeTest-1542186967 None] Created reservations ['a6d33faa-8c12-4f75-9f18-7aea1d26155b', '2c1cd784-5ae1-4e23-ba60-f42ccff08ff9', 'be6ca017-db2b-4a7e-a390-997d2ddb8ccf', '5713e432-82d3-44a2-97cb-b0ee8573b469'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:04:02 devstack sudo[108189]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:02 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2752b1b6-d480-4548-9d27-bd4b52f1fa5b tempest-ProjectMemberTests-1434405994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07158b61-1934-4e95-a1f9-9d0d9f057009" returned: 0 in 0.449s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:02 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2752b1b6-d480-4548-9d27-bd4b52f1fa5b tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07158b61-1934-4e95-a1f9-9d0d9f057009 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:02 devstack sudo[108197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07158b61-1934-4e95-a1f9-9d0d9f057009 Sep 25 12:04:02 devstack sudo[108197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:02 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-a022f259-ddc0-4a5b-8c66-31e56d6767b1 tempest-CinderUnicodeTest-1542186967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:04:02 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-a022f259-ddc0-4a5b-8c66-31e56d6767b1 tempest-CinderUnicodeTest-1542186967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:04:02 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-a022f259-ddc0-4a5b-8c66-31e56d6767b1 tempest-CinderUnicodeTest-1542186967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:04:02 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-a022f259-ddc0-4a5b-8c66-31e56d6767b1 tempest-CinderUnicodeTest-1542186967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:04:02 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-a022f259-ddc0-4a5b-8c66-31e56d6767b1 tempest-CinderUnicodeTest-1542186967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:04:02 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a022f259-ddc0-4a5b-8c66-31e56d6767b1 tempest-CinderUnicodeTest-1542186967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:02 devstack sudo[108199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 12:04:02 devstack sudo[108199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:02 devstack sudo[108199]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:02 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a022f259-ddc0-4a5b-8c66-31e56d6767b1 tempest-CinderUnicodeTest-1542186967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.454s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:02 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-a022f259-ddc0-4a5b-8c66-31e56d6767b1 tempest-CinderUnicodeTest-1542186967 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:04:02 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-a022f259-ddc0-4a5b-8c66-31e56d6767b1 tempest-CinderUnicodeTest-1542186967 None] Deleted volume successfully. Sep 25 12:04:02 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-a022f259-ddc0-4a5b-8c66-31e56d6767b1 tempest-CinderUnicodeTest-1542186967 None] Lock "cinder-df81102f-3178-47b9-9ae3-60b57d7dd3ce-delete_volume" released by "delete_volume" :: held 1.732s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:04:02 devstack sudo[108197]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:02 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2752b1b6-d480-4548-9d27-bd4b52f1fa5b tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07158b61-1934-4e95-a1f9-9d0d9f057009" returned: 0 in 0.728s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:02 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-2752b1b6-d480-4548-9d27-bd4b52f1fa5b tempest-ProjectMemberTests-1434405994 None] Lock "cinder-quobyte-07158b61-1934-4e95-a1f9-9d0d9f057009" released by "delete_volume" :: held 1.292s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:04:02 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ad665a6-30bb-4b1c-973b-199f9451beb8 tempest-ProjectReaderTests-916980377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:04:02 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3ad665a6-30bb-4b1c-973b-199f9451beb8 tempest-ProjectReaderTests-916980377 None] Flow 'volume_create_manager' (e80f23ef-b6e7-437e-b91d-c7853a778dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:04:02 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3ad665a6-30bb-4b1c-973b-199f9451beb8 tempest-ProjectReaderTests-916980377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58e47538-f1e1-4f6f-88fb-ed1cf0c886f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:04:02 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3ad665a6-30bb-4b1c-973b-199f9451beb8 tempest-ProjectReaderTests-916980377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58e47538-f1e1-4f6f-88fb-ed1cf0c886f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:04:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1108080701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b84cb61-fcfc-4c54-87f1-02671ec0f538,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c665fd078654a5ca51a715d7405fe8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:04:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:04:03Z,use_quota=True,user_id='62e4ebbd017b43a7bdf4fcc690c52509',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:04:02 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3ad665a6-30bb-4b1c-973b-199f9451beb8 tempest-ProjectReaderTests-916980377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (399fbfcd-e7d3-4faa-89d5-edb1cab5c675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:04:02 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3ad665a6-30bb-4b1c-973b-199f9451beb8 tempest-ProjectReaderTests-916980377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (399fbfcd-e7d3-4faa-89d5-edb1cab5c675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:04:02 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3ad665a6-30bb-4b1c-973b-199f9451beb8 tempest-ProjectReaderTests-916980377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8a96528-bf9b-4242-8cf4-372bac0be756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:04:02 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3ad665a6-30bb-4b1c-973b-199f9451beb8 tempest-ProjectReaderTests-916980377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8a96528-bf9b-4242-8cf4-372bac0be756) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b84cb61-fcfc-4c54-87f1-02671ec0f538', 'volume_name': 'volume-7b84cb61-fcfc-4c54-87f1-02671ec0f538', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:04:02 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3ad665a6-30bb-4b1c-973b-199f9451beb8 tempest-ProjectReaderTests-916980377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (178eae2c-4fd2-4e22-8dab-e00d69175e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:04:03 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3ad665a6-30bb-4b1c-973b-199f9451beb8 tempest-ProjectReaderTests-916980377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (178eae2c-4fd2-4e22-8dab-e00d69175e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:04:03 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3ad665a6-30bb-4b1c-973b-199f9451beb8 tempest-ProjectReaderTests-916980377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7ea325c-1023-4a57-8bb3-bcef20c35dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:04:03 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-3ad665a6-30bb-4b1c-973b-199f9451beb8 tempest-ProjectReaderTests-916980377 None] Volume 7b84cb61-fcfc-4c54-87f1-02671ec0f538: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b84cb61-fcfc-4c54-87f1-02671ec0f538', 'volume_size': 1} Sep 25 12:04:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3ad665a6-30bb-4b1c-973b-199f9451beb8 tempest-ProjectReaderTests-916980377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:04:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3ad665a6-30bb-4b1c-973b-199f9451beb8 tempest-ProjectReaderTests-916980377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:04:03 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3ad665a6-30bb-4b1c-973b-199f9451beb8 tempest-ProjectReaderTests-916980377 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:04:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1108080701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b84cb61-fcfc-4c54-87f1-02671ec0f538,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c665fd078654a5ca51a715d7405fe8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:04:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:04:03Z,use_quota=True,user_id='62e4ebbd017b43a7bdf4fcc690c52509',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:04:03 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-3ad665a6-30bb-4b1c-973b-199f9451beb8 tempest-ProjectReaderTests-916980377 None] Creating volume 7b84cb61-fcfc-4c54-87f1-02671ec0f538 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:04:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3ad665a6-30bb-4b1c-973b-199f9451beb8 tempest-ProjectReaderTests-916980377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:04:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3ad665a6-30bb-4b1c-973b-199f9451beb8 tempest-ProjectReaderTests-916980377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:04:03 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3ad665a6-30bb-4b1c-973b-199f9451beb8 tempest-ProjectReaderTests-916980377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:04:03 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3ad665a6-30bb-4b1c-973b-199f9451beb8 tempest-ProjectReaderTests-916980377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:04:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3ad665a6-30bb-4b1c-973b-199f9451beb8 tempest-ProjectReaderTests-916980377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:04:03 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3ad665a6-30bb-4b1c-973b-199f9451beb8 tempest-ProjectReaderTests-916980377 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:04:03 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-3ad665a6-30bb-4b1c-973b-199f9451beb8 tempest-ProjectReaderTests-916980377 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 12:04:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3ad665a6-30bb-4b1c-973b-199f9451beb8 tempest-ProjectReaderTests-916980377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7b84cb61-fcfc-4c54-87f1-02671ec0f538 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:03 devstack sudo[108203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7b84cb61-fcfc-4c54-87f1-02671ec0f538 1073741824 Sep 25 12:04:03 devstack sudo[108203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:03 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-2752b1b6-d480-4548-9d27-bd4b52f1fa5b tempest-ProjectMemberTests-1434405994 None] Created reservations ['11a770a4-5b6c-4edd-9c70-43015c932855', '639dd75c-cab5-403a-845a-115df9b2beeb', '719d63f6-829a-4bdd-9a42-6dbae8c69267', 'c1c4019b-457e-4a19-b154-ae6010ce7bc0'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:04:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-2752b1b6-d480-4548-9d27-bd4b52f1fa5b tempest-ProjectMemberTests-1434405994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:04:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-2752b1b6-d480-4548-9d27-bd4b52f1fa5b tempest-ProjectMemberTests-1434405994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:04:03 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-2752b1b6-d480-4548-9d27-bd4b52f1fa5b tempest-ProjectMemberTests-1434405994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:04:03 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-2752b1b6-d480-4548-9d27-bd4b52f1fa5b tempest-ProjectMemberTests-1434405994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:04:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-2752b1b6-d480-4548-9d27-bd4b52f1fa5b tempest-ProjectMemberTests-1434405994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:04:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2752b1b6-d480-4548-9d27-bd4b52f1fa5b tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:03 devstack sudo[108205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 12:04:03 devstack sudo[108205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:03 devstack sudo[108205]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-2752b1b6-d480-4548-9d27-bd4b52f1fa5b tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.399s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:03 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-2752b1b6-d480-4548-9d27-bd4b52f1fa5b tempest-ProjectMemberTests-1434405994 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:04:03 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-2752b1b6-d480-4548-9d27-bd4b52f1fa5b tempest-ProjectMemberTests-1434405994 None] Deleted volume successfully. Sep 25 12:04:03 devstack sudo[108203]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3ad665a6-30bb-4b1c-973b-199f9451beb8 tempest-ProjectReaderTests-916980377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7b84cb61-fcfc-4c54-87f1-02671ec0f538 1073741824" returned: 0 in 0.677s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:03 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-2752b1b6-d480-4548-9d27-bd4b52f1fa5b tempest-ProjectMemberTests-1434405994 None] Lock "cinder-07158b61-1934-4e95-a1f9-9d0d9f057009-delete_volume" released by "delete_volume" :: held 2.222s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:04:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3ad665a6-30bb-4b1c-973b-199f9451beb8 tempest-ProjectReaderTests-916980377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7b84cb61-fcfc-4c54-87f1-02671ec0f538 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:03 devstack sudo[108212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7b84cb61-fcfc-4c54-87f1-02671ec0f538 Sep 25 12:04:03 devstack sudo[108212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:04 devstack sudo[108212]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:04 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3ad665a6-30bb-4b1c-973b-199f9451beb8 tempest-ProjectReaderTests-916980377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7b84cb61-fcfc-4c54-87f1-02671ec0f538" returned: 0 in 0.369s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:04 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3ad665a6-30bb-4b1c-973b-199f9451beb8 tempest-ProjectReaderTests-916980377 None] <== create_volume: return (1162ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:04:04 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3ad665a6-30bb-4b1c-973b-199f9451beb8 tempest-ProjectReaderTests-916980377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.165s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:04:04 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3ad665a6-30bb-4b1c-973b-199f9451beb8 tempest-ProjectReaderTests-916980377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7ea325c-1023-4a57-8bb3-bcef20c35dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b84cb61-fcfc-4c54-87f1-02671ec0f538', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:04:04 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3ad665a6-30bb-4b1c-973b-199f9451beb8 tempest-ProjectReaderTests-916980377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf62c795-55bb-41b3-97ab-b80488302088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:04:04 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-3ad665a6-30bb-4b1c-973b-199f9451beb8 tempest-ProjectReaderTests-916980377 None] Volume volume-7b84cb61-fcfc-4c54-87f1-02671ec0f538 (7b84cb61-fcfc-4c54-87f1-02671ec0f538): created successfully Sep 25 12:04:04 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3ad665a6-30bb-4b1c-973b-199f9451beb8 tempest-ProjectReaderTests-916980377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf62c795-55bb-41b3-97ab-b80488302088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:04:04 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3ad665a6-30bb-4b1c-973b-199f9451beb8 tempest-ProjectReaderTests-916980377 None] Flow 'volume_create_manager' (e80f23ef-b6e7-437e-b91d-c7853a778dee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:04:04 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-3ad665a6-30bb-4b1c-973b-199f9451beb8 tempest-ProjectReaderTests-916980377 None] Created volume successfully. Sep 25 12:04:04 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-81efacef-b3d2-4676-bdc0-425455858e09 tempest-ProjectMemberTests-1434405994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:04:04 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-81efacef-b3d2-4676-bdc0-425455858e09 tempest-ProjectMemberTests-1434405994 None] Flow 'volume_create_manager' (f2d1d531-67f6-4bcc-8009-cbce44ea9935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:04:04 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-81efacef-b3d2-4676-bdc0-425455858e09 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c21aba33-32ae-4f31-8c43-fcee055ab4f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:04:04 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-81efacef-b3d2-4676-bdc0-425455858e09 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c21aba33-32ae-4f31-8c43-fcee055ab4f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:04:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1501737577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9959072e-3d3a-464e-bf73-1aab35aca004,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c75afeac65f84f13b7d0325fa4b21b65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:04:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:04:05Z,use_quota=True,user_id='770f7e0a81074bae8bcd048c8d7f7347',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:04:04 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-81efacef-b3d2-4676-bdc0-425455858e09 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efcee159-35a4-4cf2-a188-69cade969b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:04:04 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-81efacef-b3d2-4676-bdc0-425455858e09 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efcee159-35a4-4cf2-a188-69cade969b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:04:04 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-81efacef-b3d2-4676-bdc0-425455858e09 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e455581-1b68-46eb-955a-20607e82cde4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:04:04 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-81efacef-b3d2-4676-bdc0-425455858e09 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e455581-1b68-46eb-955a-20607e82cde4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9959072e-3d3a-464e-bf73-1aab35aca004', 'volume_name': 'volume-9959072e-3d3a-464e-bf73-1aab35aca004', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:04:04 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-81efacef-b3d2-4676-bdc0-425455858e09 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1f42107-10fd-46f2-ba6b-aedd2f56a75a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:04:04 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-81efacef-b3d2-4676-bdc0-425455858e09 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1f42107-10fd-46f2-ba6b-aedd2f56a75a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:04:04 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-81efacef-b3d2-4676-bdc0-425455858e09 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ad2f4df-181b-4e0f-849f-60b6eba4086a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:04:04 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-81efacef-b3d2-4676-bdc0-425455858e09 tempest-ProjectMemberTests-1434405994 None] Volume 9959072e-3d3a-464e-bf73-1aab35aca004: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9959072e-3d3a-464e-bf73-1aab35aca004', 'volume_size': 1} Sep 25 12:04:04 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-81efacef-b3d2-4676-bdc0-425455858e09 tempest-ProjectMemberTests-1434405994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:04:04 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-81efacef-b3d2-4676-bdc0-425455858e09 tempest-ProjectMemberTests-1434405994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:04:04 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-81efacef-b3d2-4676-bdc0-425455858e09 tempest-ProjectMemberTests-1434405994 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:04:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1501737577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9959072e-3d3a-464e-bf73-1aab35aca004,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c75afeac65f84f13b7d0325fa4b21b65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:04:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:04:05Z,use_quota=True,user_id='770f7e0a81074bae8bcd048c8d7f7347',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:04:04 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-81efacef-b3d2-4676-bdc0-425455858e09 tempest-ProjectMemberTests-1434405994 None] Creating volume 9959072e-3d3a-464e-bf73-1aab35aca004 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:04:04 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-81efacef-b3d2-4676-bdc0-425455858e09 tempest-ProjectMemberTests-1434405994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:04:04 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-81efacef-b3d2-4676-bdc0-425455858e09 tempest-ProjectMemberTests-1434405994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:04:04 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-81efacef-b3d2-4676-bdc0-425455858e09 tempest-ProjectMemberTests-1434405994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:04:04 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-81efacef-b3d2-4676-bdc0-425455858e09 tempest-ProjectMemberTests-1434405994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:04:04 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-81efacef-b3d2-4676-bdc0-425455858e09 tempest-ProjectMemberTests-1434405994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:04:04 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-81efacef-b3d2-4676-bdc0-425455858e09 tempest-ProjectMemberTests-1434405994 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:04:04 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-81efacef-b3d2-4676-bdc0-425455858e09 tempest-ProjectMemberTests-1434405994 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 12:04:04 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-81efacef-b3d2-4676-bdc0-425455858e09 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9959072e-3d3a-464e-bf73-1aab35aca004 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:04 devstack sudo[108217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9959072e-3d3a-464e-bf73-1aab35aca004 1073741824 Sep 25 12:04:04 devstack sudo[108217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-540d82df-1a4e-43b0-a629-cdc3d45ce5a0 tempest-ProjectReaderTests-916980377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:04:05 devstack sudo[108217]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-81efacef-b3d2-4676-bdc0-425455858e09 tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9959072e-3d3a-464e-bf73-1aab35aca004 1073741824" returned: 0 in 0.723s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-81efacef-b3d2-4676-bdc0-425455858e09 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9959072e-3d3a-464e-bf73-1aab35aca004 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:05 devstack sudo[108224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9959072e-3d3a-464e-bf73-1aab35aca004 Sep 25 12:04:05 devstack sudo[108224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:05 devstack sudo[108224]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-81efacef-b3d2-4676-bdc0-425455858e09 tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9959072e-3d3a-464e-bf73-1aab35aca004" returned: 0 in 0.369s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:05 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-81efacef-b3d2-4676-bdc0-425455858e09 tempest-ProjectMemberTests-1434405994 None] <== create_volume: return (1164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:04:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-81efacef-b3d2-4676-bdc0-425455858e09 tempest-ProjectMemberTests-1434405994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.168s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:04:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-540d82df-1a4e-43b0-a629-cdc3d45ce5a0 tempest-ProjectReaderTests-916980377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.592s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:04:05 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-540d82df-1a4e-43b0-a629-cdc3d45ce5a0 tempest-ProjectReaderTests-916980377 None] Creating offline snapshot ea55c7e9-b0a2-411a-9441-75559148f223 of volume 7b84cb61-fcfc-4c54-87f1-02671ec0f538 {{(pid=86984) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 12:04:05 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-81efacef-b3d2-4676-bdc0-425455858e09 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ad2f4df-181b-4e0f-849f-60b6eba4086a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9959072e-3d3a-464e-bf73-1aab35aca004', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:04:05 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-81efacef-b3d2-4676-bdc0-425455858e09 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a7ad7b8-cab8-447e-b486-813b149afc9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:04:05 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[364d1423-8672-45f7-b4d5-6a7ed13f37d3]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:04:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-540d82df-1a4e-43b0-a629-cdc3d45ce5a0 tempest-ProjectReaderTests-916980377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7b84cb61-fcfc-4c54-87f1-02671ec0f538 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:05 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-81efacef-b3d2-4676-bdc0-425455858e09 tempest-ProjectMemberTests-1434405994 None] Volume volume-9959072e-3d3a-464e-bf73-1aab35aca004 (9959072e-3d3a-464e-bf73-1aab35aca004): created successfully Sep 25 12:04:05 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-81efacef-b3d2-4676-bdc0-425455858e09 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a7ad7b8-cab8-447e-b486-813b149afc9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:04:05 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-81efacef-b3d2-4676-bdc0-425455858e09 tempest-ProjectMemberTests-1434405994 None] Flow 'volume_create_manager' (f2d1d531-67f6-4bcc-8009-cbce44ea9935) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:04:06 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-81efacef-b3d2-4676-bdc0-425455858e09 tempest-ProjectMemberTests-1434405994 None] Created volume successfully. Sep 25 12:04:06 devstack sudo[108227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7b84cb61-fcfc-4c54-87f1-02671ec0f538 Sep 25 12:04:06 devstack sudo[108227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:06 devstack sudo[108227]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-540d82df-1a4e-43b0-a629-cdc3d45ce5a0 tempest-ProjectReaderTests-916980377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7b84cb61-fcfc-4c54-87f1-02671ec0f538" returned: 0 in 0.536s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-540d82df-1a4e-43b0-a629-cdc3d45ce5a0 tempest-ProjectReaderTests-916980377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7b84cb61-fcfc-4c54-87f1-02671ec0f538,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7b84cb61-fcfc-4c54-87f1-02671ec0f538.ea55c7e9-b0a2-411a-9441-75559148f223 1G {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:06 devstack sudo[108232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7b84cb61-fcfc-4c54-87f1-02671ec0f538,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7b84cb61-fcfc-4c54-87f1-02671ec0f538.ea55c7e9-b0a2-411a-9441-75559148f223 1G Sep 25 12:04:06 devstack sudo[108232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-027523c6-01ab-4f58-a6fb-5bdcebbd18c5 tempest-ProjectMemberTests-1434405994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:04:07 devstack sudo[108232]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-540d82df-1a4e-43b0-a629-cdc3d45ce5a0 tempest-ProjectReaderTests-916980377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7b84cb61-fcfc-4c54-87f1-02671ec0f538,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7b84cb61-fcfc-4c54-87f1-02671ec0f538.ea55c7e9-b0a2-411a-9441-75559148f223 1G" returned: 0 in 0.824s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-540d82df-1a4e-43b0-a629-cdc3d45ce5a0 tempest-ProjectReaderTests-916980377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b84cb61-fcfc-4c54-87f1-02671ec0f538 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7b84cb61-fcfc-4c54-87f1-02671ec0f538.ea55c7e9-b0a2-411a-9441-75559148f223 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:07 devstack sudo[108240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b84cb61-fcfc-4c54-87f1-02671ec0f538 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7b84cb61-fcfc-4c54-87f1-02671ec0f538.ea55c7e9-b0a2-411a-9441-75559148f223 Sep 25 12:04:07 devstack sudo[108240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:07 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-338317ba-a11c-4da6-8938-3e86b7fadb3b tempest-ProjectAdminTests-297820102 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.4309730529785, 'free_capacity_gb': 1775.4309730529785, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86984) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 25 12:04:07 devstack sudo[108240]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-540d82df-1a4e-43b0-a629-cdc3d45ce5a0 tempest-ProjectReaderTests-916980377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b84cb61-fcfc-4c54-87f1-02671ec0f538 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7b84cb61-fcfc-4c54-87f1-02671ec0f538.ea55c7e9-b0a2-411a-9441-75559148f223" returned: 0 in 0.399s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:07 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-540d82df-1a4e-43b0-a629-cdc3d45ce5a0 tempest-ProjectReaderTests-916980377 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7b84cb61-fcfc-4c54-87f1-02671ec0f538.ea55c7e9-b0a2-411a-9441-75559148f223 is being set with open permissions: ugo+rw Sep 25 12:04:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-540d82df-1a4e-43b0-a629-cdc3d45ce5a0 tempest-ProjectReaderTests-916980377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7b84cb61-fcfc-4c54-87f1-02671ec0f538.ea55c7e9-b0a2-411a-9441-75559148f223 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:07 devstack sudo[108245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7b84cb61-fcfc-4c54-87f1-02671ec0f538.ea55c7e9-b0a2-411a-9441-75559148f223 Sep 25 12:04:07 devstack sudo[108245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:08 devstack sudo[108245]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-540d82df-1a4e-43b0-a629-cdc3d45ce5a0 tempest-ProjectReaderTests-916980377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7b84cb61-fcfc-4c54-87f1-02671ec0f538.ea55c7e9-b0a2-411a-9441-75559148f223" returned: 0 in 0.316s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-540d82df-1a4e-43b0-a629-cdc3d45ce5a0 tempest-ProjectReaderTests-916980377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7b84cb61-fcfc-4c54-87f1-02671ec0f538.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:08 devstack sudo[108248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7b84cb61-fcfc-4c54-87f1-02671ec0f538.info Sep 25 12:04:08 devstack sudo[108248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:08 devstack sudo[108248]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-540d82df-1a4e-43b0-a629-cdc3d45ce5a0 tempest-ProjectReaderTests-916980377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7b84cb61-fcfc-4c54-87f1-02671ec0f538.info" returned: 0 in 0.405s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:08 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-540d82df-1a4e-43b0-a629-cdc3d45ce5a0 tempest-ProjectReaderTests-916980377 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7b84cb61-fcfc-4c54-87f1-02671ec0f538.info is being set with open permissions: ugo+rw Sep 25 12:04:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-540d82df-1a4e-43b0-a629-cdc3d45ce5a0 tempest-ProjectReaderTests-916980377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7b84cb61-fcfc-4c54-87f1-02671ec0f538.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:08 devstack sudo[108251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7b84cb61-fcfc-4c54-87f1-02671ec0f538.info Sep 25 12:04:08 devstack sudo[108251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:08 devstack sudo[108251]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-540d82df-1a4e-43b0-a629-cdc3d45ce5a0 tempest-ProjectReaderTests-916980377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7b84cb61-fcfc-4c54-87f1-02671ec0f538.info" returned: 0 in 0.315s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-540d82df-1a4e-43b0-a629-cdc3d45ce5a0 tempest-ProjectReaderTests-916980377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.925s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:04:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-027523c6-01ab-4f58-a6fb-5bdcebbd18c5 tempest-ProjectMemberTests-1434405994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.628s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:04:08 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-027523c6-01ab-4f58-a6fb-5bdcebbd18c5 tempest-ProjectMemberTests-1434405994 None] Creating offline snapshot 5e04f78b-096a-479f-93c4-39c78a2b208e of volume 9959072e-3d3a-464e-bf73-1aab35aca004 {{(pid=86984) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 12:04:08 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-540d82df-1a4e-43b0-a629-cdc3d45ce5a0 tempest-ProjectReaderTests-916980377 None] Create snapshot completed successfully Sep 25 12:04:08 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b71a83-f8ac-48fc-8cfc-b720f26694cf]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:04:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-027523c6-01ab-4f58-a6fb-5bdcebbd18c5 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9959072e-3d3a-464e-bf73-1aab35aca004 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:09 devstack sudo[108254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9959072e-3d3a-464e-bf73-1aab35aca004 Sep 25 12:04:09 devstack sudo[108254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:09 devstack sudo[108254]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-027523c6-01ab-4f58-a6fb-5bdcebbd18c5 tempest-ProjectMemberTests-1434405994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9959072e-3d3a-464e-bf73-1aab35aca004" returned: 0 in 0.472s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-027523c6-01ab-4f58-a6fb-5bdcebbd18c5 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9959072e-3d3a-464e-bf73-1aab35aca004,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9959072e-3d3a-464e-bf73-1aab35aca004.5e04f78b-096a-479f-93c4-39c78a2b208e 1G {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:09 devstack sudo[108259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9959072e-3d3a-464e-bf73-1aab35aca004,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9959072e-3d3a-464e-bf73-1aab35aca004.5e04f78b-096a-479f-93c4-39c78a2b208e 1G Sep 25 12:04:09 devstack sudo[108259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:10 devstack sudo[108259]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:10 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-6a5c61b4-d503-454c-bd16-581072aa40e6 tempest-ProjectReaderTests-916980377 None] Acquiring lock "cinder-ea55c7e9-b0a2-411a-9441-75559148f223-delete_snapshot" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:04:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-027523c6-01ab-4f58-a6fb-5bdcebbd18c5 tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9959072e-3d3a-464e-bf73-1aab35aca004,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9959072e-3d3a-464e-bf73-1aab35aca004.5e04f78b-096a-479f-93c4-39c78a2b208e 1G" returned: 0 in 0.692s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-027523c6-01ab-4f58-a6fb-5bdcebbd18c5 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9959072e-3d3a-464e-bf73-1aab35aca004 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9959072e-3d3a-464e-bf73-1aab35aca004.5e04f78b-096a-479f-93c4-39c78a2b208e {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:10 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-6a5c61b4-d503-454c-bd16-581072aa40e6 tempest-ProjectReaderTests-916980377 None] Lock "cinder-ea55c7e9-b0a2-411a-9441-75559148f223-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:04:10 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-6a5c61b4-d503-454c-bd16-581072aa40e6 tempest-ProjectReaderTests-916980377 None] Acquiring lock "cinder-quobyte-7b84cb61-fcfc-4c54-87f1-02671ec0f538" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:04:10 devstack sudo[108265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9959072e-3d3a-464e-bf73-1aab35aca004 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9959072e-3d3a-464e-bf73-1aab35aca004.5e04f78b-096a-479f-93c4-39c78a2b208e Sep 25 12:04:10 devstack sudo[108265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:10 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-6a5c61b4-d503-454c-bd16-581072aa40e6 tempest-ProjectReaderTests-916980377 None] Lock "cinder-quobyte-7b84cb61-fcfc-4c54-87f1-02671ec0f538" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:04:10 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-6a5c61b4-d503-454c-bd16-581072aa40e6 tempest-ProjectReaderTests-916980377 None] Acquiring lock "cinder-quobyte-ea55c7e9-b0a2-411a-9441-75559148f223" by "_delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:04:10 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-6a5c61b4-d503-454c-bd16-581072aa40e6 tempest-ProjectReaderTests-916980377 None] Lock "cinder-quobyte-ea55c7e9-b0a2-411a-9441-75559148f223" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:04:10 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-6a5c61b4-d503-454c-bd16-581072aa40e6 tempest-ProjectReaderTests-916980377 None] Deleting offline snapshot ea55c7e9-b0a2-411a-9441-75559148f223 of volume 7b84cb61-fcfc-4c54-87f1-02671ec0f538 {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 12:04:10 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-6a5c61b4-d503-454c-bd16-581072aa40e6 tempest-ProjectReaderTests-916980377 None] snapshot_file for this snap is: volume-7b84cb61-fcfc-4c54-87f1-02671ec0f538.ea55c7e9-b0a2-411a-9441-75559148f223 {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 12:04:10 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[7912d663-9f92-40b6-888a-600d6ba71261]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:04:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6a5c61b4-d503-454c-bd16-581072aa40e6 tempest-ProjectReaderTests-916980377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7b84cb61-fcfc-4c54-87f1-02671ec0f538.ea55c7e9-b0a2-411a-9441-75559148f223 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:10 devstack sudo[108267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7b84cb61-fcfc-4c54-87f1-02671ec0f538.ea55c7e9-b0a2-411a-9441-75559148f223 Sep 25 12:04:10 devstack sudo[108267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:10 devstack sudo[108265]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-027523c6-01ab-4f58-a6fb-5bdcebbd18c5 tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9959072e-3d3a-464e-bf73-1aab35aca004 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9959072e-3d3a-464e-bf73-1aab35aca004.5e04f78b-096a-479f-93c4-39c78a2b208e" returned: 0 in 0.441s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:10 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-027523c6-01ab-4f58-a6fb-5bdcebbd18c5 tempest-ProjectMemberTests-1434405994 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9959072e-3d3a-464e-bf73-1aab35aca004.5e04f78b-096a-479f-93c4-39c78a2b208e is being set with open permissions: ugo+rw Sep 25 12:04:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-027523c6-01ab-4f58-a6fb-5bdcebbd18c5 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9959072e-3d3a-464e-bf73-1aab35aca004.5e04f78b-096a-479f-93c4-39c78a2b208e {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:10 devstack sudo[108273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9959072e-3d3a-464e-bf73-1aab35aca004.5e04f78b-096a-479f-93c4-39c78a2b208e Sep 25 12:04:10 devstack sudo[108273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:10 devstack sudo[108267]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6a5c61b4-d503-454c-bd16-581072aa40e6 tempest-ProjectReaderTests-916980377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7b84cb61-fcfc-4c54-87f1-02671ec0f538.ea55c7e9-b0a2-411a-9441-75559148f223" returned: 0 in 0.494s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:10 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-6a5c61b4-d503-454c-bd16-581072aa40e6 tempest-ProjectReaderTests-916980377 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b84cb61-fcfc-4c54-87f1-02671ec0f538(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86984) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:04:10 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[c162103b-bddc-4e52-89cb-ce9ceec80fbb]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:04:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6a5c61b4-d503-454c-bd16-581072aa40e6 tempest-ProjectReaderTests-916980377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7b84cb61-fcfc-4c54-87f1-02671ec0f538 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:10 devstack sudo[108273]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-027523c6-01ab-4f58-a6fb-5bdcebbd18c5 tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9959072e-3d3a-464e-bf73-1aab35aca004.5e04f78b-096a-479f-93c4-39c78a2b208e" returned: 0 in 0.368s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-027523c6-01ab-4f58-a6fb-5bdcebbd18c5 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9959072e-3d3a-464e-bf73-1aab35aca004.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:11 devstack sudo[108278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7b84cb61-fcfc-4c54-87f1-02671ec0f538 Sep 25 12:04:11 devstack sudo[108281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9959072e-3d3a-464e-bf73-1aab35aca004.info Sep 25 12:04:11 devstack sudo[108281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:11 devstack sudo[108278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:11 devstack sudo[108281]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-027523c6-01ab-4f58-a6fb-5bdcebbd18c5 tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9959072e-3d3a-464e-bf73-1aab35aca004.info" returned: 0 in 0.393s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:11 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-027523c6-01ab-4f58-a6fb-5bdcebbd18c5 tempest-ProjectMemberTests-1434405994 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9959072e-3d3a-464e-bf73-1aab35aca004.info is being set with open permissions: ugo+rw Sep 25 12:04:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-027523c6-01ab-4f58-a6fb-5bdcebbd18c5 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9959072e-3d3a-464e-bf73-1aab35aca004.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:11 devstack sudo[108278]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6a5c61b4-d503-454c-bd16-581072aa40e6 tempest-ProjectReaderTests-916980377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7b84cb61-fcfc-4c54-87f1-02671ec0f538" returned: 0 in 0.606s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6a5c61b4-d503-454c-bd16-581072aa40e6 tempest-ProjectReaderTests-916980377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7b84cb61-fcfc-4c54-87f1-02671ec0f538.ea55c7e9-b0a2-411a-9441-75559148f223 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:11 devstack sudo[108288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9959072e-3d3a-464e-bf73-1aab35aca004.info Sep 25 12:04:11 devstack sudo[108288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:11 devstack sudo[108289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7b84cb61-fcfc-4c54-87f1-02671ec0f538.ea55c7e9-b0a2-411a-9441-75559148f223 Sep 25 12:04:11 devstack sudo[108289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:11 devstack sudo[108288]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-027523c6-01ab-4f58-a6fb-5bdcebbd18c5 tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9959072e-3d3a-464e-bf73-1aab35aca004.info" returned: 0 in 0.336s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-027523c6-01ab-4f58-a6fb-5bdcebbd18c5 tempest-ProjectMemberTests-1434405994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.900s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:04:11 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-027523c6-01ab-4f58-a6fb-5bdcebbd18c5 tempest-ProjectMemberTests-1434405994 None] Create snapshot completed successfully Sep 25 12:04:11 devstack sudo[108289]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6a5c61b4-d503-454c-bd16-581072aa40e6 tempest-ProjectReaderTests-916980377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7b84cb61-fcfc-4c54-87f1-02671ec0f538.ea55c7e9-b0a2-411a-9441-75559148f223" returned: 0 in 0.439s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6a5c61b4-d503-454c-bd16-581072aa40e6 tempest-ProjectReaderTests-916980377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7b84cb61-fcfc-4c54-87f1-02671ec0f538.ea55c7e9-b0a2-411a-9441-75559148f223 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:11 devstack sudo[108297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7b84cb61-fcfc-4c54-87f1-02671ec0f538.ea55c7e9-b0a2-411a-9441-75559148f223 Sep 25 12:04:11 devstack sudo[108297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:12 devstack sudo[108297]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:12 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6a5c61b4-d503-454c-bd16-581072aa40e6 tempest-ProjectReaderTests-916980377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7b84cb61-fcfc-4c54-87f1-02671ec0f538.ea55c7e9-b0a2-411a-9441-75559148f223" returned: 0 in 0.289s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:12 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-6a5c61b4-d503-454c-bd16-581072aa40e6 tempest-ProjectReaderTests-916980377 None] Lock "cinder-quobyte-ea55c7e9-b0a2-411a-9441-75559148f223" released by "_delete_snapshot" :: held 2.004s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:04:12 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-6a5c61b4-d503-454c-bd16-581072aa40e6 tempest-ProjectReaderTests-916980377 None] Lock "cinder-quobyte-7b84cb61-fcfc-4c54-87f1-02671ec0f538" released by "delete_snapshot" :: held 2.036s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:04:12 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-6a5c61b4-d503-454c-bd16-581072aa40e6 tempest-ProjectReaderTests-916980377 None] Created reservations ['4b2d8557-d0d6-487e-b9ea-e02810c6ccef', '9b387b20-e823-4e31-b39d-83917c340e6c', 'e5bac492-d18a-4c1e-842a-18042a4cd624', 'd7e47a88-df3b-4472-8edd-b43b06147820'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:04:12 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-6a5c61b4-d503-454c-bd16-581072aa40e6 tempest-ProjectReaderTests-916980377 None] Delete snapshot completed successfully. Sep 25 12:04:12 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-6a5c61b4-d503-454c-bd16-581072aa40e6 tempest-ProjectReaderTests-916980377 None] Lock "cinder-ea55c7e9-b0a2-411a-9441-75559148f223-delete_snapshot" released by "delete_snapshot" :: held 2.250s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:04:12 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-d48acc8f-f8da-416f-92a6-54c0d1d42e89 tempest-ProjectMemberTests-1434405994 None] Acquiring lock "cinder-5e04f78b-096a-479f-93c4-39c78a2b208e-delete_snapshot" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:04:12 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-d48acc8f-f8da-416f-92a6-54c0d1d42e89 tempest-ProjectMemberTests-1434405994 None] Lock "cinder-5e04f78b-096a-479f-93c4-39c78a2b208e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:04:12 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-d48acc8f-f8da-416f-92a6-54c0d1d42e89 tempest-ProjectMemberTests-1434405994 None] Acquiring lock "cinder-quobyte-9959072e-3d3a-464e-bf73-1aab35aca004" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:04:12 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-d48acc8f-f8da-416f-92a6-54c0d1d42e89 tempest-ProjectMemberTests-1434405994 None] Lock "cinder-quobyte-9959072e-3d3a-464e-bf73-1aab35aca004" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:04:12 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-d48acc8f-f8da-416f-92a6-54c0d1d42e89 tempest-ProjectMemberTests-1434405994 None] Acquiring lock "cinder-quobyte-5e04f78b-096a-479f-93c4-39c78a2b208e" by "_delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:04:12 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-d48acc8f-f8da-416f-92a6-54c0d1d42e89 tempest-ProjectMemberTests-1434405994 None] Lock "cinder-quobyte-5e04f78b-096a-479f-93c4-39c78a2b208e" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:04:12 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-d48acc8f-f8da-416f-92a6-54c0d1d42e89 tempest-ProjectMemberTests-1434405994 None] Deleting offline snapshot 5e04f78b-096a-479f-93c4-39c78a2b208e of volume 9959072e-3d3a-464e-bf73-1aab35aca004 {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 12:04:12 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-d48acc8f-f8da-416f-92a6-54c0d1d42e89 tempest-ProjectMemberTests-1434405994 None] snapshot_file for this snap is: volume-9959072e-3d3a-464e-bf73-1aab35aca004.5e04f78b-096a-479f-93c4-39c78a2b208e {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 12:04:12 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[964d1b1c-908e-4680-8553-a25aa39b3a3e]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:04:12 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d48acc8f-f8da-416f-92a6-54c0d1d42e89 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9959072e-3d3a-464e-bf73-1aab35aca004.5e04f78b-096a-479f-93c4-39c78a2b208e {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:12 devstack sudo[108300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9959072e-3d3a-464e-bf73-1aab35aca004.5e04f78b-096a-479f-93c4-39c78a2b208e Sep 25 12:04:12 devstack sudo[108300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:13 devstack sudo[108300]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:13 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d48acc8f-f8da-416f-92a6-54c0d1d42e89 tempest-ProjectMemberTests-1434405994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9959072e-3d3a-464e-bf73-1aab35aca004.5e04f78b-096a-479f-93c4-39c78a2b208e" returned: 0 in 0.454s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:13 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-d48acc8f-f8da-416f-92a6-54c0d1d42e89 tempest-ProjectMemberTests-1434405994 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9959072e-3d3a-464e-bf73-1aab35aca004(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86984) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:04:13 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[277b09e8-2f6e-4e09-af3c-878e55bbb278]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:04:13 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d48acc8f-f8da-416f-92a6-54c0d1d42e89 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9959072e-3d3a-464e-bf73-1aab35aca004 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:13 devstack sudo[108305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9959072e-3d3a-464e-bf73-1aab35aca004 Sep 25 12:04:13 devstack sudo[108305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:13 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f25f58df-9174-4e0c-8315-4d0d5b9540cb tempest-ProjectReaderTests-916980377 None] Acquiring lock "cinder-7b84cb61-fcfc-4c54-87f1-02671ec0f538-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:04:13 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f25f58df-9174-4e0c-8315-4d0d5b9540cb tempest-ProjectReaderTests-916980377 None] Lock "cinder-7b84cb61-fcfc-4c54-87f1-02671ec0f538-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:04:13 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f25f58df-9174-4e0c-8315-4d0d5b9540cb tempest-ProjectReaderTests-916980377 None] Acquiring lock "cinder-quobyte-7b84cb61-fcfc-4c54-87f1-02671ec0f538" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:04:13 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f25f58df-9174-4e0c-8315-4d0d5b9540cb tempest-ProjectReaderTests-916980377 None] Lock "cinder-quobyte-7b84cb61-fcfc-4c54-87f1-02671ec0f538" acquired by "delete_volume" :: waited 0.027s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:04:13 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[c945245c-1e38-4891-8bee-f282fdc2f675]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:04:13 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f25f58df-9174-4e0c-8315-4d0d5b9540cb tempest-ProjectReaderTests-916980377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7b84cb61-fcfc-4c54-87f1-02671ec0f538 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:13 devstack sudo[108305]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:13 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d48acc8f-f8da-416f-92a6-54c0d1d42e89 tempest-ProjectMemberTests-1434405994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9959072e-3d3a-464e-bf73-1aab35aca004" returned: 0 in 0.490s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:13 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d48acc8f-f8da-416f-92a6-54c0d1d42e89 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9959072e-3d3a-464e-bf73-1aab35aca004.5e04f78b-096a-479f-93c4-39c78a2b208e {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:13 devstack sudo[108311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9959072e-3d3a-464e-bf73-1aab35aca004.5e04f78b-096a-479f-93c4-39c78a2b208e Sep 25 12:04:13 devstack sudo[108311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:13 devstack sudo[108310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7b84cb61-fcfc-4c54-87f1-02671ec0f538 Sep 25 12:04:13 devstack sudo[108310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:13 devstack sudo[108310]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:13 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f25f58df-9174-4e0c-8315-4d0d5b9540cb tempest-ProjectReaderTests-916980377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7b84cb61-fcfc-4c54-87f1-02671ec0f538" returned: 0 in 0.504s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:13 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f25f58df-9174-4e0c-8315-4d0d5b9540cb tempest-ProjectReaderTests-916980377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7b84cb61-fcfc-4c54-87f1-02671ec0f538 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:14 devstack sudo[108321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7b84cb61-fcfc-4c54-87f1-02671ec0f538 Sep 25 12:04:14 devstack sudo[108321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:14 devstack sudo[108311]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:14 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d48acc8f-f8da-416f-92a6-54c0d1d42e89 tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9959072e-3d3a-464e-bf73-1aab35aca004.5e04f78b-096a-479f-93c4-39c78a2b208e" returned: 0 in 0.459s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:14 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d48acc8f-f8da-416f-92a6-54c0d1d42e89 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9959072e-3d3a-464e-bf73-1aab35aca004.5e04f78b-096a-479f-93c4-39c78a2b208e {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:14 devstack sudo[108323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9959072e-3d3a-464e-bf73-1aab35aca004.5e04f78b-096a-479f-93c4-39c78a2b208e Sep 25 12:04:14 devstack sudo[108323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:14 devstack sudo[108321]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:14 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f25f58df-9174-4e0c-8315-4d0d5b9540cb tempest-ProjectReaderTests-916980377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7b84cb61-fcfc-4c54-87f1-02671ec0f538" returned: 0 in 0.326s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:14 devstack sudo[108323]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:14 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d48acc8f-f8da-416f-92a6-54c0d1d42e89 tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9959072e-3d3a-464e-bf73-1aab35aca004.5e04f78b-096a-479f-93c4-39c78a2b208e" returned: 0 in 0.294s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:14 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f25f58df-9174-4e0c-8315-4d0d5b9540cb tempest-ProjectReaderTests-916980377 None] Lock "cinder-quobyte-7b84cb61-fcfc-4c54-87f1-02671ec0f538" released by "delete_volume" :: held 0.911s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:04:14 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-d48acc8f-f8da-416f-92a6-54c0d1d42e89 tempest-ProjectMemberTests-1434405994 None] Lock "cinder-quobyte-5e04f78b-096a-479f-93c4-39c78a2b208e" released by "_delete_snapshot" :: held 1.849s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:04:14 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-d48acc8f-f8da-416f-92a6-54c0d1d42e89 tempest-ProjectMemberTests-1434405994 None] Lock "cinder-quobyte-9959072e-3d3a-464e-bf73-1aab35aca004" released by "delete_snapshot" :: held 1.892s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:04:14 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-f25f58df-9174-4e0c-8315-4d0d5b9540cb tempest-ProjectReaderTests-916980377 None] Created reservations ['451bbf54-ed7d-4750-8772-e7f27ffd733b', 'e94eed8f-1dca-4f8a-b6c2-6fdc652fbf8a', '428c907d-60dc-425b-8bea-5939ca7092f9', 'e3dc2c75-d0c0-42af-8d43-d8754a0194e9'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:04:14 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-d48acc8f-f8da-416f-92a6-54c0d1d42e89 tempest-ProjectMemberTests-1434405994 None] Created reservations ['99667947-f05a-4364-a38c-7edf1b52a88c', '9571a6e7-b66e-4e89-a47c-00d9ca4fefd7', '4e6f014f-b9e5-4240-8e77-a0b3d0a47dd0', 'a9949d20-6da9-4807-8013-a4a624096187'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:04:14 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f25f58df-9174-4e0c-8315-4d0d5b9540cb tempest-ProjectReaderTests-916980377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:04:14 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f25f58df-9174-4e0c-8315-4d0d5b9540cb tempest-ProjectReaderTests-916980377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:04:14 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-f25f58df-9174-4e0c-8315-4d0d5b9540cb tempest-ProjectReaderTests-916980377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:04:14 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-f25f58df-9174-4e0c-8315-4d0d5b9540cb tempest-ProjectReaderTests-916980377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:04:14 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f25f58df-9174-4e0c-8315-4d0d5b9540cb tempest-ProjectReaderTests-916980377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:04:14 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f25f58df-9174-4e0c-8315-4d0d5b9540cb tempest-ProjectReaderTests-916980377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:14 devstack sudo[108327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 12:04:14 devstack sudo[108327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:14 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-d48acc8f-f8da-416f-92a6-54c0d1d42e89 tempest-ProjectMemberTests-1434405994 None] Delete snapshot completed successfully. Sep 25 12:04:14 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-d48acc8f-f8da-416f-92a6-54c0d1d42e89 tempest-ProjectMemberTests-1434405994 None] Lock "cinder-5e04f78b-096a-479f-93c4-39c78a2b208e-delete_snapshot" released by "delete_snapshot" :: held 2.248s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:04:14 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-b6ed8e2a-c5c7-4a9f-8dbe-574d4914b5d0 tempest-ProjectMemberTests-1434405994 None] Acquiring lock "cinder-9959072e-3d3a-464e-bf73-1aab35aca004-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:04:14 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-b6ed8e2a-c5c7-4a9f-8dbe-574d4914b5d0 tempest-ProjectMemberTests-1434405994 None] Lock "cinder-9959072e-3d3a-464e-bf73-1aab35aca004-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:04:14 devstack sudo[108327]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:14 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f25f58df-9174-4e0c-8315-4d0d5b9540cb tempest-ProjectReaderTests-916980377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.344s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:14 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-f25f58df-9174-4e0c-8315-4d0d5b9540cb tempest-ProjectReaderTests-916980377 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:04:14 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-b6ed8e2a-c5c7-4a9f-8dbe-574d4914b5d0 tempest-ProjectMemberTests-1434405994 None] Acquiring lock "cinder-quobyte-9959072e-3d3a-464e-bf73-1aab35aca004" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:04:14 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-f25f58df-9174-4e0c-8315-4d0d5b9540cb tempest-ProjectReaderTests-916980377 None] Deleted volume successfully. Sep 25 12:04:14 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-b6ed8e2a-c5c7-4a9f-8dbe-574d4914b5d0 tempest-ProjectMemberTests-1434405994 None] Lock "cinder-quobyte-9959072e-3d3a-464e-bf73-1aab35aca004" acquired by "delete_volume" :: waited 0.026s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:04:15 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-f25f58df-9174-4e0c-8315-4d0d5b9540cb tempest-ProjectReaderTests-916980377 None] Lock "cinder-7b84cb61-fcfc-4c54-87f1-02671ec0f538-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:04:15 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[26cd2968-b1a6-4529-b60a-85fd8d620866]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:04:15 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-b6ed8e2a-c5c7-4a9f-8dbe-574d4914b5d0 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9959072e-3d3a-464e-bf73-1aab35aca004 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:15 devstack sudo[108330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9959072e-3d3a-464e-bf73-1aab35aca004 Sep 25 12:04:15 devstack sudo[108330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:15 devstack sudo[108330]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:15 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-b6ed8e2a-c5c7-4a9f-8dbe-574d4914b5d0 tempest-ProjectMemberTests-1434405994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9959072e-3d3a-464e-bf73-1aab35aca004" returned: 0 in 0.416s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:15 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-b6ed8e2a-c5c7-4a9f-8dbe-574d4914b5d0 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9959072e-3d3a-464e-bf73-1aab35aca004 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:15 devstack sudo[108335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9959072e-3d3a-464e-bf73-1aab35aca004 Sep 25 12:04:15 devstack sudo[108335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:15 devstack sudo[108335]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:15 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-b6ed8e2a-c5c7-4a9f-8dbe-574d4914b5d0 tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9959072e-3d3a-464e-bf73-1aab35aca004" returned: 0 in 0.273s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:15 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-b6ed8e2a-c5c7-4a9f-8dbe-574d4914b5d0 tempest-ProjectMemberTests-1434405994 None] Lock "cinder-quobyte-9959072e-3d3a-464e-bf73-1aab35aca004" released by "delete_volume" :: held 0.775s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:04:15 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-b6ed8e2a-c5c7-4a9f-8dbe-574d4914b5d0 tempest-ProjectMemberTests-1434405994 None] Created reservations ['3909194d-9844-4729-bbfc-c82a78af501c', 'b63a1747-5b45-461d-8daa-010ce907c10b', '5b809615-5bc5-40b4-942b-2ed972af2954', 'ad37a92d-8b61-4a9e-8dcc-5b2b00c4167f'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:04:15 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-b6ed8e2a-c5c7-4a9f-8dbe-574d4914b5d0 tempest-ProjectMemberTests-1434405994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:04:15 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-b6ed8e2a-c5c7-4a9f-8dbe-574d4914b5d0 tempest-ProjectMemberTests-1434405994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:04:15 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-b6ed8e2a-c5c7-4a9f-8dbe-574d4914b5d0 tempest-ProjectMemberTests-1434405994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:04:15 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-b6ed8e2a-c5c7-4a9f-8dbe-574d4914b5d0 tempest-ProjectMemberTests-1434405994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:04:15 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-b6ed8e2a-c5c7-4a9f-8dbe-574d4914b5d0 tempest-ProjectMemberTests-1434405994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:04:15 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-b6ed8e2a-c5c7-4a9f-8dbe-574d4914b5d0 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:15 devstack sudo[108338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 12:04:15 devstack sudo[108338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:16 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6248349-aa03-48b9-adfc-9f42507782a6 tempest-ProjectReaderTests-916980377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:04:16 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f6248349-aa03-48b9-adfc-9f42507782a6 tempest-ProjectReaderTests-916980377 None] Flow 'volume_create_manager' (f56738b9-290d-4577-babd-975839a8b045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:04:16 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f6248349-aa03-48b9-adfc-9f42507782a6 tempest-ProjectReaderTests-916980377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8d65207-f789-4333-a2fa-757cb740ff59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:04:16 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f6248349-aa03-48b9-adfc-9f42507782a6 tempest-ProjectReaderTests-916980377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8d65207-f789-4333-a2fa-757cb740ff59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:04:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1381197044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a78b3973-80d6-4f33-b169-d97b10f9dc9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c665fd078654a5ca51a715d7405fe8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:04:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:04:16Z,use_quota=True,user_id='62e4ebbd017b43a7bdf4fcc690c52509',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:04:16 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f6248349-aa03-48b9-adfc-9f42507782a6 tempest-ProjectReaderTests-916980377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (779ce05c-c5e4-4b2e-acb7-20a44dfa3f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:04:16 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f6248349-aa03-48b9-adfc-9f42507782a6 tempest-ProjectReaderTests-916980377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (779ce05c-c5e4-4b2e-acb7-20a44dfa3f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:04:16 devstack sudo[108338]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:16 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f6248349-aa03-48b9-adfc-9f42507782a6 tempest-ProjectReaderTests-916980377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6f03f21-22a2-463a-9c1c-5b3037546fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:04:16 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f6248349-aa03-48b9-adfc-9f42507782a6 tempest-ProjectReaderTests-916980377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6f03f21-22a2-463a-9c1c-5b3037546fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a78b3973-80d6-4f33-b169-d97b10f9dc9c', 'volume_name': 'volume-a78b3973-80d6-4f33-b169-d97b10f9dc9c', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:04:16 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f6248349-aa03-48b9-adfc-9f42507782a6 tempest-ProjectReaderTests-916980377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f239e530-c7ff-47b1-9e75-ffcd64701741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:04:16 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f6248349-aa03-48b9-adfc-9f42507782a6 tempest-ProjectReaderTests-916980377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f239e530-c7ff-47b1-9e75-ffcd64701741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:04:16 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f6248349-aa03-48b9-adfc-9f42507782a6 tempest-ProjectReaderTests-916980377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60edcfdb-956e-41c1-a33f-14753041d83f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:04:16 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-f6248349-aa03-48b9-adfc-9f42507782a6 tempest-ProjectReaderTests-916980377 None] Volume a78b3973-80d6-4f33-b169-d97b10f9dc9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a78b3973-80d6-4f33-b169-d97b10f9dc9c', 'volume_size': 1} Sep 25 12:04:16 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f6248349-aa03-48b9-adfc-9f42507782a6 tempest-ProjectReaderTests-916980377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:04:16 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f6248349-aa03-48b9-adfc-9f42507782a6 tempest-ProjectReaderTests-916980377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:04:16 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-f6248349-aa03-48b9-adfc-9f42507782a6 tempest-ProjectReaderTests-916980377 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:04:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1381197044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a78b3973-80d6-4f33-b169-d97b10f9dc9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c665fd078654a5ca51a715d7405fe8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:04:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:04:16Z,use_quota=True,user_id='62e4ebbd017b43a7bdf4fcc690c52509',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:04:16 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-f6248349-aa03-48b9-adfc-9f42507782a6 tempest-ProjectReaderTests-916980377 None] Creating volume a78b3973-80d6-4f33-b169-d97b10f9dc9c {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:04:16 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f6248349-aa03-48b9-adfc-9f42507782a6 tempest-ProjectReaderTests-916980377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:04:16 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f6248349-aa03-48b9-adfc-9f42507782a6 tempest-ProjectReaderTests-916980377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:04:16 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-f6248349-aa03-48b9-adfc-9f42507782a6 tempest-ProjectReaderTests-916980377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:04:16 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-f6248349-aa03-48b9-adfc-9f42507782a6 tempest-ProjectReaderTests-916980377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:04:16 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f6248349-aa03-48b9-adfc-9f42507782a6 tempest-ProjectReaderTests-916980377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:04:16 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-f6248349-aa03-48b9-adfc-9f42507782a6 tempest-ProjectReaderTests-916980377 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:04:16 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-f6248349-aa03-48b9-adfc-9f42507782a6 tempest-ProjectReaderTests-916980377 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 12:04:16 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f6248349-aa03-48b9-adfc-9f42507782a6 tempest-ProjectReaderTests-916980377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a78b3973-80d6-4f33-b169-d97b10f9dc9c 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:16 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-b6ed8e2a-c5c7-4a9f-8dbe-574d4914b5d0 tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.423s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:16 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-b6ed8e2a-c5c7-4a9f-8dbe-574d4914b5d0 tempest-ProjectMemberTests-1434405994 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:04:16 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-b6ed8e2a-c5c7-4a9f-8dbe-574d4914b5d0 tempest-ProjectMemberTests-1434405994 None] Deleted volume successfully. Sep 25 12:04:16 devstack sudo[108341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a78b3973-80d6-4f33-b169-d97b10f9dc9c 1073741824 Sep 25 12:04:16 devstack sudo[108341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:16 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-b6ed8e2a-c5c7-4a9f-8dbe-574d4914b5d0 tempest-ProjectMemberTests-1434405994 None] Lock "cinder-9959072e-3d3a-464e-bf73-1aab35aca004-delete_volume" released by "delete_volume" :: held 1.548s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:04:16 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f9ad01c-1aae-4da5-a409-a91ba97cc393 tempest-ProjectMemberTests-1434405994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:04:16 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8f9ad01c-1aae-4da5-a409-a91ba97cc393 tempest-ProjectMemberTests-1434405994 None] Flow 'volume_create_manager' (70d17c2c-9214-44d9-bbe7-ea19e9347455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:04:16 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8f9ad01c-1aae-4da5-a409-a91ba97cc393 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d04a08a-de7d-486b-bf75-379518611969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:04:16 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8f9ad01c-1aae-4da5-a409-a91ba97cc393 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d04a08a-de7d-486b-bf75-379518611969) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:04:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2032028071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bad501fa-a7de-4403-9a97-2e1f10777fc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c75afeac65f84f13b7d0325fa4b21b65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:04:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:04:17Z,use_quota=True,user_id='770f7e0a81074bae8bcd048c8d7f7347',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:04:16 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8f9ad01c-1aae-4da5-a409-a91ba97cc393 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80691bc1-9bc3-458b-99eb-5a5e3526aefb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:04:16 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8f9ad01c-1aae-4da5-a409-a91ba97cc393 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80691bc1-9bc3-458b-99eb-5a5e3526aefb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:04:16 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8f9ad01c-1aae-4da5-a409-a91ba97cc393 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d369ecd3-7d3c-422f-bbc8-a62feadf94b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:04:16 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8f9ad01c-1aae-4da5-a409-a91ba97cc393 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d369ecd3-7d3c-422f-bbc8-a62feadf94b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bad501fa-a7de-4403-9a97-2e1f10777fc9', 'volume_name': 'volume-bad501fa-a7de-4403-9a97-2e1f10777fc9', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:04:16 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8f9ad01c-1aae-4da5-a409-a91ba97cc393 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49348632-7692-459b-9894-4563e2099353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:04:16 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8f9ad01c-1aae-4da5-a409-a91ba97cc393 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49348632-7692-459b-9894-4563e2099353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:04:16 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8f9ad01c-1aae-4da5-a409-a91ba97cc393 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a45512d2-4051-4a4a-9857-27e040f3520c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:04:16 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-8f9ad01c-1aae-4da5-a409-a91ba97cc393 tempest-ProjectMemberTests-1434405994 None] Volume bad501fa-a7de-4403-9a97-2e1f10777fc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bad501fa-a7de-4403-9a97-2e1f10777fc9', 'volume_size': 1} Sep 25 12:04:16 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-8f9ad01c-1aae-4da5-a409-a91ba97cc393 tempest-ProjectMemberTests-1434405994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:04:16 devstack sudo[108341]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:16 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f6248349-aa03-48b9-adfc-9f42507782a6 tempest-ProjectReaderTests-916980377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a78b3973-80d6-4f33-b169-d97b10f9dc9c 1073741824" returned: 0 in 0.551s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:16 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f6248349-aa03-48b9-adfc-9f42507782a6 tempest-ProjectReaderTests-916980377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a78b3973-80d6-4f33-b169-d97b10f9dc9c {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:17 devstack sudo[108347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a78b3973-80d6-4f33-b169-d97b10f9dc9c Sep 25 12:04:17 devstack sudo[108347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:17 devstack sudo[108347]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:17 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f6248349-aa03-48b9-adfc-9f42507782a6 tempest-ProjectReaderTests-916980377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a78b3973-80d6-4f33-b169-d97b10f9dc9c" returned: 0 in 0.247s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:17 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-f6248349-aa03-48b9-adfc-9f42507782a6 tempest-ProjectReaderTests-916980377 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:04:17 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f6248349-aa03-48b9-adfc-9f42507782a6 tempest-ProjectReaderTests-916980377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:04:17 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-8f9ad01c-1aae-4da5-a409-a91ba97cc393 tempest-ProjectMemberTests-1434405994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.364s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:04:17 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-8f9ad01c-1aae-4da5-a409-a91ba97cc393 tempest-ProjectMemberTests-1434405994 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:04:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2032028071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bad501fa-a7de-4403-9a97-2e1f10777fc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c75afeac65f84f13b7d0325fa4b21b65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:04:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:04:17Z,use_quota=True,user_id='770f7e0a81074bae8bcd048c8d7f7347',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:04:17 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-8f9ad01c-1aae-4da5-a409-a91ba97cc393 tempest-ProjectMemberTests-1434405994 None] Creating volume bad501fa-a7de-4403-9a97-2e1f10777fc9 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:04:17 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-8f9ad01c-1aae-4da5-a409-a91ba97cc393 tempest-ProjectMemberTests-1434405994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:04:17 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-8f9ad01c-1aae-4da5-a409-a91ba97cc393 tempest-ProjectMemberTests-1434405994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:04:17 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-8f9ad01c-1aae-4da5-a409-a91ba97cc393 tempest-ProjectMemberTests-1434405994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:04:17 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-8f9ad01c-1aae-4da5-a409-a91ba97cc393 tempest-ProjectMemberTests-1434405994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:04:17 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-8f9ad01c-1aae-4da5-a409-a91ba97cc393 tempest-ProjectMemberTests-1434405994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:04:17 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-8f9ad01c-1aae-4da5-a409-a91ba97cc393 tempest-ProjectMemberTests-1434405994 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:04:17 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-8f9ad01c-1aae-4da5-a409-a91ba97cc393 tempest-ProjectMemberTests-1434405994 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 12:04:17 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8f9ad01c-1aae-4da5-a409-a91ba97cc393 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bad501fa-a7de-4403-9a97-2e1f10777fc9 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:17 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f6248349-aa03-48b9-adfc-9f42507782a6 tempest-ProjectReaderTests-916980377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60edcfdb-956e-41c1-a33f-14753041d83f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a78b3973-80d6-4f33-b169-d97b10f9dc9c', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:04:17 devstack sudo[108350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bad501fa-a7de-4403-9a97-2e1f10777fc9 1073741824 Sep 25 12:04:17 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f6248349-aa03-48b9-adfc-9f42507782a6 tempest-ProjectReaderTests-916980377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74d2598d-423e-468b-aabe-c9422be94c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:04:17 devstack sudo[108350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:17 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-f6248349-aa03-48b9-adfc-9f42507782a6 tempest-ProjectReaderTests-916980377 None] Volume volume-a78b3973-80d6-4f33-b169-d97b10f9dc9c (a78b3973-80d6-4f33-b169-d97b10f9dc9c): created successfully Sep 25 12:04:17 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f6248349-aa03-48b9-adfc-9f42507782a6 tempest-ProjectReaderTests-916980377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74d2598d-423e-468b-aabe-c9422be94c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:04:17 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f6248349-aa03-48b9-adfc-9f42507782a6 tempest-ProjectReaderTests-916980377 None] Flow 'volume_create_manager' (f56738b9-290d-4577-babd-975839a8b045) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:04:17 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-f6248349-aa03-48b9-adfc-9f42507782a6 tempest-ProjectReaderTests-916980377 None] Created volume successfully. Sep 25 12:04:17 devstack sudo[108350]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:17 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8f9ad01c-1aae-4da5-a409-a91ba97cc393 tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bad501fa-a7de-4403-9a97-2e1f10777fc9 1073741824" returned: 0 in 0.420s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:17 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8f9ad01c-1aae-4da5-a409-a91ba97cc393 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bad501fa-a7de-4403-9a97-2e1f10777fc9 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:17 devstack sudo[108356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bad501fa-a7de-4403-9a97-2e1f10777fc9 Sep 25 12:04:17 devstack sudo[108356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:17 devstack sudo[108356]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:17 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-8f9ad01c-1aae-4da5-a409-a91ba97cc393 tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bad501fa-a7de-4403-9a97-2e1f10777fc9" returned: 0 in 0.235s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:17 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-8f9ad01c-1aae-4da5-a409-a91ba97cc393 tempest-ProjectMemberTests-1434405994 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:04:17 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-8f9ad01c-1aae-4da5-a409-a91ba97cc393 tempest-ProjectMemberTests-1434405994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:04:17 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8f9ad01c-1aae-4da5-a409-a91ba97cc393 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a45512d2-4051-4a4a-9857-27e040f3520c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bad501fa-a7de-4403-9a97-2e1f10777fc9', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:04:17 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8f9ad01c-1aae-4da5-a409-a91ba97cc393 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29d29c10-7864-4b48-b1a2-0f162b77b8f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:04:17 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-8f9ad01c-1aae-4da5-a409-a91ba97cc393 tempest-ProjectMemberTests-1434405994 None] Volume volume-bad501fa-a7de-4403-9a97-2e1f10777fc9 (bad501fa-a7de-4403-9a97-2e1f10777fc9): created successfully Sep 25 12:04:17 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8f9ad01c-1aae-4da5-a409-a91ba97cc393 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29d29c10-7864-4b48-b1a2-0f162b77b8f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:04:17 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-8f9ad01c-1aae-4da5-a409-a91ba97cc393 tempest-ProjectMemberTests-1434405994 None] Flow 'volume_create_manager' (70d17c2c-9214-44d9-bbe7-ea19e9347455) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:04:17 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-8f9ad01c-1aae-4da5-a409-a91ba97cc393 tempest-ProjectMemberTests-1434405994 None] Created volume successfully. Sep 25 12:04:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-86ecfdd5-8f9c-49a6-9ba7-d0a351e100d7 tempest-ProjectReaderTests-916980377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:04:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-86ecfdd5-8f9c-49a6-9ba7-d0a351e100d7 tempest-ProjectReaderTests-916980377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:04:18 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-86ecfdd5-8f9c-49a6-9ba7-d0a351e100d7 tempest-ProjectReaderTests-916980377 None] Creating offline snapshot 357f580b-8c7b-47fb-843a-d4d07cd07097 of volume a78b3973-80d6-4f33-b169-d97b10f9dc9c {{(pid=86984) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 12:04:18 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7cc9da-cae5-4dab-920b-13a7f007b77e]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:04:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-86ecfdd5-8f9c-49a6-9ba7-d0a351e100d7 tempest-ProjectReaderTests-916980377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a78b3973-80d6-4f33-b169-d97b10f9dc9c {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:18 devstack sudo[108359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a78b3973-80d6-4f33-b169-d97b10f9dc9c Sep 25 12:04:18 devstack sudo[108359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:18 devstack sudo[108359]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-86ecfdd5-8f9c-49a6-9ba7-d0a351e100d7 tempest-ProjectReaderTests-916980377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a78b3973-80d6-4f33-b169-d97b10f9dc9c" returned: 0 in 0.418s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-86ecfdd5-8f9c-49a6-9ba7-d0a351e100d7 tempest-ProjectReaderTests-916980377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a78b3973-80d6-4f33-b169-d97b10f9dc9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a78b3973-80d6-4f33-b169-d97b10f9dc9c.357f580b-8c7b-47fb-843a-d4d07cd07097 1G {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:19 devstack sudo[108364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a78b3973-80d6-4f33-b169-d97b10f9dc9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a78b3973-80d6-4f33-b169-d97b10f9dc9c.357f580b-8c7b-47fb-843a-d4d07cd07097 1G Sep 25 12:04:19 devstack sudo[108364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:19 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d83fed06-0372-416c-8f2b-2fdde935a775 tempest-ProjectMemberTests-1434405994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:04:19 devstack sudo[108364]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:19 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-86ecfdd5-8f9c-49a6-9ba7-d0a351e100d7 tempest-ProjectReaderTests-916980377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a78b3973-80d6-4f33-b169-d97b10f9dc9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a78b3973-80d6-4f33-b169-d97b10f9dc9c.357f580b-8c7b-47fb-843a-d4d07cd07097 1G" returned: 0 in 0.503s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:19 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-86ecfdd5-8f9c-49a6-9ba7-d0a351e100d7 tempest-ProjectReaderTests-916980377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a78b3973-80d6-4f33-b169-d97b10f9dc9c -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a78b3973-80d6-4f33-b169-d97b10f9dc9c.357f580b-8c7b-47fb-843a-d4d07cd07097 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:19 devstack sudo[108369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a78b3973-80d6-4f33-b169-d97b10f9dc9c -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a78b3973-80d6-4f33-b169-d97b10f9dc9c.357f580b-8c7b-47fb-843a-d4d07cd07097 Sep 25 12:04:19 devstack sudo[108369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:19 devstack sudo[108369]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:19 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-86ecfdd5-8f9c-49a6-9ba7-d0a351e100d7 tempest-ProjectReaderTests-916980377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a78b3973-80d6-4f33-b169-d97b10f9dc9c -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a78b3973-80d6-4f33-b169-d97b10f9dc9c.357f580b-8c7b-47fb-843a-d4d07cd07097" returned: 0 in 0.387s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:19 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-86ecfdd5-8f9c-49a6-9ba7-d0a351e100d7 tempest-ProjectReaderTests-916980377 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a78b3973-80d6-4f33-b169-d97b10f9dc9c.357f580b-8c7b-47fb-843a-d4d07cd07097 is being set with open permissions: ugo+rw Sep 25 12:04:19 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-86ecfdd5-8f9c-49a6-9ba7-d0a351e100d7 tempest-ProjectReaderTests-916980377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a78b3973-80d6-4f33-b169-d97b10f9dc9c.357f580b-8c7b-47fb-843a-d4d07cd07097 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:19 devstack sudo[108375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a78b3973-80d6-4f33-b169-d97b10f9dc9c.357f580b-8c7b-47fb-843a-d4d07cd07097 Sep 25 12:04:19 devstack sudo[108375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:20 devstack sudo[108375]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-86ecfdd5-8f9c-49a6-9ba7-d0a351e100d7 tempest-ProjectReaderTests-916980377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a78b3973-80d6-4f33-b169-d97b10f9dc9c.357f580b-8c7b-47fb-843a-d4d07cd07097" returned: 0 in 0.316s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-86ecfdd5-8f9c-49a6-9ba7-d0a351e100d7 tempest-ProjectReaderTests-916980377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a78b3973-80d6-4f33-b169-d97b10f9dc9c.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:20 devstack sudo[108378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a78b3973-80d6-4f33-b169-d97b10f9dc9c.info Sep 25 12:04:20 devstack sudo[108378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:20 devstack sudo[108378]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-86ecfdd5-8f9c-49a6-9ba7-d0a351e100d7 tempest-ProjectReaderTests-916980377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a78b3973-80d6-4f33-b169-d97b10f9dc9c.info" returned: 0 in 0.285s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:20 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-86ecfdd5-8f9c-49a6-9ba7-d0a351e100d7 tempest-ProjectReaderTests-916980377 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a78b3973-80d6-4f33-b169-d97b10f9dc9c.info is being set with open permissions: ugo+rw Sep 25 12:04:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-86ecfdd5-8f9c-49a6-9ba7-d0a351e100d7 tempest-ProjectReaderTests-916980377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a78b3973-80d6-4f33-b169-d97b10f9dc9c.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:20 devstack sudo[108381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a78b3973-80d6-4f33-b169-d97b10f9dc9c.info Sep 25 12:04:20 devstack sudo[108381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:20 devstack sudo[108381]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-86ecfdd5-8f9c-49a6-9ba7-d0a351e100d7 tempest-ProjectReaderTests-916980377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a78b3973-80d6-4f33-b169-d97b10f9dc9c.info" returned: 0 in 0.294s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-86ecfdd5-8f9c-49a6-9ba7-d0a351e100d7 tempest-ProjectReaderTests-916980377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.306s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:04:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d83fed06-0372-416c-8f2b-2fdde935a775 tempest-ProjectMemberTests-1434405994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.747s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:04:20 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-d83fed06-0372-416c-8f2b-2fdde935a775 tempest-ProjectMemberTests-1434405994 None] Creating offline snapshot 55182a47-44dd-4cee-9bd8-f720fe298f0b of volume bad501fa-a7de-4403-9a97-2e1f10777fc9 {{(pid=86984) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 12:04:20 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-86ecfdd5-8f9c-49a6-9ba7-d0a351e100d7 tempest-ProjectReaderTests-916980377 None] Create snapshot completed successfully Sep 25 12:04:20 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf59555-53b2-409f-a08a-4721fdc3013c]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:04:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d83fed06-0372-416c-8f2b-2fdde935a775 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bad501fa-a7de-4403-9a97-2e1f10777fc9 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:21 devstack sudo[108384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bad501fa-a7de-4403-9a97-2e1f10777fc9 Sep 25 12:04:21 devstack sudo[108384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:21 devstack sudo[108384]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:21 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d83fed06-0372-416c-8f2b-2fdde935a775 tempest-ProjectMemberTests-1434405994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bad501fa-a7de-4403-9a97-2e1f10777fc9" returned: 0 in 0.450s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:21 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d83fed06-0372-416c-8f2b-2fdde935a775 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bad501fa-a7de-4403-9a97-2e1f10777fc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bad501fa-a7de-4403-9a97-2e1f10777fc9.55182a47-44dd-4cee-9bd8-f720fe298f0b 1G {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:21 devstack sudo[108390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bad501fa-a7de-4403-9a97-2e1f10777fc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bad501fa-a7de-4403-9a97-2e1f10777fc9.55182a47-44dd-4cee-9bd8-f720fe298f0b 1G Sep 25 12:04:21 devstack sudo[108390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:21 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-d560daa6-0147-4d81-8774-53efaaf77349 tempest-ProjectReaderTests-916980377 None] Acquiring lock "cinder-357f580b-8c7b-47fb-843a-d4d07cd07097-delete_snapshot" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:04:21 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-d560daa6-0147-4d81-8774-53efaaf77349 tempest-ProjectReaderTests-916980377 None] Lock "cinder-357f580b-8c7b-47fb-843a-d4d07cd07097-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:04:21 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-d560daa6-0147-4d81-8774-53efaaf77349 tempest-ProjectReaderTests-916980377 None] Acquiring lock "cinder-quobyte-a78b3973-80d6-4f33-b169-d97b10f9dc9c" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:04:21 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-d560daa6-0147-4d81-8774-53efaaf77349 tempest-ProjectReaderTests-916980377 None] Lock "cinder-quobyte-a78b3973-80d6-4f33-b169-d97b10f9dc9c" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:04:21 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-d560daa6-0147-4d81-8774-53efaaf77349 tempest-ProjectReaderTests-916980377 None] Acquiring lock "cinder-quobyte-357f580b-8c7b-47fb-843a-d4d07cd07097" by "_delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:04:21 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-d560daa6-0147-4d81-8774-53efaaf77349 tempest-ProjectReaderTests-916980377 None] Lock "cinder-quobyte-357f580b-8c7b-47fb-843a-d4d07cd07097" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:04:21 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-d560daa6-0147-4d81-8774-53efaaf77349 tempest-ProjectReaderTests-916980377 None] Deleting offline snapshot 357f580b-8c7b-47fb-843a-d4d07cd07097 of volume a78b3973-80d6-4f33-b169-d97b10f9dc9c {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 12:04:21 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-d560daa6-0147-4d81-8774-53efaaf77349 tempest-ProjectReaderTests-916980377 None] snapshot_file for this snap is: volume-a78b3973-80d6-4f33-b169-d97b10f9dc9c.357f580b-8c7b-47fb-843a-d4d07cd07097 {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 12:04:21 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[913ff918-b06a-4af7-a003-0656c520f4b4]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:04:21 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d560daa6-0147-4d81-8774-53efaaf77349 tempest-ProjectReaderTests-916980377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a78b3973-80d6-4f33-b169-d97b10f9dc9c.357f580b-8c7b-47fb-843a-d4d07cd07097 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:21 devstack sudo[108390]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:21 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d83fed06-0372-416c-8f2b-2fdde935a775 tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bad501fa-a7de-4403-9a97-2e1f10777fc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bad501fa-a7de-4403-9a97-2e1f10777fc9.55182a47-44dd-4cee-9bd8-f720fe298f0b 1G" returned: 0 in 0.656s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:21 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d83fed06-0372-416c-8f2b-2fdde935a775 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bad501fa-a7de-4403-9a97-2e1f10777fc9 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bad501fa-a7de-4403-9a97-2e1f10777fc9.55182a47-44dd-4cee-9bd8-f720fe298f0b {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:22 devstack sudo[108397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bad501fa-a7de-4403-9a97-2e1f10777fc9 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bad501fa-a7de-4403-9a97-2e1f10777fc9.55182a47-44dd-4cee-9bd8-f720fe298f0b Sep 25 12:04:22 devstack sudo[108397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:22 devstack sudo[108396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a78b3973-80d6-4f33-b169-d97b10f9dc9c.357f580b-8c7b-47fb-843a-d4d07cd07097 Sep 25 12:04:22 devstack sudo[108396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:22 devstack sudo[108396]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:22 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d560daa6-0147-4d81-8774-53efaaf77349 tempest-ProjectReaderTests-916980377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a78b3973-80d6-4f33-b169-d97b10f9dc9c.357f580b-8c7b-47fb-843a-d4d07cd07097" returned: 0 in 0.465s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:22 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-d560daa6-0147-4d81-8774-53efaaf77349 tempest-ProjectReaderTests-916980377 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a78b3973-80d6-4f33-b169-d97b10f9dc9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86984) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:04:22 devstack sudo[108397]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:22 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d83fed06-0372-416c-8f2b-2fdde935a775 tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bad501fa-a7de-4403-9a97-2e1f10777fc9 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bad501fa-a7de-4403-9a97-2e1f10777fc9.55182a47-44dd-4cee-9bd8-f720fe298f0b" returned: 0 in 0.403s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:22 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-d83fed06-0372-416c-8f2b-2fdde935a775 tempest-ProjectMemberTests-1434405994 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bad501fa-a7de-4403-9a97-2e1f10777fc9.55182a47-44dd-4cee-9bd8-f720fe298f0b is being set with open permissions: ugo+rw Sep 25 12:04:22 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d83fed06-0372-416c-8f2b-2fdde935a775 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bad501fa-a7de-4403-9a97-2e1f10777fc9.55182a47-44dd-4cee-9bd8-f720fe298f0b {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:22 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[008d0a73-1539-40d1-9fd4-400ff7ff7685]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:04:22 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d560daa6-0147-4d81-8774-53efaaf77349 tempest-ProjectReaderTests-916980377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a78b3973-80d6-4f33-b169-d97b10f9dc9c {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:22 devstack sudo[108408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bad501fa-a7de-4403-9a97-2e1f10777fc9.55182a47-44dd-4cee-9bd8-f720fe298f0b Sep 25 12:04:22 devstack sudo[108408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:22 devstack sudo[108409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a78b3973-80d6-4f33-b169-d97b10f9dc9c Sep 25 12:04:22 devstack sudo[108409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:22 devstack sudo[108408]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:22 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d83fed06-0372-416c-8f2b-2fdde935a775 tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bad501fa-a7de-4403-9a97-2e1f10777fc9.55182a47-44dd-4cee-9bd8-f720fe298f0b" returned: 0 in 0.313s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:22 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d83fed06-0372-416c-8f2b-2fdde935a775 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bad501fa-a7de-4403-9a97-2e1f10777fc9.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:22 devstack sudo[108413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bad501fa-a7de-4403-9a97-2e1f10777fc9.info Sep 25 12:04:22 devstack sudo[108413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:22 devstack sudo[108409]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:22 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d560daa6-0147-4d81-8774-53efaaf77349 tempest-ProjectReaderTests-916980377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a78b3973-80d6-4f33-b169-d97b10f9dc9c" returned: 0 in 0.500s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:22 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d560daa6-0147-4d81-8774-53efaaf77349 tempest-ProjectReaderTests-916980377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a78b3973-80d6-4f33-b169-d97b10f9dc9c.357f580b-8c7b-47fb-843a-d4d07cd07097 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:22 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddbf0693-15a0-4349-9b6b-518f817df876 tempest-ProjectReaderTests-1617660525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:04:22 devstack sudo[108418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a78b3973-80d6-4f33-b169-d97b10f9dc9c.357f580b-8c7b-47fb-843a-d4d07cd07097 Sep 25 12:04:22 devstack sudo[108418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:22 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ddbf0693-15a0-4349-9b6b-518f817df876 tempest-ProjectReaderTests-1617660525 None] Flow 'volume_create_manager' (d0ac3c08-846e-4921-a731-948532a2dc39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:04:22 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ddbf0693-15a0-4349-9b6b-518f817df876 tempest-ProjectReaderTests-1617660525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75650a27-b067-498b-a1e9-ce15187345ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:04:23 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ddbf0693-15a0-4349-9b6b-518f817df876 tempest-ProjectReaderTests-1617660525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75650a27-b067-498b-a1e9-ce15187345ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:04:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-448411183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e66c53a-c3aa-4175-8948-bfd3c83ed7cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85912b4a866d421b8fe493e363a7c16d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:04:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:04:23Z,use_quota=True,user_id='2927d38573a444b0b1809c2725177b70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:04:23 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ddbf0693-15a0-4349-9b6b-518f817df876 tempest-ProjectReaderTests-1617660525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c41e5878-3df1-402b-96b4-72bd2d913e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:04:23 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ddbf0693-15a0-4349-9b6b-518f817df876 tempest-ProjectReaderTests-1617660525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c41e5878-3df1-402b-96b4-72bd2d913e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:04:23 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ddbf0693-15a0-4349-9b6b-518f817df876 tempest-ProjectReaderTests-1617660525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b917d673-dd95-446f-9245-51024d18605c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:04:23 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ddbf0693-15a0-4349-9b6b-518f817df876 tempest-ProjectReaderTests-1617660525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b917d673-dd95-446f-9245-51024d18605c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e66c53a-c3aa-4175-8948-bfd3c83ed7cb', 'volume_name': 'volume-7e66c53a-c3aa-4175-8948-bfd3c83ed7cb', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:04:23 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ddbf0693-15a0-4349-9b6b-518f817df876 tempest-ProjectReaderTests-1617660525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dc1f1c1-8a1b-4c91-8882-82b91ff52ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:04:23 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ddbf0693-15a0-4349-9b6b-518f817df876 tempest-ProjectReaderTests-1617660525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dc1f1c1-8a1b-4c91-8882-82b91ff52ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:04:23 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ddbf0693-15a0-4349-9b6b-518f817df876 tempest-ProjectReaderTests-1617660525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed10e74a-4e13-42e9-a2c6-1cfe76981038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:04:23 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-ddbf0693-15a0-4349-9b6b-518f817df876 tempest-ProjectReaderTests-1617660525 None] Volume 7e66c53a-c3aa-4175-8948-bfd3c83ed7cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e66c53a-c3aa-4175-8948-bfd3c83ed7cb', 'volume_size': 1} Sep 25 12:04:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-ddbf0693-15a0-4349-9b6b-518f817df876 tempest-ProjectReaderTests-1617660525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:04:23 devstack sudo[108413]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d83fed06-0372-416c-8f2b-2fdde935a775 tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bad501fa-a7de-4403-9a97-2e1f10777fc9.info" returned: 0 in 0.314s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:23 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-d83fed06-0372-416c-8f2b-2fdde935a775 tempest-ProjectMemberTests-1434405994 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bad501fa-a7de-4403-9a97-2e1f10777fc9.info is being set with open permissions: ugo+rw Sep 25 12:04:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d83fed06-0372-416c-8f2b-2fdde935a775 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bad501fa-a7de-4403-9a97-2e1f10777fc9.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:23 devstack sudo[108421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bad501fa-a7de-4403-9a97-2e1f10777fc9.info Sep 25 12:04:23 devstack sudo[108421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:23 devstack sudo[108418]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d560daa6-0147-4d81-8774-53efaaf77349 tempest-ProjectReaderTests-916980377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a78b3973-80d6-4f33-b169-d97b10f9dc9c.357f580b-8c7b-47fb-843a-d4d07cd07097" returned: 0 in 0.418s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d560daa6-0147-4d81-8774-53efaaf77349 tempest-ProjectReaderTests-916980377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a78b3973-80d6-4f33-b169-d97b10f9dc9c.357f580b-8c7b-47fb-843a-d4d07cd07097 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:23 devstack sudo[108421]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d83fed06-0372-416c-8f2b-2fdde935a775 tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bad501fa-a7de-4403-9a97-2e1f10777fc9.info" returned: 0 in 0.289s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:23 devstack sudo[108427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a78b3973-80d6-4f33-b169-d97b10f9dc9c.357f580b-8c7b-47fb-843a-d4d07cd07097 Sep 25 12:04:23 devstack sudo[108427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d83fed06-0372-416c-8f2b-2fdde935a775 tempest-ProjectMemberTests-1434405994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.536s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:04:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-ddbf0693-15a0-4349-9b6b-518f817df876 tempest-ProjectReaderTests-1617660525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.331s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:04:23 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-ddbf0693-15a0-4349-9b6b-518f817df876 tempest-ProjectReaderTests-1617660525 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:04:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-448411183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e66c53a-c3aa-4175-8948-bfd3c83ed7cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85912b4a866d421b8fe493e363a7c16d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:04:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:04:23Z,use_quota=True,user_id='2927d38573a444b0b1809c2725177b70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:04:23 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-ddbf0693-15a0-4349-9b6b-518f817df876 tempest-ProjectReaderTests-1617660525 None] Creating volume 7e66c53a-c3aa-4175-8948-bfd3c83ed7cb {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:04:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-ddbf0693-15a0-4349-9b6b-518f817df876 tempest-ProjectReaderTests-1617660525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:04:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-ddbf0693-15a0-4349-9b6b-518f817df876 tempest-ProjectReaderTests-1617660525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:04:23 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-ddbf0693-15a0-4349-9b6b-518f817df876 tempest-ProjectReaderTests-1617660525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:04:23 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-ddbf0693-15a0-4349-9b6b-518f817df876 tempest-ProjectReaderTests-1617660525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:04:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-ddbf0693-15a0-4349-9b6b-518f817df876 tempest-ProjectReaderTests-1617660525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:04:23 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-ddbf0693-15a0-4349-9b6b-518f817df876 tempest-ProjectReaderTests-1617660525 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:04:23 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-ddbf0693-15a0-4349-9b6b-518f817df876 tempest-ProjectReaderTests-1617660525 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 12:04:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ddbf0693-15a0-4349-9b6b-518f817df876 tempest-ProjectReaderTests-1617660525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7e66c53a-c3aa-4175-8948-bfd3c83ed7cb 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:23 devstack sudo[108429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7e66c53a-c3aa-4175-8948-bfd3c83ed7cb 1073741824 Sep 25 12:04:23 devstack sudo[108429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:23 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-d83fed06-0372-416c-8f2b-2fdde935a775 tempest-ProjectMemberTests-1434405994 None] Create snapshot completed successfully Sep 25 12:04:23 devstack sudo[108427]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d560daa6-0147-4d81-8774-53efaaf77349 tempest-ProjectReaderTests-916980377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a78b3973-80d6-4f33-b169-d97b10f9dc9c.357f580b-8c7b-47fb-843a-d4d07cd07097" returned: 0 in 0.297s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:23 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-d560daa6-0147-4d81-8774-53efaaf77349 tempest-ProjectReaderTests-916980377 None] Lock "cinder-quobyte-357f580b-8c7b-47fb-843a-d4d07cd07097" released by "_delete_snapshot" :: held 1.834s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:04:23 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-d560daa6-0147-4d81-8774-53efaaf77349 tempest-ProjectReaderTests-916980377 None] Lock "cinder-quobyte-a78b3973-80d6-4f33-b169-d97b10f9dc9c" released by "delete_snapshot" :: held 1.873s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:04:23 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-d560daa6-0147-4d81-8774-53efaaf77349 tempest-ProjectReaderTests-916980377 None] Created reservations ['75c18702-1731-4951-90d1-c11bb2c0454e', '8e87f76c-4343-4b45-a023-4e88e8bba765', 'f311e2d1-4808-4a8c-b8b6-15ccdc7d5547', '0c7b5a09-e40d-4705-93d7-db18f13b6fa2'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:04:23 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-d560daa6-0147-4d81-8774-53efaaf77349 tempest-ProjectReaderTests-916980377 None] Delete snapshot completed successfully. Sep 25 12:04:23 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-d560daa6-0147-4d81-8774-53efaaf77349 tempest-ProjectReaderTests-916980377 None] Lock "cinder-357f580b-8c7b-47fb-843a-d4d07cd07097-delete_snapshot" released by "delete_snapshot" :: held 2.070s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:04:23 devstack sudo[108429]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:23 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ddbf0693-15a0-4349-9b6b-518f817df876 tempest-ProjectReaderTests-1617660525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7e66c53a-c3aa-4175-8948-bfd3c83ed7cb 1073741824" returned: 0 in 0.556s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:23 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-d19be72b-dc3c-4b9f-895b-9e0ae73fb9f0 tempest-ProjectReaderTests-916980377 None] Acquiring lock "cinder-a78b3973-80d6-4f33-b169-d97b10f9dc9c-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:04:24 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ddbf0693-15a0-4349-9b6b-518f817df876 tempest-ProjectReaderTests-1617660525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7e66c53a-c3aa-4175-8948-bfd3c83ed7cb {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:24 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-d19be72b-dc3c-4b9f-895b-9e0ae73fb9f0 tempest-ProjectReaderTests-916980377 None] Lock "cinder-a78b3973-80d6-4f33-b169-d97b10f9dc9c-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:04:24 devstack sudo[108437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7e66c53a-c3aa-4175-8948-bfd3c83ed7cb Sep 25 12:04:24 devstack sudo[108437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:24 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-d19be72b-dc3c-4b9f-895b-9e0ae73fb9f0 tempest-ProjectReaderTests-916980377 None] Acquiring lock "cinder-quobyte-a78b3973-80d6-4f33-b169-d97b10f9dc9c" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:04:24 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-d19be72b-dc3c-4b9f-895b-9e0ae73fb9f0 tempest-ProjectReaderTests-916980377 None] Lock "cinder-quobyte-a78b3973-80d6-4f33-b169-d97b10f9dc9c" acquired by "delete_volume" :: waited 0.018s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:04:24 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9afb819-50aa-4a3b-b3c5-e21d413bc308]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:04:24 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d19be72b-dc3c-4b9f-895b-9e0ae73fb9f0 tempest-ProjectReaderTests-916980377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a78b3973-80d6-4f33-b169-d97b10f9dc9c {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:24 devstack sudo[108439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a78b3973-80d6-4f33-b169-d97b10f9dc9c Sep 25 12:04:24 devstack sudo[108439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:24 devstack sudo[108437]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:24 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ddbf0693-15a0-4349-9b6b-518f817df876 tempest-ProjectReaderTests-1617660525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7e66c53a-c3aa-4175-8948-bfd3c83ed7cb" returned: 0 in 0.304s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:24 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-ddbf0693-15a0-4349-9b6b-518f817df876 tempest-ProjectReaderTests-1617660525 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:04:24 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-ddbf0693-15a0-4349-9b6b-518f817df876 tempest-ProjectReaderTests-1617660525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:04:24 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ddbf0693-15a0-4349-9b6b-518f817df876 tempest-ProjectReaderTests-1617660525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed10e74a-4e13-42e9-a2c6-1cfe76981038) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e66c53a-c3aa-4175-8948-bfd3c83ed7cb', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:04:24 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ddbf0693-15a0-4349-9b6b-518f817df876 tempest-ProjectReaderTests-1617660525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cdcc013-cb44-47bc-ab81-e05a6f085602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:04:24 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-ddbf0693-15a0-4349-9b6b-518f817df876 tempest-ProjectReaderTests-1617660525 None] Volume volume-7e66c53a-c3aa-4175-8948-bfd3c83ed7cb (7e66c53a-c3aa-4175-8948-bfd3c83ed7cb): created successfully Sep 25 12:04:24 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ddbf0693-15a0-4349-9b6b-518f817df876 tempest-ProjectReaderTests-1617660525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cdcc013-cb44-47bc-ab81-e05a6f085602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:04:24 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-ddbf0693-15a0-4349-9b6b-518f817df876 tempest-ProjectReaderTests-1617660525 None] Flow 'volume_create_manager' (d0ac3c08-846e-4921-a731-948532a2dc39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:04:24 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-53d50c4f-4416-4d17-93b9-81774d238b40 tempest-ProjectMemberTests-1434405994 None] Acquiring lock "cinder-55182a47-44dd-4cee-9bd8-f720fe298f0b-delete_snapshot" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:04:24 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-ddbf0693-15a0-4349-9b6b-518f817df876 tempest-ProjectReaderTests-1617660525 None] Created volume successfully. Sep 25 12:04:24 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-53d50c4f-4416-4d17-93b9-81774d238b40 tempest-ProjectMemberTests-1434405994 None] Lock "cinder-55182a47-44dd-4cee-9bd8-f720fe298f0b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:04:24 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-53d50c4f-4416-4d17-93b9-81774d238b40 tempest-ProjectMemberTests-1434405994 None] Acquiring lock "cinder-quobyte-bad501fa-a7de-4403-9a97-2e1f10777fc9" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:04:24 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-53d50c4f-4416-4d17-93b9-81774d238b40 tempest-ProjectMemberTests-1434405994 None] Lock "cinder-quobyte-bad501fa-a7de-4403-9a97-2e1f10777fc9" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:04:24 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-53d50c4f-4416-4d17-93b9-81774d238b40 tempest-ProjectMemberTests-1434405994 None] Acquiring lock "cinder-quobyte-55182a47-44dd-4cee-9bd8-f720fe298f0b" by "_delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:04:24 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-53d50c4f-4416-4d17-93b9-81774d238b40 tempest-ProjectMemberTests-1434405994 None] Lock "cinder-quobyte-55182a47-44dd-4cee-9bd8-f720fe298f0b" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:04:24 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-53d50c4f-4416-4d17-93b9-81774d238b40 tempest-ProjectMemberTests-1434405994 None] Deleting offline snapshot 55182a47-44dd-4cee-9bd8-f720fe298f0b of volume bad501fa-a7de-4403-9a97-2e1f10777fc9 {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 12:04:24 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-53d50c4f-4416-4d17-93b9-81774d238b40 tempest-ProjectMemberTests-1434405994 None] snapshot_file for this snap is: volume-bad501fa-a7de-4403-9a97-2e1f10777fc9.55182a47-44dd-4cee-9bd8-f720fe298f0b {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 12:04:24 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[147730cf-d7ed-476c-8368-4c466773b617]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:04:24 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-53d50c4f-4416-4d17-93b9-81774d238b40 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bad501fa-a7de-4403-9a97-2e1f10777fc9.55182a47-44dd-4cee-9bd8-f720fe298f0b {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:24 devstack sudo[108439]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:24 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d19be72b-dc3c-4b9f-895b-9e0ae73fb9f0 tempest-ProjectReaderTests-916980377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a78b3973-80d6-4f33-b169-d97b10f9dc9c" returned: 0 in 0.436s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:24 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d19be72b-dc3c-4b9f-895b-9e0ae73fb9f0 tempest-ProjectReaderTests-916980377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a78b3973-80d6-4f33-b169-d97b10f9dc9c {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:24 devstack sudo[108446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a78b3973-80d6-4f33-b169-d97b10f9dc9c Sep 25 12:04:24 devstack sudo[108446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:24 devstack sudo[108444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bad501fa-a7de-4403-9a97-2e1f10777fc9.55182a47-44dd-4cee-9bd8-f720fe298f0b Sep 25 12:04:24 devstack sudo[108444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:24 devstack sudo[108446]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:24 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d19be72b-dc3c-4b9f-895b-9e0ae73fb9f0 tempest-ProjectReaderTests-916980377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a78b3973-80d6-4f33-b169-d97b10f9dc9c" returned: 0 in 0.314s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:24 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-d19be72b-dc3c-4b9f-895b-9e0ae73fb9f0 tempest-ProjectReaderTests-916980377 None] Lock "cinder-quobyte-a78b3973-80d6-4f33-b169-d97b10f9dc9c" released by "delete_volume" :: held 0.833s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:04:24 devstack sudo[108444]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:24 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-53d50c4f-4416-4d17-93b9-81774d238b40 tempest-ProjectMemberTests-1434405994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bad501fa-a7de-4403-9a97-2e1f10777fc9.55182a47-44dd-4cee-9bd8-f720fe298f0b" returned: 0 in 0.432s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:24 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-53d50c4f-4416-4d17-93b9-81774d238b40 tempest-ProjectMemberTests-1434405994 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bad501fa-a7de-4403-9a97-2e1f10777fc9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86984) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:04:24 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a604f56-592e-40eb-9ee5-4f8d18e164b2]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:04:24 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-53d50c4f-4416-4d17-93b9-81774d238b40 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bad501fa-a7de-4403-9a97-2e1f10777fc9 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:25 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-d19be72b-dc3c-4b9f-895b-9e0ae73fb9f0 tempest-ProjectReaderTests-916980377 None] Created reservations ['37f009ec-3772-4b22-b84a-768619b69990', 'e33b2cef-9641-4372-997e-f49673de3616', '3fa54136-dbec-4953-a0a9-af6d499b4ab7', '35cf4b56-97e2-4e51-91ad-764926ce00ac'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:04:25 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d19be72b-dc3c-4b9f-895b-9e0ae73fb9f0 tempest-ProjectReaderTests-916980377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:04:25 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d19be72b-dc3c-4b9f-895b-9e0ae73fb9f0 tempest-ProjectReaderTests-916980377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:04:25 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-d19be72b-dc3c-4b9f-895b-9e0ae73fb9f0 tempest-ProjectReaderTests-916980377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:04:25 devstack sudo[108453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bad501fa-a7de-4403-9a97-2e1f10777fc9 Sep 25 12:04:25 devstack sudo[108453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:25 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-d19be72b-dc3c-4b9f-895b-9e0ae73fb9f0 tempest-ProjectReaderTests-916980377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:04:25 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d19be72b-dc3c-4b9f-895b-9e0ae73fb9f0 tempest-ProjectReaderTests-916980377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:04:25 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d19be72b-dc3c-4b9f-895b-9e0ae73fb9f0 tempest-ProjectReaderTests-916980377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:25 devstack sudo[108455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 12:04:25 devstack sudo[108455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:25 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-7d79d94c-9964-4f2d-9e7a-2fdb8773407a tempest-ProjectReaderTests-1617660525 None] Acquiring lock "cinder-7e66c53a-c3aa-4175-8948-bfd3c83ed7cb-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:04:25 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-7d79d94c-9964-4f2d-9e7a-2fdb8773407a tempest-ProjectReaderTests-1617660525 None] Lock "cinder-7e66c53a-c3aa-4175-8948-bfd3c83ed7cb-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:04:25 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-7d79d94c-9964-4f2d-9e7a-2fdb8773407a tempest-ProjectReaderTests-1617660525 None] Acquiring lock "cinder-quobyte-7e66c53a-c3aa-4175-8948-bfd3c83ed7cb" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:04:25 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-7d79d94c-9964-4f2d-9e7a-2fdb8773407a tempest-ProjectReaderTests-1617660525 None] Lock "cinder-quobyte-7e66c53a-c3aa-4175-8948-bfd3c83ed7cb" acquired by "delete_volume" :: waited 0.021s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:04:25 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ede560c-230d-433c-8eb4-bae026b21dae]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:04:25 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7d79d94c-9964-4f2d-9e7a-2fdb8773407a tempest-ProjectReaderTests-1617660525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7e66c53a-c3aa-4175-8948-bfd3c83ed7cb {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:25 devstack sudo[108455]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:25 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d19be72b-dc3c-4b9f-895b-9e0ae73fb9f0 tempest-ProjectReaderTests-916980377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.404s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:25 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-d19be72b-dc3c-4b9f-895b-9e0ae73fb9f0 tempest-ProjectReaderTests-916980377 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:04:25 devstack sudo[108453]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:25 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-53d50c4f-4416-4d17-93b9-81774d238b40 tempest-ProjectMemberTests-1434405994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bad501fa-a7de-4403-9a97-2e1f10777fc9" returned: 0 in 0.588s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:25 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-53d50c4f-4416-4d17-93b9-81774d238b40 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bad501fa-a7de-4403-9a97-2e1f10777fc9.55182a47-44dd-4cee-9bd8-f720fe298f0b {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:25 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-d19be72b-dc3c-4b9f-895b-9e0ae73fb9f0 tempest-ProjectReaderTests-916980377 None] Deleted volume successfully. Sep 25 12:04:25 devstack sudo[108462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bad501fa-a7de-4403-9a97-2e1f10777fc9.55182a47-44dd-4cee-9bd8-f720fe298f0b Sep 25 12:04:25 devstack sudo[108462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:25 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-d19be72b-dc3c-4b9f-895b-9e0ae73fb9f0 tempest-ProjectReaderTests-916980377 None] Lock "cinder-a78b3973-80d6-4f33-b169-d97b10f9dc9c-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:04:25 devstack sudo[108461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7e66c53a-c3aa-4175-8948-bfd3c83ed7cb Sep 25 12:04:25 devstack sudo[108461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:25 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-01bc75f3-230f-4acc-b6a9-7d33bd5c106a tempest-ProjectReaderTests-916980377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:04:25 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-01bc75f3-230f-4acc-b6a9-7d33bd5c106a tempest-ProjectReaderTests-916980377 None] Flow 'volume_create_manager' (21e230a5-a354-4b19-9de6-3006a80ea6e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:04:25 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-01bc75f3-230f-4acc-b6a9-7d33bd5c106a tempest-ProjectReaderTests-916980377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8819ba52-abba-4f90-9a28-2f583e585e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:04:25 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-01bc75f3-230f-4acc-b6a9-7d33bd5c106a tempest-ProjectReaderTests-916980377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8819ba52-abba-4f90-9a28-2f583e585e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:04:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-274597676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2450a32d-8bbb-4cc6-ad46-ece9196be4a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c665fd078654a5ca51a715d7405fe8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:04:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:04:26Z,use_quota=True,user_id='62e4ebbd017b43a7bdf4fcc690c52509',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:04:25 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-01bc75f3-230f-4acc-b6a9-7d33bd5c106a tempest-ProjectReaderTests-916980377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d11ffa1-eb66-4aea-96ed-18e7d7cfa6de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:04:25 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-01bc75f3-230f-4acc-b6a9-7d33bd5c106a tempest-ProjectReaderTests-916980377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d11ffa1-eb66-4aea-96ed-18e7d7cfa6de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:04:25 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-01bc75f3-230f-4acc-b6a9-7d33bd5c106a tempest-ProjectReaderTests-916980377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1e9f584-96d6-4a36-8fa5-50acea1303f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:04:25 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-01bc75f3-230f-4acc-b6a9-7d33bd5c106a tempest-ProjectReaderTests-916980377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1e9f584-96d6-4a36-8fa5-50acea1303f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2450a32d-8bbb-4cc6-ad46-ece9196be4a2', 'volume_name': 'volume-2450a32d-8bbb-4cc6-ad46-ece9196be4a2', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:04:26 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-01bc75f3-230f-4acc-b6a9-7d33bd5c106a tempest-ProjectReaderTests-916980377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70213136-a1f7-4f88-8ef6-15b682e2ce54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:04:26 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-01bc75f3-230f-4acc-b6a9-7d33bd5c106a tempest-ProjectReaderTests-916980377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70213136-a1f7-4f88-8ef6-15b682e2ce54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:04:26 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-01bc75f3-230f-4acc-b6a9-7d33bd5c106a tempest-ProjectReaderTests-916980377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f8f08ab-715f-41dd-a4cf-a18752b43599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:04:26 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-01bc75f3-230f-4acc-b6a9-7d33bd5c106a tempest-ProjectReaderTests-916980377 None] Volume 2450a32d-8bbb-4cc6-ad46-ece9196be4a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2450a32d-8bbb-4cc6-ad46-ece9196be4a2', 'volume_size': 1} Sep 25 12:04:26 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-01bc75f3-230f-4acc-b6a9-7d33bd5c106a tempest-ProjectReaderTests-916980377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:04:26 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-01bc75f3-230f-4acc-b6a9-7d33bd5c106a tempest-ProjectReaderTests-916980377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:04:26 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-01bc75f3-230f-4acc-b6a9-7d33bd5c106a tempest-ProjectReaderTests-916980377 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:04:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-274597676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2450a32d-8bbb-4cc6-ad46-ece9196be4a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c665fd078654a5ca51a715d7405fe8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:04:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:04:26Z,use_quota=True,user_id='62e4ebbd017b43a7bdf4fcc690c52509',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:04:26 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-01bc75f3-230f-4acc-b6a9-7d33bd5c106a tempest-ProjectReaderTests-916980377 None] Creating volume 2450a32d-8bbb-4cc6-ad46-ece9196be4a2 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:04:26 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-01bc75f3-230f-4acc-b6a9-7d33bd5c106a tempest-ProjectReaderTests-916980377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:04:26 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-01bc75f3-230f-4acc-b6a9-7d33bd5c106a tempest-ProjectReaderTests-916980377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:04:26 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-01bc75f3-230f-4acc-b6a9-7d33bd5c106a tempest-ProjectReaderTests-916980377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:04:26 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-01bc75f3-230f-4acc-b6a9-7d33bd5c106a tempest-ProjectReaderTests-916980377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:04:26 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-01bc75f3-230f-4acc-b6a9-7d33bd5c106a tempest-ProjectReaderTests-916980377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:04:26 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-01bc75f3-230f-4acc-b6a9-7d33bd5c106a tempest-ProjectReaderTests-916980377 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:04:26 devstack sudo[108462]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:26 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-01bc75f3-230f-4acc-b6a9-7d33bd5c106a tempest-ProjectReaderTests-916980377 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 12:04:26 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-01bc75f3-230f-4acc-b6a9-7d33bd5c106a tempest-ProjectReaderTests-916980377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2450a32d-8bbb-4cc6-ad46-ece9196be4a2 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:26 devstack sudo[108461]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:26 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-53d50c4f-4416-4d17-93b9-81774d238b40 tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bad501fa-a7de-4403-9a97-2e1f10777fc9.55182a47-44dd-4cee-9bd8-f720fe298f0b" returned: 0 in 0.466s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:26 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7d79d94c-9964-4f2d-9e7a-2fdb8773407a tempest-ProjectReaderTests-1617660525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7e66c53a-c3aa-4175-8948-bfd3c83ed7cb" returned: 0 in 0.517s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:26 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-53d50c4f-4416-4d17-93b9-81774d238b40 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bad501fa-a7de-4403-9a97-2e1f10777fc9.55182a47-44dd-4cee-9bd8-f720fe298f0b {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:26 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7d79d94c-9964-4f2d-9e7a-2fdb8773407a tempest-ProjectReaderTests-1617660525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7e66c53a-c3aa-4175-8948-bfd3c83ed7cb {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:26 devstack sudo[108472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2450a32d-8bbb-4cc6-ad46-ece9196be4a2 1073741824 Sep 25 12:04:26 devstack sudo[108472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:26 devstack sudo[108473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bad501fa-a7de-4403-9a97-2e1f10777fc9.55182a47-44dd-4cee-9bd8-f720fe298f0b Sep 25 12:04:26 devstack sudo[108473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:26 devstack sudo[108475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7e66c53a-c3aa-4175-8948-bfd3c83ed7cb Sep 25 12:04:26 devstack sudo[108475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:26 devstack sudo[108473]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:26 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-53d50c4f-4416-4d17-93b9-81774d238b40 tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bad501fa-a7de-4403-9a97-2e1f10777fc9.55182a47-44dd-4cee-9bd8-f720fe298f0b" returned: 0 in 0.302s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:26 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-53d50c4f-4416-4d17-93b9-81774d238b40 tempest-ProjectMemberTests-1434405994 None] Lock "cinder-quobyte-55182a47-44dd-4cee-9bd8-f720fe298f0b" released by "_delete_snapshot" :: held 1.911s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:04:26 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-53d50c4f-4416-4d17-93b9-81774d238b40 tempest-ProjectMemberTests-1434405994 None] Lock "cinder-quobyte-bad501fa-a7de-4403-9a97-2e1f10777fc9" released by "delete_snapshot" :: held 1.938s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:04:26 devstack sudo[108475]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:26 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7d79d94c-9964-4f2d-9e7a-2fdb8773407a tempest-ProjectReaderTests-1617660525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-7e66c53a-c3aa-4175-8948-bfd3c83ed7cb" returned: 0 in 0.366s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:26 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-7d79d94c-9964-4f2d-9e7a-2fdb8773407a tempest-ProjectReaderTests-1617660525 None] Lock "cinder-quobyte-7e66c53a-c3aa-4175-8948-bfd3c83ed7cb" released by "delete_volume" :: held 0.980s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:04:26 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-53d50c4f-4416-4d17-93b9-81774d238b40 tempest-ProjectMemberTests-1434405994 None] Created reservations ['abe2e4c7-dc4b-4264-9684-a88185045756', '8ce5ab12-ea49-408e-8f88-3880f91f88fb', '1236dffc-e7c1-4400-acad-e0e9f0552534', '6ac9c86f-fc16-4954-8fd6-965d9c7bd2c2'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:04:26 devstack sudo[108472]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:26 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-7d79d94c-9964-4f2d-9e7a-2fdb8773407a tempest-ProjectReaderTests-1617660525 None] Created reservations ['51e3092f-d4bc-4d39-9ff7-e4ce7f7fe486', 'e8a5b7a5-0ef6-40d5-aae0-1c8bb66dcb9b', '518a8c43-f5ad-4991-aa54-3216e541638e', '52a612e9-3e33-4177-83bc-1ec4736e9cd9'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:04:26 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-01bc75f3-230f-4acc-b6a9-7d33bd5c106a tempest-ProjectReaderTests-916980377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2450a32d-8bbb-4cc6-ad46-ece9196be4a2 1073741824" returned: 0 in 0.523s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:26 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-01bc75f3-230f-4acc-b6a9-7d33bd5c106a tempest-ProjectReaderTests-916980377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2450a32d-8bbb-4cc6-ad46-ece9196be4a2 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:26 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-53d50c4f-4416-4d17-93b9-81774d238b40 tempest-ProjectMemberTests-1434405994 None] Delete snapshot completed successfully. Sep 25 12:04:26 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-34fc71ba-f2ce-46fa-89c8-a22579348dad tempest-ProjectMemberTests-1434405994 None] Acquiring lock "cinder-bad501fa-a7de-4403-9a97-2e1f10777fc9-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:04:26 devstack sudo[108484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2450a32d-8bbb-4cc6-ad46-ece9196be4a2 Sep 25 12:04:26 devstack sudo[108484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:26 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-53d50c4f-4416-4d17-93b9-81774d238b40 tempest-ProjectMemberTests-1434405994 None] Lock "cinder-55182a47-44dd-4cee-9bd8-f720fe298f0b-delete_snapshot" released by "delete_snapshot" :: held 2.259s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:04:26 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-34fc71ba-f2ce-46fa-89c8-a22579348dad tempest-ProjectMemberTests-1434405994 None] Lock "cinder-bad501fa-a7de-4403-9a97-2e1f10777fc9-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:04:26 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-7d79d94c-9964-4f2d-9e7a-2fdb8773407a tempest-ProjectReaderTests-1617660525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:04:26 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-7d79d94c-9964-4f2d-9e7a-2fdb8773407a tempest-ProjectReaderTests-1617660525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:04:26 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-7d79d94c-9964-4f2d-9e7a-2fdb8773407a tempest-ProjectReaderTests-1617660525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:04:26 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-7d79d94c-9964-4f2d-9e7a-2fdb8773407a tempest-ProjectReaderTests-1617660525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:04:26 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-7d79d94c-9964-4f2d-9e7a-2fdb8773407a tempest-ProjectReaderTests-1617660525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:04:26 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7d79d94c-9964-4f2d-9e7a-2fdb8773407a tempest-ProjectReaderTests-1617660525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:26 devstack sudo[108486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 12:04:26 devstack sudo[108486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:26 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-34fc71ba-f2ce-46fa-89c8-a22579348dad tempest-ProjectMemberTests-1434405994 None] Acquiring lock "cinder-quobyte-bad501fa-a7de-4403-9a97-2e1f10777fc9" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:04:26 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-34fc71ba-f2ce-46fa-89c8-a22579348dad tempest-ProjectMemberTests-1434405994 None] Lock "cinder-quobyte-bad501fa-a7de-4403-9a97-2e1f10777fc9" acquired by "delete_volume" :: waited 0.027s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:04:26 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c49b4a0-0e76-4385-bccf-80b6daf025a3]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:04:26 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-34fc71ba-f2ce-46fa-89c8-a22579348dad tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bad501fa-a7de-4403-9a97-2e1f10777fc9 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:26 devstack sudo[108484]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:26 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-01bc75f3-230f-4acc-b6a9-7d33bd5c106a tempest-ProjectReaderTests-916980377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2450a32d-8bbb-4cc6-ad46-ece9196be4a2" returned: 0 in 0.348s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:26 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-01bc75f3-230f-4acc-b6a9-7d33bd5c106a tempest-ProjectReaderTests-916980377 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:04:26 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-01bc75f3-230f-4acc-b6a9-7d33bd5c106a tempest-ProjectReaderTests-916980377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:04:27 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-01bc75f3-230f-4acc-b6a9-7d33bd5c106a tempest-ProjectReaderTests-916980377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f8f08ab-715f-41dd-a4cf-a18752b43599) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2450a32d-8bbb-4cc6-ad46-ece9196be4a2', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:04:27 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-01bc75f3-230f-4acc-b6a9-7d33bd5c106a tempest-ProjectReaderTests-916980377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b912c6b4-aa52-43e9-8d85-ba9ad669fae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:04:27 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-01bc75f3-230f-4acc-b6a9-7d33bd5c106a tempest-ProjectReaderTests-916980377 None] Volume volume-2450a32d-8bbb-4cc6-ad46-ece9196be4a2 (2450a32d-8bbb-4cc6-ad46-ece9196be4a2): created successfully Sep 25 12:04:27 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-01bc75f3-230f-4acc-b6a9-7d33bd5c106a tempest-ProjectReaderTests-916980377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b912c6b4-aa52-43e9-8d85-ba9ad669fae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:04:27 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-01bc75f3-230f-4acc-b6a9-7d33bd5c106a tempest-ProjectReaderTests-916980377 None] Flow 'volume_create_manager' (21e230a5-a354-4b19-9de6-3006a80ea6e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:04:27 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-01bc75f3-230f-4acc-b6a9-7d33bd5c106a tempest-ProjectReaderTests-916980377 None] Created volume successfully. Sep 25 12:04:27 devstack sudo[108486]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:27 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7d79d94c-9964-4f2d-9e7a-2fdb8773407a tempest-ProjectReaderTests-1617660525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.334s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:27 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-7d79d94c-9964-4f2d-9e7a-2fdb8773407a tempest-ProjectReaderTests-1617660525 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:04:27 devstack sudo[108489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bad501fa-a7de-4403-9a97-2e1f10777fc9 Sep 25 12:04:27 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-7d79d94c-9964-4f2d-9e7a-2fdb8773407a tempest-ProjectReaderTests-1617660525 None] Deleted volume successfully. Sep 25 12:04:27 devstack sudo[108489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:27 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-7d79d94c-9964-4f2d-9e7a-2fdb8773407a tempest-ProjectReaderTests-1617660525 None] Lock "cinder-7e66c53a-c3aa-4175-8948-bfd3c83ed7cb-delete_volume" released by "delete_volume" :: held 1.747s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:04:27 devstack sudo[108489]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:27 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-34fc71ba-f2ce-46fa-89c8-a22579348dad tempest-ProjectMemberTests-1434405994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bad501fa-a7de-4403-9a97-2e1f10777fc9" returned: 0 in 0.466s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:27 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-34fc71ba-f2ce-46fa-89c8-a22579348dad tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bad501fa-a7de-4403-9a97-2e1f10777fc9 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:27 devstack sudo[108495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bad501fa-a7de-4403-9a97-2e1f10777fc9 Sep 25 12:04:27 devstack sudo[108495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:27 devstack sudo[108495]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:27 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-34fc71ba-f2ce-46fa-89c8-a22579348dad tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-bad501fa-a7de-4403-9a97-2e1f10777fc9" returned: 0 in 0.326s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:27 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-34fc71ba-f2ce-46fa-89c8-a22579348dad tempest-ProjectMemberTests-1434405994 None] Lock "cinder-quobyte-bad501fa-a7de-4403-9a97-2e1f10777fc9" released by "delete_volume" :: held 0.883s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:04:27 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-34fc71ba-f2ce-46fa-89c8-a22579348dad tempest-ProjectMemberTests-1434405994 None] Created reservations ['baf684a5-e4c4-4e9a-a26a-6841ecff7078', 'd8daadb0-405b-474c-b7e6-e414f2a9ddb9', 'f069b423-9bbf-4055-99f8-fc69b3019e02', '4f2eaca5-2af1-4616-9c41-eefcc35e2add'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:04:27 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-34fc71ba-f2ce-46fa-89c8-a22579348dad tempest-ProjectMemberTests-1434405994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:04:27 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-34fc71ba-f2ce-46fa-89c8-a22579348dad tempest-ProjectMemberTests-1434405994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:04:27 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-34fc71ba-f2ce-46fa-89c8-a22579348dad tempest-ProjectMemberTests-1434405994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:04:27 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-34fc71ba-f2ce-46fa-89c8-a22579348dad tempest-ProjectMemberTests-1434405994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:04:27 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-34fc71ba-f2ce-46fa-89c8-a22579348dad tempest-ProjectMemberTests-1434405994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:04:27 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-34fc71ba-f2ce-46fa-89c8-a22579348dad tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:28 devstack sudo[108499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 12:04:28 devstack sudo[108499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:28 devstack sudo[108499]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:28 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-34fc71ba-f2ce-46fa-89c8-a22579348dad tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.390s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:28 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-34fc71ba-f2ce-46fa-89c8-a22579348dad tempest-ProjectMemberTests-1434405994 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:04:28 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-34fc71ba-f2ce-46fa-89c8-a22579348dad tempest-ProjectMemberTests-1434405994 None] Deleted volume successfully. Sep 25 12:04:28 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-34fc71ba-f2ce-46fa-89c8-a22579348dad tempest-ProjectMemberTests-1434405994 None] Lock "cinder-bad501fa-a7de-4403-9a97-2e1f10777fc9-delete_volume" released by "delete_volume" :: held 1.684s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:04:28 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-7b8448e2-c268-4d1b-bb3b-92da6132c0dc tempest-ProjectReaderTests-916980377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:04:28 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-7b8448e2-c268-4d1b-bb3b-92da6132c0dc tempest-ProjectReaderTests-916980377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:04:28 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-7b8448e2-c268-4d1b-bb3b-92da6132c0dc tempest-ProjectReaderTests-916980377 None] Creating offline snapshot f2fe1617-7515-41a6-9816-e97cd1c19cd3 of volume 2450a32d-8bbb-4cc6-ad46-ece9196be4a2 {{(pid=86984) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 12:04:28 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-4689feb8-42a6-4568-a178-ac3cc56d663c tempest-ProjectReaderTests-1617660525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:04:28 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4689feb8-42a6-4568-a178-ac3cc56d663c tempest-ProjectReaderTests-1617660525 None] Flow 'volume_create_manager' (303f0ad9-395e-4a67-b2c0-8325a6c8b2bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:04:28 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4689feb8-42a6-4568-a178-ac3cc56d663c tempest-ProjectReaderTests-1617660525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a0de5a3-0174-4621-ad9f-bbf1f2236991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:04:28 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d4628e-3e8a-4f68-ac96-1a5ab825afff]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:04:28 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7b8448e2-c268-4d1b-bb3b-92da6132c0dc tempest-ProjectReaderTests-916980377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2450a32d-8bbb-4cc6-ad46-ece9196be4a2 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:28 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4689feb8-42a6-4568-a178-ac3cc56d663c tempest-ProjectReaderTests-1617660525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a0de5a3-0174-4621-ad9f-bbf1f2236991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:04:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1604873342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a23d084f-75f0-4d4e-b719-a63e0d753a4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85912b4a866d421b8fe493e363a7c16d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:04:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:04:28Z,use_quota=True,user_id='2927d38573a444b0b1809c2725177b70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:04:28 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4689feb8-42a6-4568-a178-ac3cc56d663c tempest-ProjectReaderTests-1617660525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3668fd67-9dbe-4d62-bb01-9e7e59c01e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:04:28 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4689feb8-42a6-4568-a178-ac3cc56d663c tempest-ProjectReaderTests-1617660525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3668fd67-9dbe-4d62-bb01-9e7e59c01e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:04:28 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4689feb8-42a6-4568-a178-ac3cc56d663c tempest-ProjectReaderTests-1617660525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfc194c2-a119-4590-b4d4-b468fee67a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:04:28 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4689feb8-42a6-4568-a178-ac3cc56d663c tempest-ProjectReaderTests-1617660525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfc194c2-a119-4590-b4d4-b468fee67a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a23d084f-75f0-4d4e-b719-a63e0d753a4d', 'volume_name': 'volume-a23d084f-75f0-4d4e-b719-a63e0d753a4d', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:04:28 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4689feb8-42a6-4568-a178-ac3cc56d663c tempest-ProjectReaderTests-1617660525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbcf7e38-9200-4539-815b-ac1f1fd85a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:04:28 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4689feb8-42a6-4568-a178-ac3cc56d663c tempest-ProjectReaderTests-1617660525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbcf7e38-9200-4539-815b-ac1f1fd85a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:04:28 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4689feb8-42a6-4568-a178-ac3cc56d663c tempest-ProjectReaderTests-1617660525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa84cb3b-d5b2-4165-9556-09711b6d9978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:04:28 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-4689feb8-42a6-4568-a178-ac3cc56d663c tempest-ProjectReaderTests-1617660525 None] Volume a23d084f-75f0-4d4e-b719-a63e0d753a4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a23d084f-75f0-4d4e-b719-a63e0d753a4d', 'volume_size': 1} Sep 25 12:04:28 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-4689feb8-42a6-4568-a178-ac3cc56d663c tempest-ProjectReaderTests-1617660525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:04:28 devstack sudo[108502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2450a32d-8bbb-4cc6-ad46-ece9196be4a2 Sep 25 12:04:28 devstack sudo[108502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:28 devstack sudo[108502]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:28 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7b8448e2-c268-4d1b-bb3b-92da6132c0dc tempest-ProjectReaderTests-916980377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2450a32d-8bbb-4cc6-ad46-ece9196be4a2" returned: 0 in 0.452s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:28 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7b8448e2-c268-4d1b-bb3b-92da6132c0dc tempest-ProjectReaderTests-916980377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2450a32d-8bbb-4cc6-ad46-ece9196be4a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2450a32d-8bbb-4cc6-ad46-ece9196be4a2.f2fe1617-7515-41a6-9816-e97cd1c19cd3 1G {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:29 devstack sudo[108507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2450a32d-8bbb-4cc6-ad46-ece9196be4a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2450a32d-8bbb-4cc6-ad46-ece9196be4a2.f2fe1617-7515-41a6-9816-e97cd1c19cd3 1G Sep 25 12:04:29 devstack sudo[108507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:29 devstack sudo[108507]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:29 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7b8448e2-c268-4d1b-bb3b-92da6132c0dc tempest-ProjectReaderTests-916980377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2450a32d-8bbb-4cc6-ad46-ece9196be4a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2450a32d-8bbb-4cc6-ad46-ece9196be4a2.f2fe1617-7515-41a6-9816-e97cd1c19cd3 1G" returned: 0 in 0.557s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:29 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7b8448e2-c268-4d1b-bb3b-92da6132c0dc tempest-ProjectReaderTests-916980377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2450a32d-8bbb-4cc6-ad46-ece9196be4a2 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2450a32d-8bbb-4cc6-ad46-ece9196be4a2.f2fe1617-7515-41a6-9816-e97cd1c19cd3 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:29 devstack sudo[108513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2450a32d-8bbb-4cc6-ad46-ece9196be4a2 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2450a32d-8bbb-4cc6-ad46-ece9196be4a2.f2fe1617-7515-41a6-9816-e97cd1c19cd3 Sep 25 12:04:29 devstack sudo[108513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:29 devstack cinder-volume[86984]: DEBUG dbcounter [-] [86984] Writing DB stats cinder:SELECT=151,cinder:UPDATE=174,cinder:INSERT=52,cinder:DELETE=13 {{(pid=86984) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:04:29 devstack cinder-volume[86984]: DEBUG dbcounter [-] [86984] Writing DB stats cinder:SELECT=139,cinder:UPDATE=194,cinder:INSERT=46,cinder:DELETE=17 {{(pid=86984) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:04:29 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-d56cf71d-3e4b-4b68-a5cb-917dda7241b0 tempest-ProjectMemberTests-1434405994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:04:29 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d56cf71d-3e4b-4b68-a5cb-917dda7241b0 tempest-ProjectMemberTests-1434405994 None] Flow 'volume_create_manager' (70991bba-b774-4577-887b-fca5a63a7d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:04:29 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d56cf71d-3e4b-4b68-a5cb-917dda7241b0 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fd9242a-4b38-4c94-ba08-ac41e430874a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:04:29 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d56cf71d-3e4b-4b68-a5cb-917dda7241b0 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fd9242a-4b38-4c94-ba08-ac41e430874a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:04:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1710599787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=251a9aa6-7496-4639-9209-78ee557e7d9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c75afeac65f84f13b7d0325fa4b21b65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:04:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:04:30Z,use_quota=True,user_id='770f7e0a81074bae8bcd048c8d7f7347',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:04:29 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d56cf71d-3e4b-4b68-a5cb-917dda7241b0 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47f6891c-8ab3-4807-bf87-30d9bb82f3fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:04:29 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d56cf71d-3e4b-4b68-a5cb-917dda7241b0 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47f6891c-8ab3-4807-bf87-30d9bb82f3fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:04:29 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d56cf71d-3e4b-4b68-a5cb-917dda7241b0 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27f34ca3-ab8b-4a3e-9854-16decbd10498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:04:29 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d56cf71d-3e4b-4b68-a5cb-917dda7241b0 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27f34ca3-ab8b-4a3e-9854-16decbd10498) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '251a9aa6-7496-4639-9209-78ee557e7d9f', 'volume_name': 'volume-251a9aa6-7496-4639-9209-78ee557e7d9f', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:04:29 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d56cf71d-3e4b-4b68-a5cb-917dda7241b0 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ec110d0-7c18-4604-b4af-1f78eb25dab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:04:29 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d56cf71d-3e4b-4b68-a5cb-917dda7241b0 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ec110d0-7c18-4604-b4af-1f78eb25dab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:04:29 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d56cf71d-3e4b-4b68-a5cb-917dda7241b0 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07a2925e-6e6c-458a-acaf-8129880ceb86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:04:29 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-d56cf71d-3e4b-4b68-a5cb-917dda7241b0 tempest-ProjectMemberTests-1434405994 None] Volume 251a9aa6-7496-4639-9209-78ee557e7d9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-251a9aa6-7496-4639-9209-78ee557e7d9f', 'volume_size': 1} Sep 25 12:04:29 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d56cf71d-3e4b-4b68-a5cb-917dda7241b0 tempest-ProjectMemberTests-1434405994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:04:29 devstack sudo[108513]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:29 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7b8448e2-c268-4d1b-bb3b-92da6132c0dc tempest-ProjectReaderTests-916980377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2450a32d-8bbb-4cc6-ad46-ece9196be4a2 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2450a32d-8bbb-4cc6-ad46-ece9196be4a2.f2fe1617-7515-41a6-9816-e97cd1c19cd3" returned: 0 in 0.345s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:29 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-7b8448e2-c268-4d1b-bb3b-92da6132c0dc tempest-ProjectReaderTests-916980377 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2450a32d-8bbb-4cc6-ad46-ece9196be4a2.f2fe1617-7515-41a6-9816-e97cd1c19cd3 is being set with open permissions: ugo+rw Sep 25 12:04:29 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7b8448e2-c268-4d1b-bb3b-92da6132c0dc tempest-ProjectReaderTests-916980377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2450a32d-8bbb-4cc6-ad46-ece9196be4a2.f2fe1617-7515-41a6-9816-e97cd1c19cd3 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:29 devstack sudo[108518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2450a32d-8bbb-4cc6-ad46-ece9196be4a2.f2fe1617-7515-41a6-9816-e97cd1c19cd3 Sep 25 12:04:29 devstack sudo[108518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:30 devstack sudo[108518]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:30 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7b8448e2-c268-4d1b-bb3b-92da6132c0dc tempest-ProjectReaderTests-916980377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2450a32d-8bbb-4cc6-ad46-ece9196be4a2.f2fe1617-7515-41a6-9816-e97cd1c19cd3" returned: 0 in 0.258s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:30 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7b8448e2-c268-4d1b-bb3b-92da6132c0dc tempest-ProjectReaderTests-916980377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2450a32d-8bbb-4cc6-ad46-ece9196be4a2.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:30 devstack sudo[108521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2450a32d-8bbb-4cc6-ad46-ece9196be4a2.info Sep 25 12:04:30 devstack sudo[108521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:30 devstack sudo[108521]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:30 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7b8448e2-c268-4d1b-bb3b-92da6132c0dc tempest-ProjectReaderTests-916980377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2450a32d-8bbb-4cc6-ad46-ece9196be4a2.info" returned: 0 in 0.284s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:30 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-7b8448e2-c268-4d1b-bb3b-92da6132c0dc tempest-ProjectReaderTests-916980377 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2450a32d-8bbb-4cc6-ad46-ece9196be4a2.info is being set with open permissions: ugo+rw Sep 25 12:04:30 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7b8448e2-c268-4d1b-bb3b-92da6132c0dc tempest-ProjectReaderTests-916980377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2450a32d-8bbb-4cc6-ad46-ece9196be4a2.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:30 devstack sudo[108526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2450a32d-8bbb-4cc6-ad46-ece9196be4a2.info Sep 25 12:04:30 devstack sudo[108526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:30 devstack sudo[108526]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:30 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-7b8448e2-c268-4d1b-bb3b-92da6132c0dc tempest-ProjectReaderTests-916980377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2450a32d-8bbb-4cc6-ad46-ece9196be4a2.info" returned: 0 in 0.251s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:30 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-7b8448e2-c268-4d1b-bb3b-92da6132c0dc tempest-ProjectReaderTests-916980377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.274s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:04:30 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-4689feb8-42a6-4568-a178-ac3cc56d663c tempest-ProjectReaderTests-1617660525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.118s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:04:30 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-4689feb8-42a6-4568-a178-ac3cc56d663c tempest-ProjectReaderTests-1617660525 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:04:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1604873342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a23d084f-75f0-4d4e-b719-a63e0d753a4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85912b4a866d421b8fe493e363a7c16d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:04:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:04:28Z,use_quota=True,user_id='2927d38573a444b0b1809c2725177b70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:04:30 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-4689feb8-42a6-4568-a178-ac3cc56d663c tempest-ProjectReaderTests-1617660525 None] Creating volume a23d084f-75f0-4d4e-b719-a63e0d753a4d {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:04:30 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-4689feb8-42a6-4568-a178-ac3cc56d663c tempest-ProjectReaderTests-1617660525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:04:30 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-4689feb8-42a6-4568-a178-ac3cc56d663c tempest-ProjectReaderTests-1617660525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:04:30 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-4689feb8-42a6-4568-a178-ac3cc56d663c tempest-ProjectReaderTests-1617660525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:04:30 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-4689feb8-42a6-4568-a178-ac3cc56d663c tempest-ProjectReaderTests-1617660525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:04:30 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-4689feb8-42a6-4568-a178-ac3cc56d663c tempest-ProjectReaderTests-1617660525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:04:30 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-4689feb8-42a6-4568-a178-ac3cc56d663c tempest-ProjectReaderTests-1617660525 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:04:30 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-4689feb8-42a6-4568-a178-ac3cc56d663c tempest-ProjectReaderTests-1617660525 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 12:04:30 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-4689feb8-42a6-4568-a178-ac3cc56d663c tempest-ProjectReaderTests-1617660525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a23d084f-75f0-4d4e-b719-a63e0d753a4d 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:30 devstack sudo[108529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a23d084f-75f0-4d4e-b719-a63e0d753a4d 1073741824 Sep 25 12:04:30 devstack sudo[108529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:30 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-7b8448e2-c268-4d1b-bb3b-92da6132c0dc tempest-ProjectReaderTests-916980377 None] Create snapshot completed successfully Sep 25 12:04:31 devstack sudo[108529]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:31 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-4689feb8-42a6-4568-a178-ac3cc56d663c tempest-ProjectReaderTests-1617660525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a23d084f-75f0-4d4e-b719-a63e0d753a4d 1073741824" returned: 0 in 0.475s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:31 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-4689feb8-42a6-4568-a178-ac3cc56d663c tempest-ProjectReaderTests-1617660525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a23d084f-75f0-4d4e-b719-a63e0d753a4d {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:31 devstack sudo[108534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a23d084f-75f0-4d4e-b719-a63e0d753a4d Sep 25 12:04:31 devstack sudo[108534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:31 devstack sudo[108534]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:31 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-4689feb8-42a6-4568-a178-ac3cc56d663c tempest-ProjectReaderTests-1617660525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a23d084f-75f0-4d4e-b719-a63e0d753a4d" returned: 0 in 0.291s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:31 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-4689feb8-42a6-4568-a178-ac3cc56d663c tempest-ProjectReaderTests-1617660525 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:04:31 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-4689feb8-42a6-4568-a178-ac3cc56d663c tempest-ProjectReaderTests-1617660525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:04:31 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d56cf71d-3e4b-4b68-a5cb-917dda7241b0 tempest-ProjectMemberTests-1434405994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.823s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:04:31 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-d56cf71d-3e4b-4b68-a5cb-917dda7241b0 tempest-ProjectMemberTests-1434405994 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:04:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1710599787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=251a9aa6-7496-4639-9209-78ee557e7d9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c75afeac65f84f13b7d0325fa4b21b65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:04:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:04:30Z,use_quota=True,user_id='770f7e0a81074bae8bcd048c8d7f7347',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:04:31 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-d56cf71d-3e4b-4b68-a5cb-917dda7241b0 tempest-ProjectMemberTests-1434405994 None] Creating volume 251a9aa6-7496-4639-9209-78ee557e7d9f {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:04:31 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d56cf71d-3e4b-4b68-a5cb-917dda7241b0 tempest-ProjectMemberTests-1434405994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:04:31 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d56cf71d-3e4b-4b68-a5cb-917dda7241b0 tempest-ProjectMemberTests-1434405994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:04:31 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-d56cf71d-3e4b-4b68-a5cb-917dda7241b0 tempest-ProjectMemberTests-1434405994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:04:31 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-d56cf71d-3e4b-4b68-a5cb-917dda7241b0 tempest-ProjectMemberTests-1434405994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:04:31 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d56cf71d-3e4b-4b68-a5cb-917dda7241b0 tempest-ProjectMemberTests-1434405994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:04:31 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-d56cf71d-3e4b-4b68-a5cb-917dda7241b0 tempest-ProjectMemberTests-1434405994 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:04:31 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-d56cf71d-3e4b-4b68-a5cb-917dda7241b0 tempest-ProjectMemberTests-1434405994 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 12:04:31 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d56cf71d-3e4b-4b68-a5cb-917dda7241b0 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-251a9aa6-7496-4639-9209-78ee557e7d9f 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:31 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-1e59582d-c972-4651-bd87-553aa02df982 tempest-ProjectReaderTests-916980377 None] Acquiring lock "cinder-f2fe1617-7515-41a6-9816-e97cd1c19cd3-delete_snapshot" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:04:31 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4689feb8-42a6-4568-a178-ac3cc56d663c tempest-ProjectReaderTests-1617660525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa84cb3b-d5b2-4165-9556-09711b6d9978) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a23d084f-75f0-4d4e-b719-a63e0d753a4d', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:04:31 devstack sudo[108537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-251a9aa6-7496-4639-9209-78ee557e7d9f 1073741824 Sep 25 12:04:31 devstack sudo[108537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:31 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4689feb8-42a6-4568-a178-ac3cc56d663c tempest-ProjectReaderTests-1617660525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (578529b3-aa70-44b1-a479-6d3dfc26bc7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:04:31 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-1e59582d-c972-4651-bd87-553aa02df982 tempest-ProjectReaderTests-916980377 None] Lock "cinder-f2fe1617-7515-41a6-9816-e97cd1c19cd3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:04:31 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-1e59582d-c972-4651-bd87-553aa02df982 tempest-ProjectReaderTests-916980377 None] Acquiring lock "cinder-quobyte-2450a32d-8bbb-4cc6-ad46-ece9196be4a2" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:04:31 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-4689feb8-42a6-4568-a178-ac3cc56d663c tempest-ProjectReaderTests-1617660525 None] Volume volume-a23d084f-75f0-4d4e-b719-a63e0d753a4d (a23d084f-75f0-4d4e-b719-a63e0d753a4d): created successfully Sep 25 12:04:31 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4689feb8-42a6-4568-a178-ac3cc56d663c tempest-ProjectReaderTests-1617660525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (578529b3-aa70-44b1-a479-6d3dfc26bc7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:04:31 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4689feb8-42a6-4568-a178-ac3cc56d663c tempest-ProjectReaderTests-1617660525 None] Flow 'volume_create_manager' (303f0ad9-395e-4a67-b2c0-8325a6c8b2bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:04:31 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-1e59582d-c972-4651-bd87-553aa02df982 tempest-ProjectReaderTests-916980377 None] Lock "cinder-quobyte-2450a32d-8bbb-4cc6-ad46-ece9196be4a2" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:04:31 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-1e59582d-c972-4651-bd87-553aa02df982 tempest-ProjectReaderTests-916980377 None] Acquiring lock "cinder-quobyte-f2fe1617-7515-41a6-9816-e97cd1c19cd3" by "_delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:04:31 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-4689feb8-42a6-4568-a178-ac3cc56d663c tempest-ProjectReaderTests-1617660525 None] Created volume successfully. Sep 25 12:04:31 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-1e59582d-c972-4651-bd87-553aa02df982 tempest-ProjectReaderTests-916980377 None] Lock "cinder-quobyte-f2fe1617-7515-41a6-9816-e97cd1c19cd3" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:04:31 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-1e59582d-c972-4651-bd87-553aa02df982 tempest-ProjectReaderTests-916980377 None] Deleting offline snapshot f2fe1617-7515-41a6-9816-e97cd1c19cd3 of volume 2450a32d-8bbb-4cc6-ad46-ece9196be4a2 {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 12:04:31 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-1e59582d-c972-4651-bd87-553aa02df982 tempest-ProjectReaderTests-916980377 None] snapshot_file for this snap is: volume-2450a32d-8bbb-4cc6-ad46-ece9196be4a2.f2fe1617-7515-41a6-9816-e97cd1c19cd3 {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 12:04:31 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba5db26-a2a7-4042-91c5-e760e4928207]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:04:31 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-1e59582d-c972-4651-bd87-553aa02df982 tempest-ProjectReaderTests-916980377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2450a32d-8bbb-4cc6-ad46-ece9196be4a2.f2fe1617-7515-41a6-9816-e97cd1c19cd3 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:31 devstack sudo[108539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2450a32d-8bbb-4cc6-ad46-ece9196be4a2.f2fe1617-7515-41a6-9816-e97cd1c19cd3 Sep 25 12:04:31 devstack sudo[108539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:32 devstack sudo[108537]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:32 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d56cf71d-3e4b-4b68-a5cb-917dda7241b0 tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-251a9aa6-7496-4639-9209-78ee557e7d9f 1073741824" returned: 0 in 0.538s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:32 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d56cf71d-3e4b-4b68-a5cb-917dda7241b0 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-251a9aa6-7496-4639-9209-78ee557e7d9f {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:32 devstack sudo[108548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-251a9aa6-7496-4639-9209-78ee557e7d9f Sep 25 12:04:32 devstack sudo[108548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:32 devstack sudo[108539]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:32 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-1e59582d-c972-4651-bd87-553aa02df982 tempest-ProjectReaderTests-916980377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2450a32d-8bbb-4cc6-ad46-ece9196be4a2.f2fe1617-7515-41a6-9816-e97cd1c19cd3" returned: 0 in 0.460s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:32 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-1e59582d-c972-4651-bd87-553aa02df982 tempest-ProjectReaderTests-916980377 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2450a32d-8bbb-4cc6-ad46-ece9196be4a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86984) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:04:32 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[18694b69-ea35-4d51-a4eb-e6fa2ae99bc5]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:04:32 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-1e59582d-c972-4651-bd87-553aa02df982 tempest-ProjectReaderTests-916980377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2450a32d-8bbb-4cc6-ad46-ece9196be4a2 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:32 devstack sudo[108550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2450a32d-8bbb-4cc6-ad46-ece9196be4a2 Sep 25 12:04:32 devstack sudo[108550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:32 devstack sudo[108548]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:32 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d56cf71d-3e4b-4b68-a5cb-917dda7241b0 tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-251a9aa6-7496-4639-9209-78ee557e7d9f" returned: 0 in 0.294s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:32 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-d56cf71d-3e4b-4b68-a5cb-917dda7241b0 tempest-ProjectMemberTests-1434405994 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:04:32 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d56cf71d-3e4b-4b68-a5cb-917dda7241b0 tempest-ProjectMemberTests-1434405994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:04:32 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d56cf71d-3e4b-4b68-a5cb-917dda7241b0 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07a2925e-6e6c-458a-acaf-8129880ceb86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-251a9aa6-7496-4639-9209-78ee557e7d9f', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:04:32 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d56cf71d-3e4b-4b68-a5cb-917dda7241b0 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca147463-279b-4ee6-87e1-a1f73bc85fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:04:32 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-d56cf71d-3e4b-4b68-a5cb-917dda7241b0 tempest-ProjectMemberTests-1434405994 None] Volume volume-251a9aa6-7496-4639-9209-78ee557e7d9f (251a9aa6-7496-4639-9209-78ee557e7d9f): created successfully Sep 25 12:04:32 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d56cf71d-3e4b-4b68-a5cb-917dda7241b0 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca147463-279b-4ee6-87e1-a1f73bc85fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:04:32 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d56cf71d-3e4b-4b68-a5cb-917dda7241b0 tempest-ProjectMemberTests-1434405994 None] Flow 'volume_create_manager' (70991bba-b774-4577-887b-fca5a63a7d11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:04:32 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-d56cf71d-3e4b-4b68-a5cb-917dda7241b0 tempest-ProjectMemberTests-1434405994 None] Created volume successfully. Sep 25 12:04:32 devstack sudo[108550]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:32 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-1e59582d-c972-4651-bd87-553aa02df982 tempest-ProjectReaderTests-916980377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2450a32d-8bbb-4cc6-ad46-ece9196be4a2" returned: 0 in 0.465s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:32 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-1e59582d-c972-4651-bd87-553aa02df982 tempest-ProjectReaderTests-916980377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2450a32d-8bbb-4cc6-ad46-ece9196be4a2.f2fe1617-7515-41a6-9816-e97cd1c19cd3 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:32 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e414d5e9-3d65-4ed6-a130-d9f6a13016d4 tempest-ProjectReaderTests-1617660525 None] Acquiring lock "cinder-a23d084f-75f0-4d4e-b719-a63e0d753a4d-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:04:32 devstack sudo[108556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2450a32d-8bbb-4cc6-ad46-ece9196be4a2.f2fe1617-7515-41a6-9816-e97cd1c19cd3 Sep 25 12:04:32 devstack sudo[108556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:32 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e414d5e9-3d65-4ed6-a130-d9f6a13016d4 tempest-ProjectReaderTests-1617660525 None] Lock "cinder-a23d084f-75f0-4d4e-b719-a63e0d753a4d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:04:32 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e414d5e9-3d65-4ed6-a130-d9f6a13016d4 tempest-ProjectReaderTests-1617660525 None] Acquiring lock "cinder-quobyte-a23d084f-75f0-4d4e-b719-a63e0d753a4d" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:04:32 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e414d5e9-3d65-4ed6-a130-d9f6a13016d4 tempest-ProjectReaderTests-1617660525 None] Lock "cinder-quobyte-a23d084f-75f0-4d4e-b719-a63e0d753a4d" acquired by "delete_volume" :: waited 0.022s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:04:32 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1a7b7b-b442-4fa7-b3f7-dee0f7b33a4d]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:04:32 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e414d5e9-3d65-4ed6-a130-d9f6a13016d4 tempest-ProjectReaderTests-1617660525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a23d084f-75f0-4d4e-b719-a63e0d753a4d {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:33 devstack sudo[108558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a23d084f-75f0-4d4e-b719-a63e0d753a4d Sep 25 12:04:33 devstack sudo[108558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:33 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-78955190-b760-49fc-b809-1e709654c19b tempest-ProjectMemberTests-1434405994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:04:33 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-78955190-b760-49fc-b809-1e709654c19b tempest-ProjectMemberTests-1434405994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:04:33 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-78955190-b760-49fc-b809-1e709654c19b tempest-ProjectMemberTests-1434405994 None] Creating offline snapshot 24bf82e5-3990-4ee8-9809-ca45f210f8e2 of volume 251a9aa6-7496-4639-9209-78ee557e7d9f {{(pid=86984) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 12:04:33 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb74ccd5-eeed-4d29-a839-2ae82c35fc91]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:04:33 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-78955190-b760-49fc-b809-1e709654c19b tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-251a9aa6-7496-4639-9209-78ee557e7d9f {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:33 devstack sudo[108556]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:33 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-1e59582d-c972-4651-bd87-553aa02df982 tempest-ProjectReaderTests-916980377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2450a32d-8bbb-4cc6-ad46-ece9196be4a2.f2fe1617-7515-41a6-9816-e97cd1c19cd3" returned: 0 in 0.541s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:33 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-1e59582d-c972-4651-bd87-553aa02df982 tempest-ProjectReaderTests-916980377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2450a32d-8bbb-4cc6-ad46-ece9196be4a2.f2fe1617-7515-41a6-9816-e97cd1c19cd3 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:33 devstack sudo[108563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-251a9aa6-7496-4639-9209-78ee557e7d9f Sep 25 12:04:33 devstack sudo[108563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:33 devstack sudo[108564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2450a32d-8bbb-4cc6-ad46-ece9196be4a2.f2fe1617-7515-41a6-9816-e97cd1c19cd3 Sep 25 12:04:33 devstack sudo[108564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:33 devstack sudo[108558]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:33 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e414d5e9-3d65-4ed6-a130-d9f6a13016d4 tempest-ProjectReaderTests-1617660525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a23d084f-75f0-4d4e-b719-a63e0d753a4d" returned: 0 in 0.476s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:33 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e414d5e9-3d65-4ed6-a130-d9f6a13016d4 tempest-ProjectReaderTests-1617660525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a23d084f-75f0-4d4e-b719-a63e0d753a4d {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:33 devstack sudo[108570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a23d084f-75f0-4d4e-b719-a63e0d753a4d Sep 25 12:04:33 devstack sudo[108570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:33 devstack sudo[108563]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:33 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-78955190-b760-49fc-b809-1e709654c19b tempest-ProjectMemberTests-1434405994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-251a9aa6-7496-4639-9209-78ee557e7d9f" returned: 0 in 0.476s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:33 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-78955190-b760-49fc-b809-1e709654c19b tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-251a9aa6-7496-4639-9209-78ee557e7d9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-251a9aa6-7496-4639-9209-78ee557e7d9f.24bf82e5-3990-4ee8-9809-ca45f210f8e2 1G {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:33 devstack sudo[108564]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:33 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-1e59582d-c972-4651-bd87-553aa02df982 tempest-ProjectReaderTests-916980377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2450a32d-8bbb-4cc6-ad46-ece9196be4a2.f2fe1617-7515-41a6-9816-e97cd1c19cd3" returned: 0 in 0.358s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:33 devstack sudo[108576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-251a9aa6-7496-4639-9209-78ee557e7d9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-251a9aa6-7496-4639-9209-78ee557e7d9f.24bf82e5-3990-4ee8-9809-ca45f210f8e2 1G Sep 25 12:04:33 devstack sudo[108576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:33 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-1e59582d-c972-4651-bd87-553aa02df982 tempest-ProjectReaderTests-916980377 None] Lock "cinder-quobyte-f2fe1617-7515-41a6-9816-e97cd1c19cd3" released by "_delete_snapshot" :: held 1.972s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:04:33 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-1e59582d-c972-4651-bd87-553aa02df982 tempest-ProjectReaderTests-916980377 None] Lock "cinder-quobyte-2450a32d-8bbb-4cc6-ad46-ece9196be4a2" released by "delete_snapshot" :: held 2.010s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:04:33 devstack sudo[108570]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:33 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e414d5e9-3d65-4ed6-a130-d9f6a13016d4 tempest-ProjectReaderTests-1617660525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-a23d084f-75f0-4d4e-b719-a63e0d753a4d" returned: 0 in 0.311s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:33 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e414d5e9-3d65-4ed6-a130-d9f6a13016d4 tempest-ProjectReaderTests-1617660525 None] Lock "cinder-quobyte-a23d084f-75f0-4d4e-b719-a63e0d753a4d" released by "delete_volume" :: held 0.859s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:04:33 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-1e59582d-c972-4651-bd87-553aa02df982 tempest-ProjectReaderTests-916980377 None] Created reservations ['c4fd8113-e1a8-45a3-b97b-3364a199b864', 'a11b0a7a-6d09-4429-8021-4637a3b88b50', '872e7b46-3db0-413e-bf5e-e54e534bbde5', '7b80b0b6-f769-4638-b07f-906fc18f8c72'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:04:33 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-e414d5e9-3d65-4ed6-a130-d9f6a13016d4 tempest-ProjectReaderTests-1617660525 None] Created reservations ['79277b89-99d7-4aa6-aff2-de230ba40538', 'f43462a5-5c5b-4bfd-801e-2c4fc22e12e3', 'fd7450f8-4f9e-4119-b983-7638ba974a87', 'a025d226-32a7-43b6-8012-51361a000a6f'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:04:33 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-1e59582d-c972-4651-bd87-553aa02df982 tempest-ProjectReaderTests-916980377 None] Delete snapshot completed successfully. Sep 25 12:04:33 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-1e59582d-c972-4651-bd87-553aa02df982 tempest-ProjectReaderTests-916980377 None] Lock "cinder-f2fe1617-7515-41a6-9816-e97cd1c19cd3-delete_snapshot" released by "delete_snapshot" :: held 2.318s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:04:33 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-e414d5e9-3d65-4ed6-a130-d9f6a13016d4 tempest-ProjectReaderTests-1617660525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:04:33 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-e414d5e9-3d65-4ed6-a130-d9f6a13016d4 tempest-ProjectReaderTests-1617660525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:04:33 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-e414d5e9-3d65-4ed6-a130-d9f6a13016d4 tempest-ProjectReaderTests-1617660525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:04:33 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-e414d5e9-3d65-4ed6-a130-d9f6a13016d4 tempest-ProjectReaderTests-1617660525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:04:33 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-e414d5e9-3d65-4ed6-a130-d9f6a13016d4 tempest-ProjectReaderTests-1617660525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:04:33 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e414d5e9-3d65-4ed6-a130-d9f6a13016d4 tempest-ProjectReaderTests-1617660525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:34 devstack sudo[108583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 12:04:34 devstack sudo[108583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:34 devstack sudo[108576]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:34 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-78955190-b760-49fc-b809-1e709654c19b tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-251a9aa6-7496-4639-9209-78ee557e7d9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-251a9aa6-7496-4639-9209-78ee557e7d9f.24bf82e5-3990-4ee8-9809-ca45f210f8e2 1G" returned: 0 in 0.602s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:34 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-78955190-b760-49fc-b809-1e709654c19b tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-251a9aa6-7496-4639-9209-78ee557e7d9f -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-251a9aa6-7496-4639-9209-78ee557e7d9f.24bf82e5-3990-4ee8-9809-ca45f210f8e2 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:34 devstack sudo[108587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-251a9aa6-7496-4639-9209-78ee557e7d9f -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-251a9aa6-7496-4639-9209-78ee557e7d9f.24bf82e5-3990-4ee8-9809-ca45f210f8e2 Sep 25 12:04:34 devstack sudo[108587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:34 devstack sudo[108583]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:34 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e414d5e9-3d65-4ed6-a130-d9f6a13016d4 tempest-ProjectReaderTests-1617660525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.337s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:34 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-e414d5e9-3d65-4ed6-a130-d9f6a13016d4 tempest-ProjectReaderTests-1617660525 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:04:34 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-e414d5e9-3d65-4ed6-a130-d9f6a13016d4 tempest-ProjectReaderTests-1617660525 None] Deleted volume successfully. Sep 25 12:04:34 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e414d5e9-3d65-4ed6-a130-d9f6a13016d4 tempest-ProjectReaderTests-1617660525 None] Lock "cinder-a23d084f-75f0-4d4e-b719-a63e0d753a4d-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:04:34 devstack sudo[108587]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:34 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-78955190-b760-49fc-b809-1e709654c19b tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-251a9aa6-7496-4639-9209-78ee557e7d9f -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-251a9aa6-7496-4639-9209-78ee557e7d9f.24bf82e5-3990-4ee8-9809-ca45f210f8e2" returned: 0 in 0.361s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:34 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-78955190-b760-49fc-b809-1e709654c19b tempest-ProjectMemberTests-1434405994 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-251a9aa6-7496-4639-9209-78ee557e7d9f.24bf82e5-3990-4ee8-9809-ca45f210f8e2 is being set with open permissions: ugo+rw Sep 25 12:04:34 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-78955190-b760-49fc-b809-1e709654c19b tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-251a9aa6-7496-4639-9209-78ee557e7d9f.24bf82e5-3990-4ee8-9809-ca45f210f8e2 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:34 devstack sudo[108593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-251a9aa6-7496-4639-9209-78ee557e7d9f.24bf82e5-3990-4ee8-9809-ca45f210f8e2 Sep 25 12:04:34 devstack sudo[108593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:34 devstack sudo[108593]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:34 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-78955190-b760-49fc-b809-1e709654c19b tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-251a9aa6-7496-4639-9209-78ee557e7d9f.24bf82e5-3990-4ee8-9809-ca45f210f8e2" returned: 0 in 0.262s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:34 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-78955190-b760-49fc-b809-1e709654c19b tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-251a9aa6-7496-4639-9209-78ee557e7d9f.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:34 devstack sudo[108596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-251a9aa6-7496-4639-9209-78ee557e7d9f.info Sep 25 12:04:34 devstack sudo[108596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:34 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e645e986-cc6d-498d-ae8a-c627a48608a0 tempest-ProjectReaderTests-916980377 None] Acquiring lock "cinder-2450a32d-8bbb-4cc6-ad46-ece9196be4a2-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:04:34 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e645e986-cc6d-498d-ae8a-c627a48608a0 tempest-ProjectReaderTests-916980377 None] Lock "cinder-2450a32d-8bbb-4cc6-ad46-ece9196be4a2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:04:34 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e645e986-cc6d-498d-ae8a-c627a48608a0 tempest-ProjectReaderTests-916980377 None] Acquiring lock "cinder-quobyte-2450a32d-8bbb-4cc6-ad46-ece9196be4a2" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:04:35 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e645e986-cc6d-498d-ae8a-c627a48608a0 tempest-ProjectReaderTests-916980377 None] Lock "cinder-quobyte-2450a32d-8bbb-4cc6-ad46-ece9196be4a2" acquired by "delete_volume" :: waited 0.018s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:04:35 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff66c78b-4636-47d9-9b2d-d176cf38d2dd]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:04:35 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e645e986-cc6d-498d-ae8a-c627a48608a0 tempest-ProjectReaderTests-916980377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2450a32d-8bbb-4cc6-ad46-ece9196be4a2 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:35 devstack sudo[108598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2450a32d-8bbb-4cc6-ad46-ece9196be4a2 Sep 25 12:04:35 devstack sudo[108598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:35 devstack sudo[108596]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:35 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-78955190-b760-49fc-b809-1e709654c19b tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-251a9aa6-7496-4639-9209-78ee557e7d9f.info" returned: 0 in 0.405s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:35 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-78955190-b760-49fc-b809-1e709654c19b tempest-ProjectMemberTests-1434405994 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-251a9aa6-7496-4639-9209-78ee557e7d9f.info is being set with open permissions: ugo+rw Sep 25 12:04:35 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-78955190-b760-49fc-b809-1e709654c19b tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-251a9aa6-7496-4639-9209-78ee557e7d9f.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:35 devstack sudo[108601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-251a9aa6-7496-4639-9209-78ee557e7d9f.info Sep 25 12:04:35 devstack sudo[108601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:35 devstack sudo[108598]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:35 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e645e986-cc6d-498d-ae8a-c627a48608a0 tempest-ProjectReaderTests-916980377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2450a32d-8bbb-4cc6-ad46-ece9196be4a2" returned: 0 in 0.482s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:35 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e645e986-cc6d-498d-ae8a-c627a48608a0 tempest-ProjectReaderTests-916980377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2450a32d-8bbb-4cc6-ad46-ece9196be4a2 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:35 devstack sudo[108607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2450a32d-8bbb-4cc6-ad46-ece9196be4a2 Sep 25 12:04:35 devstack sudo[108607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:35 devstack sudo[108601]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:35 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-78955190-b760-49fc-b809-1e709654c19b tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-251a9aa6-7496-4639-9209-78ee557e7d9f.info" returned: 0 in 0.340s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:35 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-78955190-b760-49fc-b809-1e709654c19b tempest-ProjectMemberTests-1434405994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.555s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:04:35 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-78955190-b760-49fc-b809-1e709654c19b tempest-ProjectMemberTests-1434405994 None] Create snapshot completed successfully Sep 25 12:04:35 devstack sudo[108607]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:35 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e645e986-cc6d-498d-ae8a-c627a48608a0 tempest-ProjectReaderTests-916980377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-2450a32d-8bbb-4cc6-ad46-ece9196be4a2" returned: 0 in 0.308s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:35 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e645e986-cc6d-498d-ae8a-c627a48608a0 tempest-ProjectReaderTests-916980377 None] Lock "cinder-quobyte-2450a32d-8bbb-4cc6-ad46-ece9196be4a2" released by "delete_volume" :: held 0.881s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:04:35 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-e645e986-cc6d-498d-ae8a-c627a48608a0 tempest-ProjectReaderTests-916980377 None] Created reservations ['a4c95062-0ebf-4e58-bd7f-75e4cde183ae', 'd357c527-f242-4334-b090-f932189b0c4a', '81fa8a42-e1b3-45ab-94d2-34c060b9703c', '05345801-2b72-45be-9f75-98c92d700b9e'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:04:36 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-e645e986-cc6d-498d-ae8a-c627a48608a0 tempest-ProjectReaderTests-916980377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:04:36 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-e645e986-cc6d-498d-ae8a-c627a48608a0 tempest-ProjectReaderTests-916980377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:04:36 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-e645e986-cc6d-498d-ae8a-c627a48608a0 tempest-ProjectReaderTests-916980377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:04:36 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-e645e986-cc6d-498d-ae8a-c627a48608a0 tempest-ProjectReaderTests-916980377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:04:36 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-e645e986-cc6d-498d-ae8a-c627a48608a0 tempest-ProjectReaderTests-916980377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:04:36 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e645e986-cc6d-498d-ae8a-c627a48608a0 tempest-ProjectReaderTests-916980377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:36 devstack sudo[108610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 12:04:36 devstack sudo[108610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:36 devstack sudo[108610]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:36 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-6810f39f-0851-4fc2-a7af-5d1ee075499e tempest-ProjectMemberTests-1434405994 None] Acquiring lock "cinder-24bf82e5-3990-4ee8-9809-ca45f210f8e2-delete_snapshot" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:04:36 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e645e986-cc6d-498d-ae8a-c627a48608a0 tempest-ProjectReaderTests-916980377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.316s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:36 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-e645e986-cc6d-498d-ae8a-c627a48608a0 tempest-ProjectReaderTests-916980377 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:04:36 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-e645e986-cc6d-498d-ae8a-c627a48608a0 tempest-ProjectReaderTests-916980377 None] Deleted volume successfully. Sep 25 12:04:36 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-6810f39f-0851-4fc2-a7af-5d1ee075499e tempest-ProjectMemberTests-1434405994 None] Lock "cinder-24bf82e5-3990-4ee8-9809-ca45f210f8e2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:04:36 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-6810f39f-0851-4fc2-a7af-5d1ee075499e tempest-ProjectMemberTests-1434405994 None] Acquiring lock "cinder-quobyte-251a9aa6-7496-4639-9209-78ee557e7d9f" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:04:36 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-6810f39f-0851-4fc2-a7af-5d1ee075499e tempest-ProjectMemberTests-1434405994 None] Lock "cinder-quobyte-251a9aa6-7496-4639-9209-78ee557e7d9f" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:04:36 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-6810f39f-0851-4fc2-a7af-5d1ee075499e tempest-ProjectMemberTests-1434405994 None] Acquiring lock "cinder-quobyte-24bf82e5-3990-4ee8-9809-ca45f210f8e2" by "_delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:04:36 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-e645e986-cc6d-498d-ae8a-c627a48608a0 tempest-ProjectReaderTests-916980377 None] Lock "cinder-2450a32d-8bbb-4cc6-ad46-ece9196be4a2-delete_volume" released by "delete_volume" :: held 1.483s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:04:36 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-6810f39f-0851-4fc2-a7af-5d1ee075499e tempest-ProjectMemberTests-1434405994 None] Lock "cinder-quobyte-24bf82e5-3990-4ee8-9809-ca45f210f8e2" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:04:36 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-6810f39f-0851-4fc2-a7af-5d1ee075499e tempest-ProjectMemberTests-1434405994 None] Deleting offline snapshot 24bf82e5-3990-4ee8-9809-ca45f210f8e2 of volume 251a9aa6-7496-4639-9209-78ee557e7d9f {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 12:04:36 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-6810f39f-0851-4fc2-a7af-5d1ee075499e tempest-ProjectMemberTests-1434405994 None] snapshot_file for this snap is: volume-251a9aa6-7496-4639-9209-78ee557e7d9f.24bf82e5-3990-4ee8-9809-ca45f210f8e2 {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 12:04:36 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[78237217-0c38-4293-9018-d60039b6ac35]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:04:36 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6810f39f-0851-4fc2-a7af-5d1ee075499e tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-251a9aa6-7496-4639-9209-78ee557e7d9f.24bf82e5-3990-4ee8-9809-ca45f210f8e2 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:36 devstack sudo[108613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-251a9aa6-7496-4639-9209-78ee557e7d9f.24bf82e5-3990-4ee8-9809-ca45f210f8e2 Sep 25 12:04:36 devstack sudo[108613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:36 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-0de3a049-2103-4294-b323-23f37858d417 tempest-ProjectReaderTests-916980377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:04:36 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-0de3a049-2103-4294-b323-23f37858d417 tempest-ProjectReaderTests-916980377 None] Flow 'volume_create_manager' (9386ae7f-ea32-4460-945e-e265f7f95d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:04:36 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-0de3a049-2103-4294-b323-23f37858d417 tempest-ProjectReaderTests-916980377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c499ea6f-a112-4331-8f7f-f0593ec8847e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:04:36 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-0de3a049-2103-4294-b323-23f37858d417 tempest-ProjectReaderTests-916980377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c499ea6f-a112-4331-8f7f-f0593ec8847e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:04:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-441546242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07b7fac3-3da6-4363-afbf-43ece8db99da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c665fd078654a5ca51a715d7405fe8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:04:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:04:37Z,use_quota=True,user_id='62e4ebbd017b43a7bdf4fcc690c52509',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:04:36 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-0de3a049-2103-4294-b323-23f37858d417 tempest-ProjectReaderTests-916980377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44ea2789-f840-474a-843a-4816cd62688d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:04:36 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-0de3a049-2103-4294-b323-23f37858d417 tempest-ProjectReaderTests-916980377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44ea2789-f840-474a-843a-4816cd62688d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:04:36 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-0de3a049-2103-4294-b323-23f37858d417 tempest-ProjectReaderTests-916980377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f1e4a9c-a609-4a71-ac6b-5f7850a639de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:04:36 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-0de3a049-2103-4294-b323-23f37858d417 tempest-ProjectReaderTests-916980377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f1e4a9c-a609-4a71-ac6b-5f7850a639de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07b7fac3-3da6-4363-afbf-43ece8db99da', 'volume_name': 'volume-07b7fac3-3da6-4363-afbf-43ece8db99da', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:04:36 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-0de3a049-2103-4294-b323-23f37858d417 tempest-ProjectReaderTests-916980377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da8f4574-6fcd-4105-b41f-add8551f1949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:04:36 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-0de3a049-2103-4294-b323-23f37858d417 tempest-ProjectReaderTests-916980377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da8f4574-6fcd-4105-b41f-add8551f1949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:04:36 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-0de3a049-2103-4294-b323-23f37858d417 tempest-ProjectReaderTests-916980377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6ae7bd7-29f8-47e9-8f95-5b2ea88cd9ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:04:36 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-0de3a049-2103-4294-b323-23f37858d417 tempest-ProjectReaderTests-916980377 None] Volume 07b7fac3-3da6-4363-afbf-43ece8db99da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07b7fac3-3da6-4363-afbf-43ece8db99da', 'volume_size': 1} Sep 25 12:04:36 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-0de3a049-2103-4294-b323-23f37858d417 tempest-ProjectReaderTests-916980377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:04:36 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-0de3a049-2103-4294-b323-23f37858d417 tempest-ProjectReaderTests-916980377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:04:36 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-0de3a049-2103-4294-b323-23f37858d417 tempest-ProjectReaderTests-916980377 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:04:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-441546242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07b7fac3-3da6-4363-afbf-43ece8db99da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c665fd078654a5ca51a715d7405fe8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:04:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:04:37Z,use_quota=True,user_id='62e4ebbd017b43a7bdf4fcc690c52509',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:04:36 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-0de3a049-2103-4294-b323-23f37858d417 tempest-ProjectReaderTests-916980377 None] Creating volume 07b7fac3-3da6-4363-afbf-43ece8db99da {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:04:36 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-0de3a049-2103-4294-b323-23f37858d417 tempest-ProjectReaderTests-916980377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:04:36 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-0de3a049-2103-4294-b323-23f37858d417 tempest-ProjectReaderTests-916980377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:04:36 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-0de3a049-2103-4294-b323-23f37858d417 tempest-ProjectReaderTests-916980377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:04:36 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-0de3a049-2103-4294-b323-23f37858d417 tempest-ProjectReaderTests-916980377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:04:36 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-0de3a049-2103-4294-b323-23f37858d417 tempest-ProjectReaderTests-916980377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:04:36 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-0de3a049-2103-4294-b323-23f37858d417 tempest-ProjectReaderTests-916980377 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:04:36 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-0de3a049-2103-4294-b323-23f37858d417 tempest-ProjectReaderTests-916980377 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 12:04:36 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-0de3a049-2103-4294-b323-23f37858d417 tempest-ProjectReaderTests-916980377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07b7fac3-3da6-4363-afbf-43ece8db99da 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:36 devstack sudo[108615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07b7fac3-3da6-4363-afbf-43ece8db99da 1073741824 Sep 25 12:04:36 devstack sudo[108615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:37 devstack sudo[108613]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:37 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6810f39f-0851-4fc2-a7af-5d1ee075499e tempest-ProjectMemberTests-1434405994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-251a9aa6-7496-4639-9209-78ee557e7d9f.24bf82e5-3990-4ee8-9809-ca45f210f8e2" returned: 0 in 0.516s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:37 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-6810f39f-0851-4fc2-a7af-5d1ee075499e tempest-ProjectMemberTests-1434405994 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-251a9aa6-7496-4639-9209-78ee557e7d9f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86984) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:04:37 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[8815f212-e89a-4b2a-b3e7-a02beee3b464]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:04:37 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6810f39f-0851-4fc2-a7af-5d1ee075499e tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-251a9aa6-7496-4639-9209-78ee557e7d9f {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:37 devstack sudo[108620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-251a9aa6-7496-4639-9209-78ee557e7d9f Sep 25 12:04:37 devstack sudo[108620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:37 devstack sudo[108615]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:37 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-0de3a049-2103-4294-b323-23f37858d417 tempest-ProjectReaderTests-916980377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07b7fac3-3da6-4363-afbf-43ece8db99da 1073741824" returned: 0 in 0.569s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:37 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-0de3a049-2103-4294-b323-23f37858d417 tempest-ProjectReaderTests-916980377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07b7fac3-3da6-4363-afbf-43ece8db99da {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:37 devstack sudo[108630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07b7fac3-3da6-4363-afbf-43ece8db99da Sep 25 12:04:37 devstack sudo[108630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:37 devstack sudo[108620]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:37 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6810f39f-0851-4fc2-a7af-5d1ee075499e tempest-ProjectMemberTests-1434405994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-251a9aa6-7496-4639-9209-78ee557e7d9f" returned: 0 in 0.464s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:37 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6810f39f-0851-4fc2-a7af-5d1ee075499e tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-251a9aa6-7496-4639-9209-78ee557e7d9f.24bf82e5-3990-4ee8-9809-ca45f210f8e2 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:37 devstack sudo[108632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-251a9aa6-7496-4639-9209-78ee557e7d9f.24bf82e5-3990-4ee8-9809-ca45f210f8e2 Sep 25 12:04:37 devstack sudo[108632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:37 devstack sudo[108630]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:37 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-0de3a049-2103-4294-b323-23f37858d417 tempest-ProjectReaderTests-916980377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07b7fac3-3da6-4363-afbf-43ece8db99da" returned: 0 in 0.285s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:37 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-0de3a049-2103-4294-b323-23f37858d417 tempest-ProjectReaderTests-916980377 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:04:37 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-0de3a049-2103-4294-b323-23f37858d417 tempest-ProjectReaderTests-916980377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:04:37 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-0de3a049-2103-4294-b323-23f37858d417 tempest-ProjectReaderTests-916980377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6ae7bd7-29f8-47e9-8f95-5b2ea88cd9ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07b7fac3-3da6-4363-afbf-43ece8db99da', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:04:37 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-0de3a049-2103-4294-b323-23f37858d417 tempest-ProjectReaderTests-916980377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e26d1d31-40e9-47ff-a21e-8792ba80da0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:04:37 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-0de3a049-2103-4294-b323-23f37858d417 tempest-ProjectReaderTests-916980377 None] Volume volume-07b7fac3-3da6-4363-afbf-43ece8db99da (07b7fac3-3da6-4363-afbf-43ece8db99da): created successfully Sep 25 12:04:37 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-0de3a049-2103-4294-b323-23f37858d417 tempest-ProjectReaderTests-916980377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e26d1d31-40e9-47ff-a21e-8792ba80da0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:04:37 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-0de3a049-2103-4294-b323-23f37858d417 tempest-ProjectReaderTests-916980377 None] Flow 'volume_create_manager' (9386ae7f-ea32-4460-945e-e265f7f95d26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:04:37 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-0de3a049-2103-4294-b323-23f37858d417 tempest-ProjectReaderTests-916980377 None] Created volume successfully. Sep 25 12:04:37 devstack sudo[108632]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:37 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6810f39f-0851-4fc2-a7af-5d1ee075499e tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-251a9aa6-7496-4639-9209-78ee557e7d9f.24bf82e5-3990-4ee8-9809-ca45f210f8e2" returned: 0 in 0.414s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:37 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6810f39f-0851-4fc2-a7af-5d1ee075499e tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-251a9aa6-7496-4639-9209-78ee557e7d9f.24bf82e5-3990-4ee8-9809-ca45f210f8e2 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:37 devstack sudo[108638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-251a9aa6-7496-4639-9209-78ee557e7d9f.24bf82e5-3990-4ee8-9809-ca45f210f8e2 Sep 25 12:04:37 devstack sudo[108638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:38 devstack sudo[108638]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6810f39f-0851-4fc2-a7af-5d1ee075499e tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-251a9aa6-7496-4639-9209-78ee557e7d9f.24bf82e5-3990-4ee8-9809-ca45f210f8e2" returned: 0 in 0.265s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:38 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-6810f39f-0851-4fc2-a7af-5d1ee075499e tempest-ProjectMemberTests-1434405994 None] Lock "cinder-quobyte-24bf82e5-3990-4ee8-9809-ca45f210f8e2" released by "_delete_snapshot" :: held 1.812s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:04:38 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-6810f39f-0851-4fc2-a7af-5d1ee075499e tempest-ProjectMemberTests-1434405994 None] Lock "cinder-quobyte-251a9aa6-7496-4639-9209-78ee557e7d9f" released by "delete_snapshot" :: held 1.846s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:04:38 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-6810f39f-0851-4fc2-a7af-5d1ee075499e tempest-ProjectMemberTests-1434405994 None] Created reservations ['3411ee9a-1850-43d3-80f1-d015caf1a05c', '18852dcc-5e82-4d14-877e-463ed1ae65d0', '802e4cb6-4c81-4bbb-a3db-e10731ee74c2', 'aeddb3c6-6897-48d6-8e0f-ad644cf733ae'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:04:38 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-6810f39f-0851-4fc2-a7af-5d1ee075499e tempest-ProjectMemberTests-1434405994 None] Delete snapshot completed successfully. Sep 25 12:04:38 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-6810f39f-0851-4fc2-a7af-5d1ee075499e tempest-ProjectMemberTests-1434405994 None] Lock "cinder-24bf82e5-3990-4ee8-9809-ca45f210f8e2-delete_snapshot" released by "delete_snapshot" :: held 2.034s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:04:38 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-0b1db56f-ba89-4481-9e98-d80cc320fb6f tempest-ProjectMemberTests-1434405994 None] Acquiring lock "cinder-251a9aa6-7496-4639-9209-78ee557e7d9f-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:04:38 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-0b1db56f-ba89-4481-9e98-d80cc320fb6f tempest-ProjectMemberTests-1434405994 None] Lock "cinder-251a9aa6-7496-4639-9209-78ee557e7d9f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:04:38 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-0b1db56f-ba89-4481-9e98-d80cc320fb6f tempest-ProjectMemberTests-1434405994 None] Acquiring lock "cinder-quobyte-251a9aa6-7496-4639-9209-78ee557e7d9f" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:04:38 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-0b1db56f-ba89-4481-9e98-d80cc320fb6f tempest-ProjectMemberTests-1434405994 None] Lock "cinder-quobyte-251a9aa6-7496-4639-9209-78ee557e7d9f" acquired by "delete_volume" :: waited 0.018s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:04:38 devstack cinder-volume[86984]: DEBUG oslo_service.periodic_task [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:04:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:04:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:04:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:04:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:04:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:04:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:38 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[649fb4e4-e2bc-48e0-b454-9844a9c0bf65]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:04:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-0b1db56f-ba89-4481-9e98-d80cc320fb6f tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-251a9aa6-7496-4639-9209-78ee557e7d9f {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:38 devstack sudo[108641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 12:04:38 devstack sudo[108641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:38 devstack sudo[108642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-251a9aa6-7496-4639-9209-78ee557e7d9f Sep 25 12:04:38 devstack sudo[108642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-76fca710-efc7-4729-895e-3ef26e4add31 tempest-ProjectReaderTests-916980377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:04:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-76fca710-efc7-4729-895e-3ef26e4add31 tempest-ProjectReaderTests-916980377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:04:39 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-76fca710-efc7-4729-895e-3ef26e4add31 tempest-ProjectReaderTests-916980377 None] Creating offline snapshot c51e2068-b162-4cd8-86b6-5badd32475e1 of volume 07b7fac3-3da6-4363-afbf-43ece8db99da {{(pid=86984) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 12:04:39 devstack sudo[108641]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.360s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:39 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:04:39 devstack cinder-volume[86984]: DEBUG oslo_service.periodic_task [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running periodic task VolumeManager._thread_info {{(pid=86984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:04:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] thread count: 28 {{(pid=86984) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 12:04:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] thread info: [<_MainThread(MainThread, started 132046492332160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86984) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 12:04:39 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[68601db9-9d34-471a-9947-cc14e38c1d0d]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:04:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-76fca710-efc7-4729-895e-3ef26e4add31 tempest-ProjectReaderTests-916980377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07b7fac3-3da6-4363-afbf-43ece8db99da {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:39 devstack sudo[108642]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-0b1db56f-ba89-4481-9e98-d80cc320fb6f tempest-ProjectMemberTests-1434405994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-251a9aa6-7496-4639-9209-78ee557e7d9f" returned: 0 in 0.433s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-0b1db56f-ba89-4481-9e98-d80cc320fb6f tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-251a9aa6-7496-4639-9209-78ee557e7d9f {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:39 devstack sudo[108650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-251a9aa6-7496-4639-9209-78ee557e7d9f Sep 25 12:04:39 devstack sudo[108650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:39 devstack sudo[108648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07b7fac3-3da6-4363-afbf-43ece8db99da Sep 25 12:04:39 devstack sudo[108648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:39 devstack sudo[108650]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-0b1db56f-ba89-4481-9e98-d80cc320fb6f tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-251a9aa6-7496-4639-9209-78ee557e7d9f" returned: 0 in 0.295s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:39 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-0b1db56f-ba89-4481-9e98-d80cc320fb6f tempest-ProjectMemberTests-1434405994 None] Lock "cinder-quobyte-251a9aa6-7496-4639-9209-78ee557e7d9f" released by "delete_volume" :: held 0.824s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:04:39 devstack sudo[108648]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-76fca710-efc7-4729-895e-3ef26e4add31 tempest-ProjectReaderTests-916980377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07b7fac3-3da6-4363-afbf-43ece8db99da" returned: 0 in 0.414s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-76fca710-efc7-4729-895e-3ef26e4add31 tempest-ProjectReaderTests-916980377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07b7fac3-3da6-4363-afbf-43ece8db99da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07b7fac3-3da6-4363-afbf-43ece8db99da.c51e2068-b162-4cd8-86b6-5badd32475e1 1G {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:39 devstack sudo[108657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07b7fac3-3da6-4363-afbf-43ece8db99da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07b7fac3-3da6-4363-afbf-43ece8db99da.c51e2068-b162-4cd8-86b6-5badd32475e1 1G Sep 25 12:04:39 devstack sudo[108657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:39 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-0b1db56f-ba89-4481-9e98-d80cc320fb6f tempest-ProjectMemberTests-1434405994 None] Created reservations ['7a6d7b01-42ca-4ecc-8d6a-7d7710ddf209', 'bfe3521e-4a48-4c70-b22b-1de2a25deafd', '3ac69998-b174-4f88-aa7f-94c8c122b5e3', '74f0c045-a030-44dc-a200-9be9a8cdfcdc'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:04:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-0b1db56f-ba89-4481-9e98-d80cc320fb6f tempest-ProjectMemberTests-1434405994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:04:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-0b1db56f-ba89-4481-9e98-d80cc320fb6f tempest-ProjectMemberTests-1434405994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:04:39 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-0b1db56f-ba89-4481-9e98-d80cc320fb6f tempest-ProjectMemberTests-1434405994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:04:39 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-0b1db56f-ba89-4481-9e98-d80cc320fb6f tempest-ProjectMemberTests-1434405994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:04:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-0b1db56f-ba89-4481-9e98-d80cc320fb6f tempest-ProjectMemberTests-1434405994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:04:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-0b1db56f-ba89-4481-9e98-d80cc320fb6f tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:39 devstack sudo[108659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 12:04:39 devstack sudo[108659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:40 devstack sudo[108659]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:40 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-0b1db56f-ba89-4481-9e98-d80cc320fb6f tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.333s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:40 devstack sudo[108657]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:40 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-0b1db56f-ba89-4481-9e98-d80cc320fb6f tempest-ProjectMemberTests-1434405994 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:04:40 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-76fca710-efc7-4729-895e-3ef26e4add31 tempest-ProjectReaderTests-916980377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07b7fac3-3da6-4363-afbf-43ece8db99da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07b7fac3-3da6-4363-afbf-43ece8db99da.c51e2068-b162-4cd8-86b6-5badd32475e1 1G" returned: 0 in 0.504s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:40 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-76fca710-efc7-4729-895e-3ef26e4add31 tempest-ProjectReaderTests-916980377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07b7fac3-3da6-4363-afbf-43ece8db99da -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07b7fac3-3da6-4363-afbf-43ece8db99da.c51e2068-b162-4cd8-86b6-5badd32475e1 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:40 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-0b1db56f-ba89-4481-9e98-d80cc320fb6f tempest-ProjectMemberTests-1434405994 None] Deleted volume successfully. Sep 25 12:04:40 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-0b1db56f-ba89-4481-9e98-d80cc320fb6f tempest-ProjectMemberTests-1434405994 None] Lock "cinder-251a9aa6-7496-4639-9209-78ee557e7d9f-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:04:40 devstack sudo[108668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07b7fac3-3da6-4363-afbf-43ece8db99da -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07b7fac3-3da6-4363-afbf-43ece8db99da.c51e2068-b162-4cd8-86b6-5badd32475e1 Sep 25 12:04:40 devstack sudo[108668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:40 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6c04243-418a-4807-b77d-04c976bac3f6 tempest-ProjectMemberTests-1434405994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:04:40 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e6c04243-418a-4807-b77d-04c976bac3f6 tempest-ProjectMemberTests-1434405994 None] Flow 'volume_create_manager' (b8bd21d4-e476-4a25-af30-25f589500ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:04:40 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e6c04243-418a-4807-b77d-04c976bac3f6 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15bbbf2a-ef07-4f72-b79d-60e61625b646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:04:40 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e6c04243-418a-4807-b77d-04c976bac3f6 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15bbbf2a-ef07-4f72-b79d-60e61625b646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:04:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1097462947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00153808-ef7d-4742-ad16-36b5e744c656,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c75afeac65f84f13b7d0325fa4b21b65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:04:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:04:40Z,use_quota=True,user_id='770f7e0a81074bae8bcd048c8d7f7347',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:04:40 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e6c04243-418a-4807-b77d-04c976bac3f6 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11153b71-7e8c-4c54-831b-d7d1aa1cc64b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:04:40 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e6c04243-418a-4807-b77d-04c976bac3f6 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11153b71-7e8c-4c54-831b-d7d1aa1cc64b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:04:40 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e6c04243-418a-4807-b77d-04c976bac3f6 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de7ad3fc-f04c-4eed-ba71-af6cce1c5be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:04:40 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e6c04243-418a-4807-b77d-04c976bac3f6 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de7ad3fc-f04c-4eed-ba71-af6cce1c5be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00153808-ef7d-4742-ad16-36b5e744c656', 'volume_name': 'volume-00153808-ef7d-4742-ad16-36b5e744c656', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:04:40 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e6c04243-418a-4807-b77d-04c976bac3f6 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4de98dc-5c24-459f-b54f-a54f3f294d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:04:40 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e6c04243-418a-4807-b77d-04c976bac3f6 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4de98dc-5c24-459f-b54f-a54f3f294d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:04:40 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e6c04243-418a-4807-b77d-04c976bac3f6 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6588fe0e-18ba-4dce-8c79-0ac7c617fd48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:04:40 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-e6c04243-418a-4807-b77d-04c976bac3f6 tempest-ProjectMemberTests-1434405994 None] Volume 00153808-ef7d-4742-ad16-36b5e744c656: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00153808-ef7d-4742-ad16-36b5e744c656', 'volume_size': 1} Sep 25 12:04:40 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-e6c04243-418a-4807-b77d-04c976bac3f6 tempest-ProjectMemberTests-1434405994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:04:40 devstack sudo[108668]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:40 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-76fca710-efc7-4729-895e-3ef26e4add31 tempest-ProjectReaderTests-916980377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07b7fac3-3da6-4363-afbf-43ece8db99da -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07b7fac3-3da6-4363-afbf-43ece8db99da.c51e2068-b162-4cd8-86b6-5badd32475e1" returned: 0 in 0.370s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:40 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-76fca710-efc7-4729-895e-3ef26e4add31 tempest-ProjectReaderTests-916980377 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07b7fac3-3da6-4363-afbf-43ece8db99da.c51e2068-b162-4cd8-86b6-5badd32475e1 is being set with open permissions: ugo+rw Sep 25 12:04:40 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-76fca710-efc7-4729-895e-3ef26e4add31 tempest-ProjectReaderTests-916980377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07b7fac3-3da6-4363-afbf-43ece8db99da.c51e2068-b162-4cd8-86b6-5badd32475e1 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:40 devstack sudo[108676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07b7fac3-3da6-4363-afbf-43ece8db99da.c51e2068-b162-4cd8-86b6-5badd32475e1 Sep 25 12:04:40 devstack sudo[108676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:40 devstack sudo[108676]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:40 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-76fca710-efc7-4729-895e-3ef26e4add31 tempest-ProjectReaderTests-916980377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07b7fac3-3da6-4363-afbf-43ece8db99da.c51e2068-b162-4cd8-86b6-5badd32475e1" returned: 0 in 0.256s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:40 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-76fca710-efc7-4729-895e-3ef26e4add31 tempest-ProjectReaderTests-916980377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07b7fac3-3da6-4363-afbf-43ece8db99da.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:40 devstack sudo[108679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07b7fac3-3da6-4363-afbf-43ece8db99da.info Sep 25 12:04:40 devstack sudo[108679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:40 devstack sudo[108679]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:40 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-76fca710-efc7-4729-895e-3ef26e4add31 tempest-ProjectReaderTests-916980377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07b7fac3-3da6-4363-afbf-43ece8db99da.info" returned: 0 in 0.283s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:40 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-76fca710-efc7-4729-895e-3ef26e4add31 tempest-ProjectReaderTests-916980377 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07b7fac3-3da6-4363-afbf-43ece8db99da.info is being set with open permissions: ugo+rw Sep 25 12:04:40 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-76fca710-efc7-4729-895e-3ef26e4add31 tempest-ProjectReaderTests-916980377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07b7fac3-3da6-4363-afbf-43ece8db99da.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:40 devstack sudo[108682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07b7fac3-3da6-4363-afbf-43ece8db99da.info Sep 25 12:04:40 devstack sudo[108682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:41 devstack sudo[108682]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-76fca710-efc7-4729-895e-3ef26e4add31 tempest-ProjectReaderTests-916980377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07b7fac3-3da6-4363-afbf-43ece8db99da.info" returned: 0 in 0.262s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-76fca710-efc7-4729-895e-3ef26e4add31 tempest-ProjectReaderTests-916980377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.192s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:04:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-e6c04243-418a-4807-b77d-04c976bac3f6 tempest-ProjectMemberTests-1434405994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.875s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:04:41 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-e6c04243-418a-4807-b77d-04c976bac3f6 tempest-ProjectMemberTests-1434405994 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:04:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1097462947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00153808-ef7d-4742-ad16-36b5e744c656,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c75afeac65f84f13b7d0325fa4b21b65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:04:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:04:40Z,use_quota=True,user_id='770f7e0a81074bae8bcd048c8d7f7347',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:04:41 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-e6c04243-418a-4807-b77d-04c976bac3f6 tempest-ProjectMemberTests-1434405994 None] Creating volume 00153808-ef7d-4742-ad16-36b5e744c656 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:04:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-e6c04243-418a-4807-b77d-04c976bac3f6 tempest-ProjectMemberTests-1434405994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:04:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-e6c04243-418a-4807-b77d-04c976bac3f6 tempest-ProjectMemberTests-1434405994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:04:41 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-e6c04243-418a-4807-b77d-04c976bac3f6 tempest-ProjectMemberTests-1434405994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:04:41 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-e6c04243-418a-4807-b77d-04c976bac3f6 tempest-ProjectMemberTests-1434405994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:04:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-e6c04243-418a-4807-b77d-04c976bac3f6 tempest-ProjectMemberTests-1434405994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:04:41 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-e6c04243-418a-4807-b77d-04c976bac3f6 tempest-ProjectMemberTests-1434405994 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:04:41 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-e6c04243-418a-4807-b77d-04c976bac3f6 tempest-ProjectMemberTests-1434405994 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 12:04:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e6c04243-418a-4807-b77d-04c976bac3f6 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-00153808-ef7d-4742-ad16-36b5e744c656 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:41 devstack sudo[108685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-00153808-ef7d-4742-ad16-36b5e744c656 1073741824 Sep 25 12:04:41 devstack sudo[108685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:41 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-76fca710-efc7-4729-895e-3ef26e4add31 tempest-ProjectReaderTests-916980377 None] Create snapshot completed successfully Sep 25 12:04:41 devstack sudo[108685]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e6c04243-418a-4807-b77d-04c976bac3f6 tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-00153808-ef7d-4742-ad16-36b5e744c656 1073741824" returned: 0 in 0.443s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e6c04243-418a-4807-b77d-04c976bac3f6 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-00153808-ef7d-4742-ad16-36b5e744c656 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:41 devstack sudo[108690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-00153808-ef7d-4742-ad16-36b5e744c656 Sep 25 12:04:41 devstack sudo[108690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:42 devstack sudo[108690]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:42 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e6c04243-418a-4807-b77d-04c976bac3f6 tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-00153808-ef7d-4742-ad16-36b5e744c656" returned: 0 in 0.266s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:42 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-e6c04243-418a-4807-b77d-04c976bac3f6 tempest-ProjectMemberTests-1434405994 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:04:42 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-e6c04243-418a-4807-b77d-04c976bac3f6 tempest-ProjectMemberTests-1434405994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:04:42 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e6c04243-418a-4807-b77d-04c976bac3f6 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6588fe0e-18ba-4dce-8c79-0ac7c617fd48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00153808-ef7d-4742-ad16-36b5e744c656', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:04:42 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e6c04243-418a-4807-b77d-04c976bac3f6 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aaf33865-1e65-48ec-95e9-db334a055669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:04:42 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-e6c04243-418a-4807-b77d-04c976bac3f6 tempest-ProjectMemberTests-1434405994 None] Volume volume-00153808-ef7d-4742-ad16-36b5e744c656 (00153808-ef7d-4742-ad16-36b5e744c656): created successfully Sep 25 12:04:42 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e6c04243-418a-4807-b77d-04c976bac3f6 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aaf33865-1e65-48ec-95e9-db334a055669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:04:42 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e6c04243-418a-4807-b77d-04c976bac3f6 tempest-ProjectMemberTests-1434405994 None] Flow 'volume_create_manager' (b8bd21d4-e476-4a25-af30-25f589500ecd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:04:42 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-e6c04243-418a-4807-b77d-04c976bac3f6 tempest-ProjectMemberTests-1434405994 None] Created volume successfully. Sep 25 12:04:42 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-5ef1e57d-241b-4ea7-8e44-d800952389bc tempest-ProjectReaderTests-916980377 None] Acquiring lock "cinder-c51e2068-b162-4cd8-86b6-5badd32475e1-delete_snapshot" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:04:42 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-5ef1e57d-241b-4ea7-8e44-d800952389bc tempest-ProjectReaderTests-916980377 None] Lock "cinder-c51e2068-b162-4cd8-86b6-5badd32475e1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:04:42 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-5ef1e57d-241b-4ea7-8e44-d800952389bc tempest-ProjectReaderTests-916980377 None] Acquiring lock "cinder-quobyte-07b7fac3-3da6-4363-afbf-43ece8db99da" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:04:42 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-5ef1e57d-241b-4ea7-8e44-d800952389bc tempest-ProjectReaderTests-916980377 None] Lock "cinder-quobyte-07b7fac3-3da6-4363-afbf-43ece8db99da" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:04:42 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-5ef1e57d-241b-4ea7-8e44-d800952389bc tempest-ProjectReaderTests-916980377 None] Acquiring lock "cinder-quobyte-c51e2068-b162-4cd8-86b6-5badd32475e1" by "_delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:04:42 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-5ef1e57d-241b-4ea7-8e44-d800952389bc tempest-ProjectReaderTests-916980377 None] Lock "cinder-quobyte-c51e2068-b162-4cd8-86b6-5badd32475e1" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:04:42 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-5ef1e57d-241b-4ea7-8e44-d800952389bc tempest-ProjectReaderTests-916980377 None] Deleting offline snapshot c51e2068-b162-4cd8-86b6-5badd32475e1 of volume 07b7fac3-3da6-4363-afbf-43ece8db99da {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 12:04:42 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-5ef1e57d-241b-4ea7-8e44-d800952389bc tempest-ProjectReaderTests-916980377 None] snapshot_file for this snap is: volume-07b7fac3-3da6-4363-afbf-43ece8db99da.c51e2068-b162-4cd8-86b6-5badd32475e1 {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 12:04:42 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb776f07-70c1-415e-965c-67b090aaa1eb]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:04:42 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-5ef1e57d-241b-4ea7-8e44-d800952389bc tempest-ProjectReaderTests-916980377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07b7fac3-3da6-4363-afbf-43ece8db99da.c51e2068-b162-4cd8-86b6-5badd32475e1 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:42 devstack sudo[108693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07b7fac3-3da6-4363-afbf-43ece8db99da.c51e2068-b162-4cd8-86b6-5badd32475e1 Sep 25 12:04:42 devstack sudo[108693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:42 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-faa8776e-fb2b-481c-9d22-a64e6ad6d853 tempest-ProjectMemberTests-1434405994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:04:42 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-faa8776e-fb2b-481c-9d22-a64e6ad6d853 tempest-ProjectMemberTests-1434405994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:04:42 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-faa8776e-fb2b-481c-9d22-a64e6ad6d853 tempest-ProjectMemberTests-1434405994 None] Creating offline snapshot 740c714b-bffd-4b4b-bd37-c020f7c68b4c of volume 00153808-ef7d-4742-ad16-36b5e744c656 {{(pid=86984) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 12:04:42 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cdc1e27-5987-43ad-a6f5-b9fe5cbc70ee]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:04:42 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-faa8776e-fb2b-481c-9d22-a64e6ad6d853 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-00153808-ef7d-4742-ad16-36b5e744c656 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:42 devstack sudo[108697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-00153808-ef7d-4742-ad16-36b5e744c656 Sep 25 12:04:42 devstack sudo[108697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:42 devstack sudo[108693]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:42 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-5ef1e57d-241b-4ea7-8e44-d800952389bc tempest-ProjectReaderTests-916980377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07b7fac3-3da6-4363-afbf-43ece8db99da.c51e2068-b162-4cd8-86b6-5badd32475e1" returned: 0 in 0.475s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:42 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-5ef1e57d-241b-4ea7-8e44-d800952389bc tempest-ProjectReaderTests-916980377 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-07b7fac3-3da6-4363-afbf-43ece8db99da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86984) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:04:42 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c13abf-b8e2-4be1-adc7-ffb2edeeefc4]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:04:42 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-5ef1e57d-241b-4ea7-8e44-d800952389bc tempest-ProjectReaderTests-916980377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07b7fac3-3da6-4363-afbf-43ece8db99da {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:43 devstack sudo[108702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07b7fac3-3da6-4363-afbf-43ece8db99da Sep 25 12:04:43 devstack sudo[108702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:43 devstack sudo[108697]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-faa8776e-fb2b-481c-9d22-a64e6ad6d853 tempest-ProjectMemberTests-1434405994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-00153808-ef7d-4742-ad16-36b5e744c656" returned: 0 in 0.443s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-faa8776e-fb2b-481c-9d22-a64e6ad6d853 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-00153808-ef7d-4742-ad16-36b5e744c656,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-00153808-ef7d-4742-ad16-36b5e744c656.740c714b-bffd-4b4b-bd37-c020f7c68b4c 1G {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:43 devstack sudo[108708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-00153808-ef7d-4742-ad16-36b5e744c656,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-00153808-ef7d-4742-ad16-36b5e744c656.740c714b-bffd-4b4b-bd37-c020f7c68b4c 1G Sep 25 12:04:43 devstack sudo[108708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:43 devstack sudo[108702]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-5ef1e57d-241b-4ea7-8e44-d800952389bc tempest-ProjectReaderTests-916980377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07b7fac3-3da6-4363-afbf-43ece8db99da" returned: 0 in 0.402s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-5ef1e57d-241b-4ea7-8e44-d800952389bc tempest-ProjectReaderTests-916980377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07b7fac3-3da6-4363-afbf-43ece8db99da.c51e2068-b162-4cd8-86b6-5badd32475e1 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:43 devstack sudo[108713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07b7fac3-3da6-4363-afbf-43ece8db99da.c51e2068-b162-4cd8-86b6-5badd32475e1 Sep 25 12:04:43 devstack sudo[108713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:43 devstack sudo[108708]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-faa8776e-fb2b-481c-9d22-a64e6ad6d853 tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-00153808-ef7d-4742-ad16-36b5e744c656,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-00153808-ef7d-4742-ad16-36b5e744c656.740c714b-bffd-4b4b-bd37-c020f7c68b4c 1G" returned: 0 in 0.480s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-faa8776e-fb2b-481c-9d22-a64e6ad6d853 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00153808-ef7d-4742-ad16-36b5e744c656 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-00153808-ef7d-4742-ad16-36b5e744c656.740c714b-bffd-4b4b-bd37-c020f7c68b4c {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:43 devstack sudo[108720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00153808-ef7d-4742-ad16-36b5e744c656 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-00153808-ef7d-4742-ad16-36b5e744c656.740c714b-bffd-4b4b-bd37-c020f7c68b4c Sep 25 12:04:43 devstack sudo[108720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:43 devstack sudo[108713]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-5ef1e57d-241b-4ea7-8e44-d800952389bc tempest-ProjectReaderTests-916980377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07b7fac3-3da6-4363-afbf-43ece8db99da.c51e2068-b162-4cd8-86b6-5badd32475e1" returned: 0 in 0.438s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-5ef1e57d-241b-4ea7-8e44-d800952389bc tempest-ProjectReaderTests-916980377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07b7fac3-3da6-4363-afbf-43ece8db99da.c51e2068-b162-4cd8-86b6-5badd32475e1 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:43 devstack sudo[108723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07b7fac3-3da6-4363-afbf-43ece8db99da.c51e2068-b162-4cd8-86b6-5badd32475e1 Sep 25 12:04:43 devstack sudo[108723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:43 devstack sudo[108720]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-faa8776e-fb2b-481c-9d22-a64e6ad6d853 tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00153808-ef7d-4742-ad16-36b5e744c656 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-00153808-ef7d-4742-ad16-36b5e744c656.740c714b-bffd-4b4b-bd37-c020f7c68b4c" returned: 0 in 0.396s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:43 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-faa8776e-fb2b-481c-9d22-a64e6ad6d853 tempest-ProjectMemberTests-1434405994 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-00153808-ef7d-4742-ad16-36b5e744c656.740c714b-bffd-4b4b-bd37-c020f7c68b4c is being set with open permissions: ugo+rw Sep 25 12:04:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-faa8776e-fb2b-481c-9d22-a64e6ad6d853 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-00153808-ef7d-4742-ad16-36b5e744c656.740c714b-bffd-4b4b-bd37-c020f7c68b4c {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:44 devstack sudo[108728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-00153808-ef7d-4742-ad16-36b5e744c656.740c714b-bffd-4b4b-bd37-c020f7c68b4c Sep 25 12:04:44 devstack sudo[108728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:44 devstack sudo[108723]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-5ef1e57d-241b-4ea7-8e44-d800952389bc tempest-ProjectReaderTests-916980377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07b7fac3-3da6-4363-afbf-43ece8db99da.c51e2068-b162-4cd8-86b6-5badd32475e1" returned: 0 in 0.332s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:44 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-5ef1e57d-241b-4ea7-8e44-d800952389bc tempest-ProjectReaderTests-916980377 None] Lock "cinder-quobyte-c51e2068-b162-4cd8-86b6-5badd32475e1" released by "_delete_snapshot" :: held 1.782s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:04:44 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-5ef1e57d-241b-4ea7-8e44-d800952389bc tempest-ProjectReaderTests-916980377 None] Lock "cinder-quobyte-07b7fac3-3da6-4363-afbf-43ece8db99da" released by "delete_snapshot" :: held 1.807s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:04:44 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-5ef1e57d-241b-4ea7-8e44-d800952389bc tempest-ProjectReaderTests-916980377 None] Created reservations ['aafa32b6-8b29-4543-a307-9025a4d5a461', '69479f21-f8c9-4322-87a5-5c5fa10daf85', '092045d7-af8d-4af3-917a-79f5d9d932e3', '9b2829a9-f244-4e4e-89f2-66c3c9c354f5'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:04:44 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-5ef1e57d-241b-4ea7-8e44-d800952389bc tempest-ProjectReaderTests-916980377 None] Delete snapshot completed successfully. Sep 25 12:04:44 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-5ef1e57d-241b-4ea7-8e44-d800952389bc tempest-ProjectReaderTests-916980377 None] Lock "cinder-c51e2068-b162-4cd8-86b6-5badd32475e1-delete_snapshot" released by "delete_snapshot" :: held 1.967s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:04:44 devstack sudo[108728]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-faa8776e-fb2b-481c-9d22-a64e6ad6d853 tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-00153808-ef7d-4742-ad16-36b5e744c656.740c714b-bffd-4b4b-bd37-c020f7c68b4c" returned: 0 in 0.306s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-faa8776e-fb2b-481c-9d22-a64e6ad6d853 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-00153808-ef7d-4742-ad16-36b5e744c656.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:44 devstack sudo[108734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-00153808-ef7d-4742-ad16-36b5e744c656.info Sep 25 12:04:44 devstack sudo[108734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:44 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-296fc367-47b6-4437-8884-92873751c3b1 tempest-ProjectReaderTests-916980377 None] Acquiring lock "cinder-07b7fac3-3da6-4363-afbf-43ece8db99da-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:04:44 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-296fc367-47b6-4437-8884-92873751c3b1 tempest-ProjectReaderTests-916980377 None] Lock "cinder-07b7fac3-3da6-4363-afbf-43ece8db99da-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:04:44 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-296fc367-47b6-4437-8884-92873751c3b1 tempest-ProjectReaderTests-916980377 None] Acquiring lock "cinder-quobyte-07b7fac3-3da6-4363-afbf-43ece8db99da" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:04:44 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-296fc367-47b6-4437-8884-92873751c3b1 tempest-ProjectReaderTests-916980377 None] Lock "cinder-quobyte-07b7fac3-3da6-4363-afbf-43ece8db99da" acquired by "delete_volume" :: waited 0.017s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:04:44 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[5235a648-4d04-4ba4-bf46-227c01c4678c]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:04:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-296fc367-47b6-4437-8884-92873751c3b1 tempest-ProjectReaderTests-916980377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07b7fac3-3da6-4363-afbf-43ece8db99da {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:44 devstack sudo[108734]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-faa8776e-fb2b-481c-9d22-a64e6ad6d853 tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-00153808-ef7d-4742-ad16-36b5e744c656.info" returned: 0 in 0.292s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:44 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-faa8776e-fb2b-481c-9d22-a64e6ad6d853 tempest-ProjectMemberTests-1434405994 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-00153808-ef7d-4742-ad16-36b5e744c656.info is being set with open permissions: ugo+rw Sep 25 12:04:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-faa8776e-fb2b-481c-9d22-a64e6ad6d853 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-00153808-ef7d-4742-ad16-36b5e744c656.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:44 devstack sudo[108738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-00153808-ef7d-4742-ad16-36b5e744c656.info Sep 25 12:04:44 devstack sudo[108738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:44 devstack sudo[108737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07b7fac3-3da6-4363-afbf-43ece8db99da Sep 25 12:04:44 devstack sudo[108737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:44 devstack sudo[108738]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-faa8776e-fb2b-481c-9d22-a64e6ad6d853 tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-00153808-ef7d-4742-ad16-36b5e744c656.info" returned: 0 in 0.285s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-faa8776e-fb2b-481c-9d22-a64e6ad6d853 tempest-ProjectMemberTests-1434405994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.301s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:04:44 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-faa8776e-fb2b-481c-9d22-a64e6ad6d853 tempest-ProjectMemberTests-1434405994 None] Create snapshot completed successfully Sep 25 12:04:45 devstack sudo[108737]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-296fc367-47b6-4437-8884-92873751c3b1 tempest-ProjectReaderTests-916980377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07b7fac3-3da6-4363-afbf-43ece8db99da" returned: 0 in 0.443s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-296fc367-47b6-4437-8884-92873751c3b1 tempest-ProjectReaderTests-916980377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07b7fac3-3da6-4363-afbf-43ece8db99da {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:45 devstack sudo[108745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07b7fac3-3da6-4363-afbf-43ece8db99da Sep 25 12:04:45 devstack sudo[108745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:45 devstack sudo[108745]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-296fc367-47b6-4437-8884-92873751c3b1 tempest-ProjectReaderTests-916980377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-07b7fac3-3da6-4363-afbf-43ece8db99da" returned: 0 in 0.266s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:45 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-296fc367-47b6-4437-8884-92873751c3b1 tempest-ProjectReaderTests-916980377 None] Lock "cinder-quobyte-07b7fac3-3da6-4363-afbf-43ece8db99da" released by "delete_volume" :: held 0.786s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:04:45 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-296fc367-47b6-4437-8884-92873751c3b1 tempest-ProjectReaderTests-916980377 None] Created reservations ['625c0f33-cb4e-4072-8b7c-472ddac837f5', '47b81a9b-4964-4648-bab5-518d167994f8', '65eade55-ab4e-4011-89f2-0bb4df3b1fa8', '2af09fa6-fd5f-42df-83fa-266c77240237'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:04:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-296fc367-47b6-4437-8884-92873751c3b1 tempest-ProjectReaderTests-916980377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:04:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-296fc367-47b6-4437-8884-92873751c3b1 tempest-ProjectReaderTests-916980377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:04:45 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-296fc367-47b6-4437-8884-92873751c3b1 tempest-ProjectReaderTests-916980377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:04:45 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-296fc367-47b6-4437-8884-92873751c3b1 tempest-ProjectReaderTests-916980377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:04:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-296fc367-47b6-4437-8884-92873751c3b1 tempest-ProjectReaderTests-916980377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:04:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-296fc367-47b6-4437-8884-92873751c3b1 tempest-ProjectReaderTests-916980377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:45 devstack sudo[108748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 12:04:45 devstack sudo[108748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:45 devstack sudo[108748]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-296fc367-47b6-4437-8884-92873751c3b1 tempest-ProjectReaderTests-916980377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.301s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:45 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-296fc367-47b6-4437-8884-92873751c3b1 tempest-ProjectReaderTests-916980377 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:04:45 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-296fc367-47b6-4437-8884-92873751c3b1 tempest-ProjectReaderTests-916980377 None] Deleted volume successfully. Sep 25 12:04:45 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-296fc367-47b6-4437-8884-92873751c3b1 tempest-ProjectReaderTests-916980377 None] Lock "cinder-07b7fac3-3da6-4363-afbf-43ece8db99da-delete_volume" released by "delete_volume" :: held 1.336s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:04:45 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-72f988d7-ba08-4a0a-9e9b-203dc1ad85ae tempest-ProjectMemberTests-1434405994 None] Acquiring lock "cinder-740c714b-bffd-4b4b-bd37-c020f7c68b4c-delete_snapshot" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:04:45 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-72f988d7-ba08-4a0a-9e9b-203dc1ad85ae tempest-ProjectMemberTests-1434405994 None] Lock "cinder-740c714b-bffd-4b4b-bd37-c020f7c68b4c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:04:45 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-72f988d7-ba08-4a0a-9e9b-203dc1ad85ae tempest-ProjectMemberTests-1434405994 None] Acquiring lock "cinder-quobyte-00153808-ef7d-4742-ad16-36b5e744c656" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:04:45 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-72f988d7-ba08-4a0a-9e9b-203dc1ad85ae tempest-ProjectMemberTests-1434405994 None] Lock "cinder-quobyte-00153808-ef7d-4742-ad16-36b5e744c656" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:04:45 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-72f988d7-ba08-4a0a-9e9b-203dc1ad85ae tempest-ProjectMemberTests-1434405994 None] Acquiring lock "cinder-quobyte-740c714b-bffd-4b4b-bd37-c020f7c68b4c" by "_delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:04:45 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-72f988d7-ba08-4a0a-9e9b-203dc1ad85ae tempest-ProjectMemberTests-1434405994 None] Lock "cinder-quobyte-740c714b-bffd-4b4b-bd37-c020f7c68b4c" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:04:45 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-72f988d7-ba08-4a0a-9e9b-203dc1ad85ae tempest-ProjectMemberTests-1434405994 None] Deleting offline snapshot 740c714b-bffd-4b4b-bd37-c020f7c68b4c of volume 00153808-ef7d-4742-ad16-36b5e744c656 {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 12:04:46 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-72f988d7-ba08-4a0a-9e9b-203dc1ad85ae tempest-ProjectMemberTests-1434405994 None] snapshot_file for this snap is: volume-00153808-ef7d-4742-ad16-36b5e744c656.740c714b-bffd-4b4b-bd37-c020f7c68b4c {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 12:04:46 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f9a7e1b-b376-4270-98c0-91d5b9aed018]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:04:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-72f988d7-ba08-4a0a-9e9b-203dc1ad85ae tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-00153808-ef7d-4742-ad16-36b5e744c656.740c714b-bffd-4b4b-bd37-c020f7c68b4c {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:46 devstack sudo[108751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-00153808-ef7d-4742-ad16-36b5e744c656.740c714b-bffd-4b4b-bd37-c020f7c68b4c Sep 25 12:04:46 devstack sudo[108751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:46 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8b920cb-6eea-4a07-afd9-36b5f5f75866 tempest-ProjectReaderTests-916980377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:04:46 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f8b920cb-6eea-4a07-afd9-36b5f5f75866 tempest-ProjectReaderTests-916980377 None] Flow 'volume_create_manager' (4c7e36ba-2651-4622-83f0-53da7008ab97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:04:46 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f8b920cb-6eea-4a07-afd9-36b5f5f75866 tempest-ProjectReaderTests-916980377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (600ac2f7-0003-4a0f-b99c-b974c2694228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:04:46 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f8b920cb-6eea-4a07-afd9-36b5f5f75866 tempest-ProjectReaderTests-916980377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (600ac2f7-0003-4a0f-b99c-b974c2694228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:04:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1247850463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7fbfa60-8297-496a-83e6-606280464488,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c665fd078654a5ca51a715d7405fe8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:04:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:04:46Z,use_quota=True,user_id='62e4ebbd017b43a7bdf4fcc690c52509',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:04:46 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f8b920cb-6eea-4a07-afd9-36b5f5f75866 tempest-ProjectReaderTests-916980377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53650fc4-40a1-4f58-b731-d6fcf45fba5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:04:46 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f8b920cb-6eea-4a07-afd9-36b5f5f75866 tempest-ProjectReaderTests-916980377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53650fc4-40a1-4f58-b731-d6fcf45fba5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:04:46 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f8b920cb-6eea-4a07-afd9-36b5f5f75866 tempest-ProjectReaderTests-916980377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f50cde8-930e-4669-a0b9-14158748033c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:04:46 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f8b920cb-6eea-4a07-afd9-36b5f5f75866 tempest-ProjectReaderTests-916980377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f50cde8-930e-4669-a0b9-14158748033c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7fbfa60-8297-496a-83e6-606280464488', 'volume_name': 'volume-c7fbfa60-8297-496a-83e6-606280464488', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:04:46 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f8b920cb-6eea-4a07-afd9-36b5f5f75866 tempest-ProjectReaderTests-916980377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4103d6c-d927-41f3-a8c3-e9b6fe1bdb84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:04:46 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f8b920cb-6eea-4a07-afd9-36b5f5f75866 tempest-ProjectReaderTests-916980377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4103d6c-d927-41f3-a8c3-e9b6fe1bdb84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:04:46 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f8b920cb-6eea-4a07-afd9-36b5f5f75866 tempest-ProjectReaderTests-916980377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7be36bac-221c-4f06-9457-94b5cd403f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:04:46 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-f8b920cb-6eea-4a07-afd9-36b5f5f75866 tempest-ProjectReaderTests-916980377 None] Volume c7fbfa60-8297-496a-83e6-606280464488: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7fbfa60-8297-496a-83e6-606280464488', 'volume_size': 1} Sep 25 12:04:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f8b920cb-6eea-4a07-afd9-36b5f5f75866 tempest-ProjectReaderTests-916980377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:04:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f8b920cb-6eea-4a07-afd9-36b5f5f75866 tempest-ProjectReaderTests-916980377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:04:46 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-f8b920cb-6eea-4a07-afd9-36b5f5f75866 tempest-ProjectReaderTests-916980377 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:04:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1247850463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7fbfa60-8297-496a-83e6-606280464488,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c665fd078654a5ca51a715d7405fe8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:04:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:04:46Z,use_quota=True,user_id='62e4ebbd017b43a7bdf4fcc690c52509',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:04:46 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-f8b920cb-6eea-4a07-afd9-36b5f5f75866 tempest-ProjectReaderTests-916980377 None] Creating volume c7fbfa60-8297-496a-83e6-606280464488 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:04:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f8b920cb-6eea-4a07-afd9-36b5f5f75866 tempest-ProjectReaderTests-916980377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:04:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f8b920cb-6eea-4a07-afd9-36b5f5f75866 tempest-ProjectReaderTests-916980377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:04:46 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-f8b920cb-6eea-4a07-afd9-36b5f5f75866 tempest-ProjectReaderTests-916980377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:04:46 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-f8b920cb-6eea-4a07-afd9-36b5f5f75866 tempest-ProjectReaderTests-916980377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:04:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f8b920cb-6eea-4a07-afd9-36b5f5f75866 tempest-ProjectReaderTests-916980377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:04:46 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-f8b920cb-6eea-4a07-afd9-36b5f5f75866 tempest-ProjectReaderTests-916980377 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:04:46 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-f8b920cb-6eea-4a07-afd9-36b5f5f75866 tempest-ProjectReaderTests-916980377 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 12:04:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f8b920cb-6eea-4a07-afd9-36b5f5f75866 tempest-ProjectReaderTests-916980377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c7fbfa60-8297-496a-83e6-606280464488 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:46 devstack sudo[108753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c7fbfa60-8297-496a-83e6-606280464488 1073741824 Sep 25 12:04:46 devstack sudo[108753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:46 devstack sudo[108751]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-72f988d7-ba08-4a0a-9e9b-203dc1ad85ae tempest-ProjectMemberTests-1434405994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-00153808-ef7d-4742-ad16-36b5e744c656.740c714b-bffd-4b4b-bd37-c020f7c68b4c" returned: 0 in 0.421s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:46 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-72f988d7-ba08-4a0a-9e9b-203dc1ad85ae tempest-ProjectMemberTests-1434405994 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00153808-ef7d-4742-ad16-36b5e744c656(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86984) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:04:46 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62bf816-04cb-43b3-a313-6545ff5d8352]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:04:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-72f988d7-ba08-4a0a-9e9b-203dc1ad85ae tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-00153808-ef7d-4742-ad16-36b5e744c656 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:46 devstack sudo[108758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-00153808-ef7d-4742-ad16-36b5e744c656 Sep 25 12:04:46 devstack sudo[108758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:46 devstack sudo[108753]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f8b920cb-6eea-4a07-afd9-36b5f5f75866 tempest-ProjectReaderTests-916980377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c7fbfa60-8297-496a-83e6-606280464488 1073741824" returned: 0 in 0.505s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f8b920cb-6eea-4a07-afd9-36b5f5f75866 tempest-ProjectReaderTests-916980377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c7fbfa60-8297-496a-83e6-606280464488 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:46 devstack sudo[108764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c7fbfa60-8297-496a-83e6-606280464488 Sep 25 12:04:46 devstack sudo[108764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:46 devstack sudo[108758]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-72f988d7-ba08-4a0a-9e9b-203dc1ad85ae tempest-ProjectMemberTests-1434405994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-00153808-ef7d-4742-ad16-36b5e744c656" returned: 0 in 0.482s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-72f988d7-ba08-4a0a-9e9b-203dc1ad85ae tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-00153808-ef7d-4742-ad16-36b5e744c656.740c714b-bffd-4b4b-bd37-c020f7c68b4c {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:47 devstack sudo[108768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-00153808-ef7d-4742-ad16-36b5e744c656.740c714b-bffd-4b4b-bd37-c020f7c68b4c Sep 25 12:04:47 devstack sudo[108768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:47 devstack sudo[108764]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f8b920cb-6eea-4a07-afd9-36b5f5f75866 tempest-ProjectReaderTests-916980377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c7fbfa60-8297-496a-83e6-606280464488" returned: 0 in 0.343s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:47 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-f8b920cb-6eea-4a07-afd9-36b5f5f75866 tempest-ProjectReaderTests-916980377 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:04:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f8b920cb-6eea-4a07-afd9-36b5f5f75866 tempest-ProjectReaderTests-916980377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:04:47 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f8b920cb-6eea-4a07-afd9-36b5f5f75866 tempest-ProjectReaderTests-916980377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7be36bac-221c-4f06-9457-94b5cd403f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7fbfa60-8297-496a-83e6-606280464488', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:04:47 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f8b920cb-6eea-4a07-afd9-36b5f5f75866 tempest-ProjectReaderTests-916980377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9177bf5d-49a0-4ec9-a305-753793e2778b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:04:47 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-f8b920cb-6eea-4a07-afd9-36b5f5f75866 tempest-ProjectReaderTests-916980377 None] Volume volume-c7fbfa60-8297-496a-83e6-606280464488 (c7fbfa60-8297-496a-83e6-606280464488): created successfully Sep 25 12:04:47 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f8b920cb-6eea-4a07-afd9-36b5f5f75866 tempest-ProjectReaderTests-916980377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9177bf5d-49a0-4ec9-a305-753793e2778b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:04:47 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-f8b920cb-6eea-4a07-afd9-36b5f5f75866 tempest-ProjectReaderTests-916980377 None] Flow 'volume_create_manager' (4c7e36ba-2651-4622-83f0-53da7008ab97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:04:47 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-f8b920cb-6eea-4a07-afd9-36b5f5f75866 tempest-ProjectReaderTests-916980377 None] Created volume successfully. Sep 25 12:04:47 devstack sudo[108768]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-72f988d7-ba08-4a0a-9e9b-203dc1ad85ae tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-00153808-ef7d-4742-ad16-36b5e744c656.740c714b-bffd-4b4b-bd37-c020f7c68b4c" returned: 0 in 0.433s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-72f988d7-ba08-4a0a-9e9b-203dc1ad85ae tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-00153808-ef7d-4742-ad16-36b5e744c656.740c714b-bffd-4b4b-bd37-c020f7c68b4c {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:47 devstack sudo[108774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-00153808-ef7d-4742-ad16-36b5e744c656.740c714b-bffd-4b4b-bd37-c020f7c68b4c Sep 25 12:04:47 devstack sudo[108774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:47 devstack sudo[108774]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-72f988d7-ba08-4a0a-9e9b-203dc1ad85ae tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-00153808-ef7d-4742-ad16-36b5e744c656.740c714b-bffd-4b4b-bd37-c020f7c68b4c" returned: 0 in 0.302s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:47 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-72f988d7-ba08-4a0a-9e9b-203dc1ad85ae tempest-ProjectMemberTests-1434405994 None] Lock "cinder-quobyte-740c714b-bffd-4b4b-bd37-c020f7c68b4c" released by "_delete_snapshot" :: held 1.777s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:04:47 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-72f988d7-ba08-4a0a-9e9b-203dc1ad85ae tempest-ProjectMemberTests-1434405994 None] Lock "cinder-quobyte-00153808-ef7d-4742-ad16-36b5e744c656" released by "delete_snapshot" :: held 1.806s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:04:47 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-72f988d7-ba08-4a0a-9e9b-203dc1ad85ae tempest-ProjectMemberTests-1434405994 None] Created reservations ['b34b1fdc-cba2-42f6-89f7-a49f92f974c7', 'a5b5d60c-9e71-49aa-9265-31acd9a98fb6', 'ea62ed60-19cb-4a21-b985-7f0cb5d89f53', 'e18ed288-dddb-4db5-9bff-59bf7ea6a374'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:04:47 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-72f988d7-ba08-4a0a-9e9b-203dc1ad85ae tempest-ProjectMemberTests-1434405994 None] Delete snapshot completed successfully. Sep 25 12:04:47 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-72f988d7-ba08-4a0a-9e9b-203dc1ad85ae tempest-ProjectMemberTests-1434405994 None] Lock "cinder-740c714b-bffd-4b4b-bd37-c020f7c68b4c-delete_snapshot" released by "delete_snapshot" :: held 1.962s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:04:48 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-b2e83d8d-2a4f-4f5f-851d-e77e54f7b08a tempest-ProjectMemberTests-1434405994 None] Acquiring lock "cinder-00153808-ef7d-4742-ad16-36b5e744c656-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:04:48 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-b2e83d8d-2a4f-4f5f-851d-e77e54f7b08a tempest-ProjectMemberTests-1434405994 None] Lock "cinder-00153808-ef7d-4742-ad16-36b5e744c656-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:04:48 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-b2e83d8d-2a4f-4f5f-851d-e77e54f7b08a tempest-ProjectMemberTests-1434405994 None] Acquiring lock "cinder-quobyte-00153808-ef7d-4742-ad16-36b5e744c656" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:04:48 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-b2e83d8d-2a4f-4f5f-851d-e77e54f7b08a tempest-ProjectMemberTests-1434405994 None] Lock "cinder-quobyte-00153808-ef7d-4742-ad16-36b5e744c656" acquired by "delete_volume" :: waited 0.018s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:04:48 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a09ba7-e22a-4f88-aefd-df4bb0698937]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:04:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-b2e83d8d-2a4f-4f5f-851d-e77e54f7b08a tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-00153808-ef7d-4742-ad16-36b5e744c656 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:48 devstack sudo[108777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-00153808-ef7d-4742-ad16-36b5e744c656 Sep 25 12:04:48 devstack sudo[108777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d33c03bd-f319-43a0-a65c-71ee28539603 tempest-ProjectReaderTests-916980377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:04:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d33c03bd-f319-43a0-a65c-71ee28539603 tempest-ProjectReaderTests-916980377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:04:48 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-d33c03bd-f319-43a0-a65c-71ee28539603 tempest-ProjectReaderTests-916980377 None] Creating offline snapshot 1af931ca-9130-4ba2-aa47-93bf657246eb of volume c7fbfa60-8297-496a-83e6-606280464488 {{(pid=86984) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 12:04:48 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ed3246-13f9-4b20-a97c-43d413e8b7aa]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:04:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d33c03bd-f319-43a0-a65c-71ee28539603 tempest-ProjectReaderTests-916980377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c7fbfa60-8297-496a-83e6-606280464488 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:48 devstack sudo[108777]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-b2e83d8d-2a4f-4f5f-851d-e77e54f7b08a tempest-ProjectMemberTests-1434405994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-00153808-ef7d-4742-ad16-36b5e744c656" returned: 0 in 0.430s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-b2e83d8d-2a4f-4f5f-851d-e77e54f7b08a tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-00153808-ef7d-4742-ad16-36b5e744c656 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:48 devstack sudo[108779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c7fbfa60-8297-496a-83e6-606280464488 Sep 25 12:04:48 devstack sudo[108779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:48 devstack sudo[108784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-00153808-ef7d-4742-ad16-36b5e744c656 Sep 25 12:04:48 devstack sudo[108784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:48 devstack sudo[108784]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-b2e83d8d-2a4f-4f5f-851d-e77e54f7b08a tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-00153808-ef7d-4742-ad16-36b5e744c656" returned: 0 in 0.276s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:48 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-b2e83d8d-2a4f-4f5f-851d-e77e54f7b08a tempest-ProjectMemberTests-1434405994 None] Lock "cinder-quobyte-00153808-ef7d-4742-ad16-36b5e744c656" released by "delete_volume" :: held 0.797s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:04:48 devstack sudo[108779]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d33c03bd-f319-43a0-a65c-71ee28539603 tempest-ProjectReaderTests-916980377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c7fbfa60-8297-496a-83e6-606280464488" returned: 0 in 0.442s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d33c03bd-f319-43a0-a65c-71ee28539603 tempest-ProjectReaderTests-916980377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c7fbfa60-8297-496a-83e6-606280464488,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c7fbfa60-8297-496a-83e6-606280464488.1af931ca-9130-4ba2-aa47-93bf657246eb 1G {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:49 devstack sudo[108790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c7fbfa60-8297-496a-83e6-606280464488,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c7fbfa60-8297-496a-83e6-606280464488.1af931ca-9130-4ba2-aa47-93bf657246eb 1G Sep 25 12:04:49 devstack sudo[108790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:49 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-b2e83d8d-2a4f-4f5f-851d-e77e54f7b08a tempest-ProjectMemberTests-1434405994 None] Created reservations ['b4f9e7b7-4f1d-4182-8a1f-b57c0e5aa531', 'cfdaad4c-5998-4ce1-b7f9-febb52998fa5', 'b5dc2f22-5ff8-4a5a-a6a8-3212f17dc0d5', '2c19afa1-24d2-46cb-9080-80ff701da61e'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:04:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-b2e83d8d-2a4f-4f5f-851d-e77e54f7b08a tempest-ProjectMemberTests-1434405994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:04:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-b2e83d8d-2a4f-4f5f-851d-e77e54f7b08a tempest-ProjectMemberTests-1434405994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:04:49 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-b2e83d8d-2a4f-4f5f-851d-e77e54f7b08a tempest-ProjectMemberTests-1434405994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:04:49 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-b2e83d8d-2a4f-4f5f-851d-e77e54f7b08a tempest-ProjectMemberTests-1434405994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:04:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-b2e83d8d-2a4f-4f5f-851d-e77e54f7b08a tempest-ProjectMemberTests-1434405994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:04:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-b2e83d8d-2a4f-4f5f-851d-e77e54f7b08a tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:49 devstack sudo[108792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 12:04:49 devstack sudo[108792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:49 devstack sudo[108792]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-b2e83d8d-2a4f-4f5f-851d-e77e54f7b08a tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.351s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:49 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-b2e83d8d-2a4f-4f5f-851d-e77e54f7b08a tempest-ProjectMemberTests-1434405994 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:04:49 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-b2e83d8d-2a4f-4f5f-851d-e77e54f7b08a tempest-ProjectMemberTests-1434405994 None] Deleted volume successfully. Sep 25 12:04:49 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-b2e83d8d-2a4f-4f5f-851d-e77e54f7b08a tempest-ProjectMemberTests-1434405994 None] Lock "cinder-00153808-ef7d-4742-ad16-36b5e744c656-delete_volume" released by "delete_volume" :: held 1.401s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:04:49 devstack sudo[108790]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d33c03bd-f319-43a0-a65c-71ee28539603 tempest-ProjectReaderTests-916980377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c7fbfa60-8297-496a-83e6-606280464488,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c7fbfa60-8297-496a-83e6-606280464488.1af931ca-9130-4ba2-aa47-93bf657246eb 1G" returned: 0 in 0.592s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d33c03bd-f319-43a0-a65c-71ee28539603 tempest-ProjectReaderTests-916980377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7fbfa60-8297-496a-83e6-606280464488 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c7fbfa60-8297-496a-83e6-606280464488.1af931ca-9130-4ba2-aa47-93bf657246eb {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:49 devstack sudo[108799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7fbfa60-8297-496a-83e6-606280464488 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c7fbfa60-8297-496a-83e6-606280464488.1af931ca-9130-4ba2-aa47-93bf657246eb Sep 25 12:04:49 devstack sudo[108799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:49 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-cecf62dd-c049-487d-b02a-9f1223f107b3 tempest-ProjectMemberTests-1434405994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:04:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cecf62dd-c049-487d-b02a-9f1223f107b3 tempest-ProjectMemberTests-1434405994 None] Flow 'volume_create_manager' (0d77c6fb-31d6-4395-a9fb-0727f2c53d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:04:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cecf62dd-c049-487d-b02a-9f1223f107b3 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f75e9e02-3df0-4741-ac08-4812fe3cf6ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:04:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cecf62dd-c049-487d-b02a-9f1223f107b3 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f75e9e02-3df0-4741-ac08-4812fe3cf6ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:04:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-594154881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76025640-be40-42c0-9bfa-ae1610b4d7e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c75afeac65f84f13b7d0325fa4b21b65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:04:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:04:50Z,use_quota=True,user_id='770f7e0a81074bae8bcd048c8d7f7347',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:04:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cecf62dd-c049-487d-b02a-9f1223f107b3 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6446011e-70bd-469c-a611-fa335a9f5ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:04:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cecf62dd-c049-487d-b02a-9f1223f107b3 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6446011e-70bd-469c-a611-fa335a9f5ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:04:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cecf62dd-c049-487d-b02a-9f1223f107b3 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62eb85a9-2a34-48fc-ad93-acf89149a489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:04:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cecf62dd-c049-487d-b02a-9f1223f107b3 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62eb85a9-2a34-48fc-ad93-acf89149a489) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76025640-be40-42c0-9bfa-ae1610b4d7e7', 'volume_name': 'volume-76025640-be40-42c0-9bfa-ae1610b4d7e7', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:04:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cecf62dd-c049-487d-b02a-9f1223f107b3 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f54b4cb5-7d16-4029-be9c-b68ec98fc37a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:04:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cecf62dd-c049-487d-b02a-9f1223f107b3 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f54b4cb5-7d16-4029-be9c-b68ec98fc37a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:04:49 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cecf62dd-c049-487d-b02a-9f1223f107b3 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d07f0b50-9128-4f09-a18d-e6a4b910fb12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:04:49 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-cecf62dd-c049-487d-b02a-9f1223f107b3 tempest-ProjectMemberTests-1434405994 None] Volume 76025640-be40-42c0-9bfa-ae1610b4d7e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76025640-be40-42c0-9bfa-ae1610b4d7e7', 'volume_size': 1} Sep 25 12:04:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-cecf62dd-c049-487d-b02a-9f1223f107b3 tempest-ProjectMemberTests-1434405994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:04:49 devstack sudo[108799]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d33c03bd-f319-43a0-a65c-71ee28539603 tempest-ProjectReaderTests-916980377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7fbfa60-8297-496a-83e6-606280464488 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c7fbfa60-8297-496a-83e6-606280464488.1af931ca-9130-4ba2-aa47-93bf657246eb" returned: 0 in 0.365s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:49 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-d33c03bd-f319-43a0-a65c-71ee28539603 tempest-ProjectReaderTests-916980377 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c7fbfa60-8297-496a-83e6-606280464488.1af931ca-9130-4ba2-aa47-93bf657246eb is being set with open permissions: ugo+rw Sep 25 12:04:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d33c03bd-f319-43a0-a65c-71ee28539603 tempest-ProjectReaderTests-916980377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c7fbfa60-8297-496a-83e6-606280464488.1af931ca-9130-4ba2-aa47-93bf657246eb {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:49 devstack sudo[108804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c7fbfa60-8297-496a-83e6-606280464488.1af931ca-9130-4ba2-aa47-93bf657246eb Sep 25 12:04:49 devstack sudo[108804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:50 devstack sudo[108804]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d33c03bd-f319-43a0-a65c-71ee28539603 tempest-ProjectReaderTests-916980377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c7fbfa60-8297-496a-83e6-606280464488.1af931ca-9130-4ba2-aa47-93bf657246eb" returned: 0 in 0.281s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d33c03bd-f319-43a0-a65c-71ee28539603 tempest-ProjectReaderTests-916980377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c7fbfa60-8297-496a-83e6-606280464488.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:50 devstack sudo[108807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c7fbfa60-8297-496a-83e6-606280464488.info Sep 25 12:04:50 devstack sudo[108807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:50 devstack sudo[108807]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d33c03bd-f319-43a0-a65c-71ee28539603 tempest-ProjectReaderTests-916980377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c7fbfa60-8297-496a-83e6-606280464488.info" returned: 0 in 0.294s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:50 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-d33c03bd-f319-43a0-a65c-71ee28539603 tempest-ProjectReaderTests-916980377 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c7fbfa60-8297-496a-83e6-606280464488.info is being set with open permissions: ugo+rw Sep 25 12:04:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d33c03bd-f319-43a0-a65c-71ee28539603 tempest-ProjectReaderTests-916980377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c7fbfa60-8297-496a-83e6-606280464488.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:50 devstack sudo[108810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c7fbfa60-8297-496a-83e6-606280464488.info Sep 25 12:04:50 devstack sudo[108810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:50 devstack sudo[108810]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d33c03bd-f319-43a0-a65c-71ee28539603 tempest-ProjectReaderTests-916980377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c7fbfa60-8297-496a-83e6-606280464488.info" returned: 0 in 0.259s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d33c03bd-f319-43a0-a65c-71ee28539603 tempest-ProjectReaderTests-916980377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.332s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:04:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-cecf62dd-c049-487d-b02a-9f1223f107b3 tempest-ProjectMemberTests-1434405994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.903s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:04:50 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-cecf62dd-c049-487d-b02a-9f1223f107b3 tempest-ProjectMemberTests-1434405994 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:04:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-594154881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76025640-be40-42c0-9bfa-ae1610b4d7e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c75afeac65f84f13b7d0325fa4b21b65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:04:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:04:50Z,use_quota=True,user_id='770f7e0a81074bae8bcd048c8d7f7347',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:04:50 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-cecf62dd-c049-487d-b02a-9f1223f107b3 tempest-ProjectMemberTests-1434405994 None] Creating volume 76025640-be40-42c0-9bfa-ae1610b4d7e7 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:04:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-cecf62dd-c049-487d-b02a-9f1223f107b3 tempest-ProjectMemberTests-1434405994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:04:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-cecf62dd-c049-487d-b02a-9f1223f107b3 tempest-ProjectMemberTests-1434405994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:04:50 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-cecf62dd-c049-487d-b02a-9f1223f107b3 tempest-ProjectMemberTests-1434405994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:04:50 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-cecf62dd-c049-487d-b02a-9f1223f107b3 tempest-ProjectMemberTests-1434405994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:04:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-cecf62dd-c049-487d-b02a-9f1223f107b3 tempest-ProjectMemberTests-1434405994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:04:50 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-cecf62dd-c049-487d-b02a-9f1223f107b3 tempest-ProjectMemberTests-1434405994 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:04:50 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-cecf62dd-c049-487d-b02a-9f1223f107b3 tempest-ProjectMemberTests-1434405994 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 12:04:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cecf62dd-c049-487d-b02a-9f1223f107b3 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-76025640-be40-42c0-9bfa-ae1610b4d7e7 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:50 devstack sudo[108813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-76025640-be40-42c0-9bfa-ae1610b4d7e7 1073741824 Sep 25 12:04:50 devstack sudo[108813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:50 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-d33c03bd-f319-43a0-a65c-71ee28539603 tempest-ProjectReaderTests-916980377 None] Create snapshot completed successfully Sep 25 12:04:51 devstack sudo[108813]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cecf62dd-c049-487d-b02a-9f1223f107b3 tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-76025640-be40-42c0-9bfa-ae1610b4d7e7 1073741824" returned: 0 in 0.523s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cecf62dd-c049-487d-b02a-9f1223f107b3 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-76025640-be40-42c0-9bfa-ae1610b4d7e7 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:51 devstack sudo[108819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-76025640-be40-42c0-9bfa-ae1610b4d7e7 Sep 25 12:04:51 devstack sudo[108819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:51 devstack sudo[108819]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:51 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-14d8799d-acee-47f9-9806-4f96914beaa7 tempest-ProjectReaderTests-916980377 None] Acquiring lock "cinder-1af931ca-9130-4ba2-aa47-93bf657246eb-delete_snapshot" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:04:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cecf62dd-c049-487d-b02a-9f1223f107b3 tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-76025640-be40-42c0-9bfa-ae1610b4d7e7" returned: 0 in 0.276s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:51 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-cecf62dd-c049-487d-b02a-9f1223f107b3 tempest-ProjectMemberTests-1434405994 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:04:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-cecf62dd-c049-487d-b02a-9f1223f107b3 tempest-ProjectMemberTests-1434405994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:04:51 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cecf62dd-c049-487d-b02a-9f1223f107b3 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d07f0b50-9128-4f09-a18d-e6a4b910fb12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76025640-be40-42c0-9bfa-ae1610b4d7e7', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:04:51 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cecf62dd-c049-487d-b02a-9f1223f107b3 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58b2b888-fa3b-406f-bb03-4a391c09563d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:04:51 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-14d8799d-acee-47f9-9806-4f96914beaa7 tempest-ProjectReaderTests-916980377 None] Lock "cinder-1af931ca-9130-4ba2-aa47-93bf657246eb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:04:51 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-14d8799d-acee-47f9-9806-4f96914beaa7 tempest-ProjectReaderTests-916980377 None] Acquiring lock "cinder-quobyte-c7fbfa60-8297-496a-83e6-606280464488" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:04:51 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-cecf62dd-c049-487d-b02a-9f1223f107b3 tempest-ProjectMemberTests-1434405994 None] Volume volume-76025640-be40-42c0-9bfa-ae1610b4d7e7 (76025640-be40-42c0-9bfa-ae1610b4d7e7): created successfully Sep 25 12:04:51 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cecf62dd-c049-487d-b02a-9f1223f107b3 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58b2b888-fa3b-406f-bb03-4a391c09563d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:04:51 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-cecf62dd-c049-487d-b02a-9f1223f107b3 tempest-ProjectMemberTests-1434405994 None] Flow 'volume_create_manager' (0d77c6fb-31d6-4395-a9fb-0727f2c53d42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:04:51 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-14d8799d-acee-47f9-9806-4f96914beaa7 tempest-ProjectReaderTests-916980377 None] Lock "cinder-quobyte-c7fbfa60-8297-496a-83e6-606280464488" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:04:51 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-14d8799d-acee-47f9-9806-4f96914beaa7 tempest-ProjectReaderTests-916980377 None] Acquiring lock "cinder-quobyte-1af931ca-9130-4ba2-aa47-93bf657246eb" by "_delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:04:51 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-cecf62dd-c049-487d-b02a-9f1223f107b3 tempest-ProjectMemberTests-1434405994 None] Created volume successfully. Sep 25 12:04:51 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-14d8799d-acee-47f9-9806-4f96914beaa7 tempest-ProjectReaderTests-916980377 None] Lock "cinder-quobyte-1af931ca-9130-4ba2-aa47-93bf657246eb" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:04:51 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-14d8799d-acee-47f9-9806-4f96914beaa7 tempest-ProjectReaderTests-916980377 None] Deleting offline snapshot 1af931ca-9130-4ba2-aa47-93bf657246eb of volume c7fbfa60-8297-496a-83e6-606280464488 {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 12:04:51 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-14d8799d-acee-47f9-9806-4f96914beaa7 tempest-ProjectReaderTests-916980377 None] snapshot_file for this snap is: volume-c7fbfa60-8297-496a-83e6-606280464488.1af931ca-9130-4ba2-aa47-93bf657246eb {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 12:04:51 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce1720e-efd4-490e-9724-4afc87fb19c2]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:04:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-14d8799d-acee-47f9-9806-4f96914beaa7 tempest-ProjectReaderTests-916980377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c7fbfa60-8297-496a-83e6-606280464488.1af931ca-9130-4ba2-aa47-93bf657246eb {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:51 devstack sudo[108822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c7fbfa60-8297-496a-83e6-606280464488.1af931ca-9130-4ba2-aa47-93bf657246eb Sep 25 12:04:51 devstack sudo[108822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f9ac7da3-082b-43d2-b0ef-0508d7cccbe9 tempest-ProjectMemberTests-1434405994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:04:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f9ac7da3-082b-43d2-b0ef-0508d7cccbe9 tempest-ProjectMemberTests-1434405994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:04:52 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-f9ac7da3-082b-43d2-b0ef-0508d7cccbe9 tempest-ProjectMemberTests-1434405994 None] Creating offline snapshot d0e03948-c220-4b04-a8a0-4a9adafb5247 of volume 76025640-be40-42c0-9bfa-ae1610b4d7e7 {{(pid=86984) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 12:04:52 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e3872fb-5971-4643-9f86-1262f46198cc]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:04:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f9ac7da3-082b-43d2-b0ef-0508d7cccbe9 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-76025640-be40-42c0-9bfa-ae1610b4d7e7 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:52 devstack sudo[108822]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-14d8799d-acee-47f9-9806-4f96914beaa7 tempest-ProjectReaderTests-916980377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c7fbfa60-8297-496a-83e6-606280464488.1af931ca-9130-4ba2-aa47-93bf657246eb" returned: 0 in 0.406s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:52 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-14d8799d-acee-47f9-9806-4f96914beaa7 tempest-ProjectReaderTests-916980377 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7fbfa60-8297-496a-83e6-606280464488(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86984) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:04:52 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[598ea850-b052-4a6d-884e-2e6cd9141d1b]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:04:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-14d8799d-acee-47f9-9806-4f96914beaa7 tempest-ProjectReaderTests-916980377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c7fbfa60-8297-496a-83e6-606280464488 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:52 devstack sudo[108827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-76025640-be40-42c0-9bfa-ae1610b4d7e7 Sep 25 12:04:52 devstack sudo[108827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:52 devstack sudo[108828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c7fbfa60-8297-496a-83e6-606280464488 Sep 25 12:04:52 devstack sudo[108828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:52 devstack sudo[108827]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f9ac7da3-082b-43d2-b0ef-0508d7cccbe9 tempest-ProjectMemberTests-1434405994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-76025640-be40-42c0-9bfa-ae1610b4d7e7" returned: 0 in 0.427s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f9ac7da3-082b-43d2-b0ef-0508d7cccbe9 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-76025640-be40-42c0-9bfa-ae1610b4d7e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-76025640-be40-42c0-9bfa-ae1610b4d7e7.d0e03948-c220-4b04-a8a0-4a9adafb5247 1G {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:52 devstack sudo[108828]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:52 devstack sudo[108837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-76025640-be40-42c0-9bfa-ae1610b4d7e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-76025640-be40-42c0-9bfa-ae1610b4d7e7.d0e03948-c220-4b04-a8a0-4a9adafb5247 1G Sep 25 12:04:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-14d8799d-acee-47f9-9806-4f96914beaa7 tempest-ProjectReaderTests-916980377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c7fbfa60-8297-496a-83e6-606280464488" returned: 0 in 0.401s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:52 devstack sudo[108837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-14d8799d-acee-47f9-9806-4f96914beaa7 tempest-ProjectReaderTests-916980377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c7fbfa60-8297-496a-83e6-606280464488.1af931ca-9130-4ba2-aa47-93bf657246eb {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:52 devstack sudo[108839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c7fbfa60-8297-496a-83e6-606280464488.1af931ca-9130-4ba2-aa47-93bf657246eb Sep 25 12:04:52 devstack sudo[108839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:53 devstack sudo[108839]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-14d8799d-acee-47f9-9806-4f96914beaa7 tempest-ProjectReaderTests-916980377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c7fbfa60-8297-496a-83e6-606280464488.1af931ca-9130-4ba2-aa47-93bf657246eb" returned: 0 in 0.371s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-14d8799d-acee-47f9-9806-4f96914beaa7 tempest-ProjectReaderTests-916980377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c7fbfa60-8297-496a-83e6-606280464488.1af931ca-9130-4ba2-aa47-93bf657246eb {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:53 devstack sudo[108848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c7fbfa60-8297-496a-83e6-606280464488.1af931ca-9130-4ba2-aa47-93bf657246eb Sep 25 12:04:53 devstack sudo[108848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:53 devstack sudo[108837]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f9ac7da3-082b-43d2-b0ef-0508d7cccbe9 tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-76025640-be40-42c0-9bfa-ae1610b4d7e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-76025640-be40-42c0-9bfa-ae1610b4d7e7.d0e03948-c220-4b04-a8a0-4a9adafb5247 1G" returned: 0 in 0.464s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f9ac7da3-082b-43d2-b0ef-0508d7cccbe9 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76025640-be40-42c0-9bfa-ae1610b4d7e7 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-76025640-be40-42c0-9bfa-ae1610b4d7e7.d0e03948-c220-4b04-a8a0-4a9adafb5247 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:53 devstack sudo[108850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76025640-be40-42c0-9bfa-ae1610b4d7e7 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-76025640-be40-42c0-9bfa-ae1610b4d7e7.d0e03948-c220-4b04-a8a0-4a9adafb5247 Sep 25 12:04:53 devstack sudo[108850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:53 devstack sudo[108848]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-14d8799d-acee-47f9-9806-4f96914beaa7 tempest-ProjectReaderTests-916980377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c7fbfa60-8297-496a-83e6-606280464488.1af931ca-9130-4ba2-aa47-93bf657246eb" returned: 0 in 0.273s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:53 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-14d8799d-acee-47f9-9806-4f96914beaa7 tempest-ProjectReaderTests-916980377 None] Lock "cinder-quobyte-1af931ca-9130-4ba2-aa47-93bf657246eb" released by "_delete_snapshot" :: held 1.576s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:04:53 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-14d8799d-acee-47f9-9806-4f96914beaa7 tempest-ProjectReaderTests-916980377 None] Lock "cinder-quobyte-c7fbfa60-8297-496a-83e6-606280464488" released by "delete_snapshot" :: held 1.606s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:04:53 devstack sudo[108850]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f9ac7da3-082b-43d2-b0ef-0508d7cccbe9 tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76025640-be40-42c0-9bfa-ae1610b4d7e7 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-76025640-be40-42c0-9bfa-ae1610b4d7e7.d0e03948-c220-4b04-a8a0-4a9adafb5247" returned: 0 in 0.325s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:53 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-f9ac7da3-082b-43d2-b0ef-0508d7cccbe9 tempest-ProjectMemberTests-1434405994 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-76025640-be40-42c0-9bfa-ae1610b4d7e7.d0e03948-c220-4b04-a8a0-4a9adafb5247 is being set with open permissions: ugo+rw Sep 25 12:04:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f9ac7da3-082b-43d2-b0ef-0508d7cccbe9 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-76025640-be40-42c0-9bfa-ae1610b4d7e7.d0e03948-c220-4b04-a8a0-4a9adafb5247 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:53 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-14d8799d-acee-47f9-9806-4f96914beaa7 tempest-ProjectReaderTests-916980377 None] Created reservations ['af015c36-7fae-4526-a03b-f752de14dc50', 'b2321caa-301c-4fc4-b0d1-4267c9b61df3', '050cf66c-cf95-4197-89cf-fbd73cf51e3f', '479476b5-4c70-47d8-a4a4-125220ef0fd8'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:04:53 devstack sudo[108856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-76025640-be40-42c0-9bfa-ae1610b4d7e7.d0e03948-c220-4b04-a8a0-4a9adafb5247 Sep 25 12:04:53 devstack sudo[108856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:53 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-14d8799d-acee-47f9-9806-4f96914beaa7 tempest-ProjectReaderTests-916980377 None] Delete snapshot completed successfully. Sep 25 12:04:53 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-14d8799d-acee-47f9-9806-4f96914beaa7 tempest-ProjectReaderTests-916980377 None] Lock "cinder-1af931ca-9130-4ba2-aa47-93bf657246eb-delete_snapshot" released by "delete_snapshot" :: held 1.801s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:04:53 devstack sudo[108856]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f9ac7da3-082b-43d2-b0ef-0508d7cccbe9 tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-76025640-be40-42c0-9bfa-ae1610b4d7e7.d0e03948-c220-4b04-a8a0-4a9adafb5247" returned: 0 in 0.282s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f9ac7da3-082b-43d2-b0ef-0508d7cccbe9 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-76025640-be40-42c0-9bfa-ae1610b4d7e7.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:53 devstack sudo[108859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-76025640-be40-42c0-9bfa-ae1610b4d7e7.info Sep 25 12:04:53 devstack sudo[108859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:53 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-a5572101-a812-475b-b288-9b3b21899c17 tempest-ProjectReaderTests-916980377 None] Acquiring lock "cinder-c7fbfa60-8297-496a-83e6-606280464488-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:04:53 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-a5572101-a812-475b-b288-9b3b21899c17 tempest-ProjectReaderTests-916980377 None] Lock "cinder-c7fbfa60-8297-496a-83e6-606280464488-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:04:53 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-a5572101-a812-475b-b288-9b3b21899c17 tempest-ProjectReaderTests-916980377 None] Acquiring lock "cinder-quobyte-c7fbfa60-8297-496a-83e6-606280464488" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:04:53 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-a5572101-a812-475b-b288-9b3b21899c17 tempest-ProjectReaderTests-916980377 None] Lock "cinder-quobyte-c7fbfa60-8297-496a-83e6-606280464488" acquired by "delete_volume" :: waited 0.020s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:04:54 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f7d2a75-093d-4476-a228-59bc39d7e908]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:04:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a5572101-a812-475b-b288-9b3b21899c17 tempest-ProjectReaderTests-916980377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c7fbfa60-8297-496a-83e6-606280464488 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:54 devstack sudo[108859]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f9ac7da3-082b-43d2-b0ef-0508d7cccbe9 tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-76025640-be40-42c0-9bfa-ae1610b4d7e7.info" returned: 0 in 0.305s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:54 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-f9ac7da3-082b-43d2-b0ef-0508d7cccbe9 tempest-ProjectMemberTests-1434405994 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-76025640-be40-42c0-9bfa-ae1610b4d7e7.info is being set with open permissions: ugo+rw Sep 25 12:04:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f9ac7da3-082b-43d2-b0ef-0508d7cccbe9 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-76025640-be40-42c0-9bfa-ae1610b4d7e7.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:54 devstack sudo[108864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-76025640-be40-42c0-9bfa-ae1610b4d7e7.info Sep 25 12:04:54 devstack sudo[108864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:54 devstack sudo[108863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c7fbfa60-8297-496a-83e6-606280464488 Sep 25 12:04:54 devstack sudo[108863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:54 devstack sudo[108864]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-f9ac7da3-082b-43d2-b0ef-0508d7cccbe9 tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-76025640-be40-42c0-9bfa-ae1610b4d7e7.info" returned: 0 in 0.285s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-f9ac7da3-082b-43d2-b0ef-0508d7cccbe9 tempest-ProjectMemberTests-1434405994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.190s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:04:54 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-f9ac7da3-082b-43d2-b0ef-0508d7cccbe9 tempest-ProjectMemberTests-1434405994 None] Create snapshot completed successfully Sep 25 12:04:54 devstack sudo[108863]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a5572101-a812-475b-b288-9b3b21899c17 tempest-ProjectReaderTests-916980377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c7fbfa60-8297-496a-83e6-606280464488" returned: 0 in 0.421s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a5572101-a812-475b-b288-9b3b21899c17 tempest-ProjectReaderTests-916980377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c7fbfa60-8297-496a-83e6-606280464488 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:54 devstack sudo[108871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c7fbfa60-8297-496a-83e6-606280464488 Sep 25 12:04:54 devstack sudo[108871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:54 devstack sudo[108871]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a5572101-a812-475b-b288-9b3b21899c17 tempest-ProjectReaderTests-916980377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-c7fbfa60-8297-496a-83e6-606280464488" returned: 0 in 0.289s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:54 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-a5572101-a812-475b-b288-9b3b21899c17 tempest-ProjectReaderTests-916980377 None] Lock "cinder-quobyte-c7fbfa60-8297-496a-83e6-606280464488" released by "delete_volume" :: held 0.782s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:04:54 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-a5572101-a812-475b-b288-9b3b21899c17 tempest-ProjectReaderTests-916980377 None] Created reservations ['b0d18711-30e3-483e-b22d-14a81e9d6518', 'c76898e3-0d17-4472-89d5-af3f7052fc6e', '0806f09d-e6a3-45fa-aec1-cc9f240e7ae6', '6f7db507-5df0-4303-b158-ffb03c7eaedd'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:04:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-a5572101-a812-475b-b288-9b3b21899c17 tempest-ProjectReaderTests-916980377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:04:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-a5572101-a812-475b-b288-9b3b21899c17 tempest-ProjectReaderTests-916980377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:04:54 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-a5572101-a812-475b-b288-9b3b21899c17 tempest-ProjectReaderTests-916980377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:04:54 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-a5572101-a812-475b-b288-9b3b21899c17 tempest-ProjectReaderTests-916980377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:04:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-a5572101-a812-475b-b288-9b3b21899c17 tempest-ProjectReaderTests-916980377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:04:54 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a5572101-a812-475b-b288-9b3b21899c17 tempest-ProjectReaderTests-916980377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:54 devstack sudo[108874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 12:04:54 devstack sudo[108874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:55 devstack sudo[108874]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a5572101-a812-475b-b288-9b3b21899c17 tempest-ProjectReaderTests-916980377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.272s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:55 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-a5572101-a812-475b-b288-9b3b21899c17 tempest-ProjectReaderTests-916980377 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:04:55 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-a5572101-a812-475b-b288-9b3b21899c17 tempest-ProjectReaderTests-916980377 None] Deleted volume successfully. Sep 25 12:04:55 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-a5572101-a812-475b-b288-9b3b21899c17 tempest-ProjectReaderTests-916980377 None] Lock "cinder-c7fbfa60-8297-496a-83e6-606280464488-delete_volume" released by "delete_volume" :: held 1.346s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:04:55 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-6ac05bee-789f-4eb6-877c-a459c0aa3a04 tempest-ProjectMemberTests-1434405994 None] Acquiring lock "cinder-d0e03948-c220-4b04-a8a0-4a9adafb5247-delete_snapshot" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:04:55 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-6ac05bee-789f-4eb6-877c-a459c0aa3a04 tempest-ProjectMemberTests-1434405994 None] Lock "cinder-d0e03948-c220-4b04-a8a0-4a9adafb5247-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:04:55 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-6ac05bee-789f-4eb6-877c-a459c0aa3a04 tempest-ProjectMemberTests-1434405994 None] Acquiring lock "cinder-quobyte-76025640-be40-42c0-9bfa-ae1610b4d7e7" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:04:55 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-6ac05bee-789f-4eb6-877c-a459c0aa3a04 tempest-ProjectMemberTests-1434405994 None] Lock "cinder-quobyte-76025640-be40-42c0-9bfa-ae1610b4d7e7" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:04:55 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-6ac05bee-789f-4eb6-877c-a459c0aa3a04 tempest-ProjectMemberTests-1434405994 None] Acquiring lock "cinder-quobyte-d0e03948-c220-4b04-a8a0-4a9adafb5247" by "_delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:04:55 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-6ac05bee-789f-4eb6-877c-a459c0aa3a04 tempest-ProjectMemberTests-1434405994 None] Lock "cinder-quobyte-d0e03948-c220-4b04-a8a0-4a9adafb5247" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:04:55 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-6ac05bee-789f-4eb6-877c-a459c0aa3a04 tempest-ProjectMemberTests-1434405994 None] Deleting offline snapshot d0e03948-c220-4b04-a8a0-4a9adafb5247 of volume 76025640-be40-42c0-9bfa-ae1610b4d7e7 {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 12:04:55 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-6ac05bee-789f-4eb6-877c-a459c0aa3a04 tempest-ProjectMemberTests-1434405994 None] snapshot_file for this snap is: volume-76025640-be40-42c0-9bfa-ae1610b4d7e7.d0e03948-c220-4b04-a8a0-4a9adafb5247 {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 12:04:55 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[7470198e-2d70-470a-bf54-e26875f135d4]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:04:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6ac05bee-789f-4eb6-877c-a459c0aa3a04 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-76025640-be40-42c0-9bfa-ae1610b4d7e7.d0e03948-c220-4b04-a8a0-4a9adafb5247 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:55 devstack sudo[108877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-76025640-be40-42c0-9bfa-ae1610b4d7e7.d0e03948-c220-4b04-a8a0-4a9adafb5247 Sep 25 12:04:55 devstack sudo[108877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:55 devstack sudo[108877]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:55 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6ac05bee-789f-4eb6-877c-a459c0aa3a04 tempest-ProjectMemberTests-1434405994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-76025640-be40-42c0-9bfa-ae1610b4d7e7.d0e03948-c220-4b04-a8a0-4a9adafb5247" returned: 0 in 0.472s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:55 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-6ac05bee-789f-4eb6-877c-a459c0aa3a04 tempest-ProjectMemberTests-1434405994 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-76025640-be40-42c0-9bfa-ae1610b4d7e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86984) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:04:56 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df42fe0-2e0c-49cc-aa5b-7e487f32ad16]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:04:56 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6ac05bee-789f-4eb6-877c-a459c0aa3a04 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-76025640-be40-42c0-9bfa-ae1610b4d7e7 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:56 devstack sudo[108882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-76025640-be40-42c0-9bfa-ae1610b4d7e7 Sep 25 12:04:56 devstack sudo[108882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:56 devstack sudo[108882]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:56 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6ac05bee-789f-4eb6-877c-a459c0aa3a04 tempest-ProjectMemberTests-1434405994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-76025640-be40-42c0-9bfa-ae1610b4d7e7" returned: 0 in 0.527s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:56 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6ac05bee-789f-4eb6-877c-a459c0aa3a04 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-76025640-be40-42c0-9bfa-ae1610b4d7e7.d0e03948-c220-4b04-a8a0-4a9adafb5247 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:56 devstack sudo[108889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-76025640-be40-42c0-9bfa-ae1610b4d7e7.d0e03948-c220-4b04-a8a0-4a9adafb5247 Sep 25 12:04:56 devstack sudo[108889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:56 devstack sudo[108889]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:56 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6ac05bee-789f-4eb6-877c-a459c0aa3a04 tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-76025640-be40-42c0-9bfa-ae1610b4d7e7.d0e03948-c220-4b04-a8a0-4a9adafb5247" returned: 0 in 0.412s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:56 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6ac05bee-789f-4eb6-877c-a459c0aa3a04 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-76025640-be40-42c0-9bfa-ae1610b4d7e7.d0e03948-c220-4b04-a8a0-4a9adafb5247 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:56 devstack sudo[108894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-76025640-be40-42c0-9bfa-ae1610b4d7e7.d0e03948-c220-4b04-a8a0-4a9adafb5247 Sep 25 12:04:56 devstack sudo[108894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:57 devstack sudo[108894]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:57 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-6ac05bee-789f-4eb6-877c-a459c0aa3a04 tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-76025640-be40-42c0-9bfa-ae1610b4d7e7.d0e03948-c220-4b04-a8a0-4a9adafb5247" returned: 0 in 0.298s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:57 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-6ac05bee-789f-4eb6-877c-a459c0aa3a04 tempest-ProjectMemberTests-1434405994 None] Lock "cinder-quobyte-d0e03948-c220-4b04-a8a0-4a9adafb5247" released by "_delete_snapshot" :: held 1.850s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:04:57 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-6ac05bee-789f-4eb6-877c-a459c0aa3a04 tempest-ProjectMemberTests-1434405994 None] Lock "cinder-quobyte-76025640-be40-42c0-9bfa-ae1610b4d7e7" released by "delete_snapshot" :: held 1.881s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:04:57 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-6ac05bee-789f-4eb6-877c-a459c0aa3a04 tempest-ProjectMemberTests-1434405994 None] Created reservations ['c7bc7cfd-7e20-4753-856f-92d0422e83b6', 'fad9ac83-e043-450f-80a4-c929bf72902d', '08c40d4b-487f-48e6-81f1-a5bbb20666dd', '133b6833-cd23-400c-9690-5e742f5ab264'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:04:57 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-6ac05bee-789f-4eb6-877c-a459c0aa3a04 tempest-ProjectMemberTests-1434405994 None] Delete snapshot completed successfully. Sep 25 12:04:57 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-6ac05bee-789f-4eb6-877c-a459c0aa3a04 tempest-ProjectMemberTests-1434405994 None] Lock "cinder-d0e03948-c220-4b04-a8a0-4a9adafb5247-delete_snapshot" released by "delete_snapshot" :: held 2.050s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:04:57 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-98a1896a-6f80-418d-a887-fa92a71e8309 tempest-ProjectMemberTests-1434405994 None] Acquiring lock "cinder-76025640-be40-42c0-9bfa-ae1610b4d7e7-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:04:57 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-98a1896a-6f80-418d-a887-fa92a71e8309 tempest-ProjectMemberTests-1434405994 None] Lock "cinder-76025640-be40-42c0-9bfa-ae1610b4d7e7-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:04:57 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-98a1896a-6f80-418d-a887-fa92a71e8309 tempest-ProjectMemberTests-1434405994 None] Acquiring lock "cinder-quobyte-76025640-be40-42c0-9bfa-ae1610b4d7e7" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:04:57 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-98a1896a-6f80-418d-a887-fa92a71e8309 tempest-ProjectMemberTests-1434405994 None] Lock "cinder-quobyte-76025640-be40-42c0-9bfa-ae1610b4d7e7" acquired by "delete_volume" :: waited 0.019s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:04:57 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[e02d158c-2b12-4d2d-aa34-50fa3d4e578f]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:04:57 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-98a1896a-6f80-418d-a887-fa92a71e8309 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-76025640-be40-42c0-9bfa-ae1610b4d7e7 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:57 devstack sudo[108897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-76025640-be40-42c0-9bfa-ae1610b4d7e7 Sep 25 12:04:57 devstack sudo[108897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:58 devstack sudo[108897]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:58 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-98a1896a-6f80-418d-a887-fa92a71e8309 tempest-ProjectMemberTests-1434405994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-76025640-be40-42c0-9bfa-ae1610b4d7e7" returned: 0 in 0.435s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:58 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-98a1896a-6f80-418d-a887-fa92a71e8309 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-76025640-be40-42c0-9bfa-ae1610b4d7e7 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:58 devstack sudo[108902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-76025640-be40-42c0-9bfa-ae1610b4d7e7 Sep 25 12:04:58 devstack sudo[108902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:58 devstack sudo[108902]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:58 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-98a1896a-6f80-418d-a887-fa92a71e8309 tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-76025640-be40-42c0-9bfa-ae1610b4d7e7" returned: 0 in 0.290s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:58 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-98a1896a-6f80-418d-a887-fa92a71e8309 tempest-ProjectMemberTests-1434405994 None] Lock "cinder-quobyte-76025640-be40-42c0-9bfa-ae1610b4d7e7" released by "delete_volume" :: held 0.800s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:04:58 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-98a1896a-6f80-418d-a887-fa92a71e8309 tempest-ProjectMemberTests-1434405994 None] Created reservations ['a27c47ca-18d3-496f-af78-d7dd9d52ad4e', '2e7e52fb-86b5-4f87-a3b7-66bdadbb6e64', '02f9c7db-419d-43df-a528-f0bdc827d662', '2f1c715f-d6ee-4c41-a64f-3b281ecc0b3b'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:04:58 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-98a1896a-6f80-418d-a887-fa92a71e8309 tempest-ProjectMemberTests-1434405994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:04:58 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-98a1896a-6f80-418d-a887-fa92a71e8309 tempest-ProjectMemberTests-1434405994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:04:58 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-98a1896a-6f80-418d-a887-fa92a71e8309 tempest-ProjectMemberTests-1434405994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:04:58 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-98a1896a-6f80-418d-a887-fa92a71e8309 tempest-ProjectMemberTests-1434405994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:04:58 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-98a1896a-6f80-418d-a887-fa92a71e8309 tempest-ProjectMemberTests-1434405994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:04:58 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-98a1896a-6f80-418d-a887-fa92a71e8309 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:58 devstack sudo[108905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 12:04:58 devstack sudo[108905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:04:58 devstack sudo[108905]: pam_unix(sudo:session): session closed for user root Sep 25 12:04:58 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-98a1896a-6f80-418d-a887-fa92a71e8309 tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.307s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:04:58 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-98a1896a-6f80-418d-a887-fa92a71e8309 tempest-ProjectMemberTests-1434405994 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:04:58 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-98a1896a-6f80-418d-a887-fa92a71e8309 tempest-ProjectMemberTests-1434405994 None] Deleted volume successfully. Sep 25 12:04:58 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-98a1896a-6f80-418d-a887-fa92a71e8309 tempest-ProjectMemberTests-1434405994 None] Lock "cinder-76025640-be40-42c0-9bfa-ae1610b4d7e7-delete_volume" released by "delete_volume" :: held 1.364s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:04:59 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-e77d1df2-a18b-4579-ba8f-3fef792cea17 tempest-ProjectMemberTests-1434405994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:04:59 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e77d1df2-a18b-4579-ba8f-3fef792cea17 tempest-ProjectMemberTests-1434405994 None] Flow 'volume_create_manager' (adcb2fd9-a8ff-4c19-98d8-a3e250dbf84c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:04:59 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e77d1df2-a18b-4579-ba8f-3fef792cea17 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c75d529-10bc-440e-86f7-ed9ce6d6a022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:04:59 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e77d1df2-a18b-4579-ba8f-3fef792cea17 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c75d529-10bc-440e-86f7-ed9ce6d6a022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:04:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1302840978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9760807c-d3c1-475e-84db-98e9305fd47c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c75afeac65f84f13b7d0325fa4b21b65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:04:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:04:59Z,use_quota=True,user_id='770f7e0a81074bae8bcd048c8d7f7347',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:04:59 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e77d1df2-a18b-4579-ba8f-3fef792cea17 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23feadc8-6c00-41e8-8f8c-73b894a19bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:04:59 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e77d1df2-a18b-4579-ba8f-3fef792cea17 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23feadc8-6c00-41e8-8f8c-73b894a19bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:04:59 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e77d1df2-a18b-4579-ba8f-3fef792cea17 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1770b07-3be4-4632-ae03-0f5f19f3e084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:04:59 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e77d1df2-a18b-4579-ba8f-3fef792cea17 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1770b07-3be4-4632-ae03-0f5f19f3e084) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9760807c-d3c1-475e-84db-98e9305fd47c', 'volume_name': 'volume-9760807c-d3c1-475e-84db-98e9305fd47c', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:04:59 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e77d1df2-a18b-4579-ba8f-3fef792cea17 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea540096-dd43-45ac-9338-0f8aea94ef78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:04:59 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e77d1df2-a18b-4579-ba8f-3fef792cea17 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea540096-dd43-45ac-9338-0f8aea94ef78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:04:59 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e77d1df2-a18b-4579-ba8f-3fef792cea17 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca22179d-b520-4d2f-9911-d10c8dad45a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:04:59 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-e77d1df2-a18b-4579-ba8f-3fef792cea17 tempest-ProjectMemberTests-1434405994 None] Volume 9760807c-d3c1-475e-84db-98e9305fd47c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9760807c-d3c1-475e-84db-98e9305fd47c', 'volume_size': 1} Sep 25 12:04:59 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-e77d1df2-a18b-4579-ba8f-3fef792cea17 tempest-ProjectMemberTests-1434405994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:04:59 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-e77d1df2-a18b-4579-ba8f-3fef792cea17 tempest-ProjectMemberTests-1434405994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:04:59 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-e77d1df2-a18b-4579-ba8f-3fef792cea17 tempest-ProjectMemberTests-1434405994 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:04:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1302840978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9760807c-d3c1-475e-84db-98e9305fd47c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c75afeac65f84f13b7d0325fa4b21b65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:04:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:04:59Z,use_quota=True,user_id='770f7e0a81074bae8bcd048c8d7f7347',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:04:59 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-e77d1df2-a18b-4579-ba8f-3fef792cea17 tempest-ProjectMemberTests-1434405994 None] Creating volume 9760807c-d3c1-475e-84db-98e9305fd47c {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:04:59 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-e77d1df2-a18b-4579-ba8f-3fef792cea17 tempest-ProjectMemberTests-1434405994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:04:59 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-e77d1df2-a18b-4579-ba8f-3fef792cea17 tempest-ProjectMemberTests-1434405994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:04:59 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-e77d1df2-a18b-4579-ba8f-3fef792cea17 tempest-ProjectMemberTests-1434405994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:04:59 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-e77d1df2-a18b-4579-ba8f-3fef792cea17 tempest-ProjectMemberTests-1434405994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:04:59 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-e77d1df2-a18b-4579-ba8f-3fef792cea17 tempest-ProjectMemberTests-1434405994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:04:59 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-e77d1df2-a18b-4579-ba8f-3fef792cea17 tempest-ProjectMemberTests-1434405994 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:04:59 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-e77d1df2-a18b-4579-ba8f-3fef792cea17 tempest-ProjectMemberTests-1434405994 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 12:04:59 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e77d1df2-a18b-4579-ba8f-3fef792cea17 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9760807c-d3c1-475e-84db-98e9305fd47c 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:04:59 devstack sudo[108942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9760807c-d3c1-475e-84db-98e9305fd47c 1073741824 Sep 25 12:04:59 devstack sudo[108942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:05:00 devstack sudo[108942]: pam_unix(sudo:session): session closed for user root Sep 25 12:05:00 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e77d1df2-a18b-4579-ba8f-3fef792cea17 tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9760807c-d3c1-475e-84db-98e9305fd47c 1073741824" returned: 0 in 0.564s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:05:00 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e77d1df2-a18b-4579-ba8f-3fef792cea17 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9760807c-d3c1-475e-84db-98e9305fd47c {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:05:00 devstack sudo[108949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9760807c-d3c1-475e-84db-98e9305fd47c Sep 25 12:05:00 devstack sudo[108949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:05:00 devstack sudo[108949]: pam_unix(sudo:session): session closed for user root Sep 25 12:05:00 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-e77d1df2-a18b-4579-ba8f-3fef792cea17 tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9760807c-d3c1-475e-84db-98e9305fd47c" returned: 0 in 0.291s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:05:00 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-e77d1df2-a18b-4579-ba8f-3fef792cea17 tempest-ProjectMemberTests-1434405994 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:05:00 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-e77d1df2-a18b-4579-ba8f-3fef792cea17 tempest-ProjectMemberTests-1434405994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:05:00 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e77d1df2-a18b-4579-ba8f-3fef792cea17 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca22179d-b520-4d2f-9911-d10c8dad45a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9760807c-d3c1-475e-84db-98e9305fd47c', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:05:00 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e77d1df2-a18b-4579-ba8f-3fef792cea17 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (437c9bed-74c2-41f6-9a7f-e885832cf354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:05:00 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-e77d1df2-a18b-4579-ba8f-3fef792cea17 tempest-ProjectMemberTests-1434405994 None] Volume volume-9760807c-d3c1-475e-84db-98e9305fd47c (9760807c-d3c1-475e-84db-98e9305fd47c): created successfully Sep 25 12:05:00 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e77d1df2-a18b-4579-ba8f-3fef792cea17 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (437c9bed-74c2-41f6-9a7f-e885832cf354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:05:00 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-e77d1df2-a18b-4579-ba8f-3fef792cea17 tempest-ProjectMemberTests-1434405994 None] Flow 'volume_create_manager' (adcb2fd9-a8ff-4c19-98d8-a3e250dbf84c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:05:00 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-e77d1df2-a18b-4579-ba8f-3fef792cea17 tempest-ProjectMemberTests-1434405994 None] Created volume successfully. Sep 25 12:05:01 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-ff73a043-e38a-4b18-9de1-f55f9d7a4621 tempest-ProjectMemberTests-1434405994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:05:01 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-ff73a043-e38a-4b18-9de1-f55f9d7a4621 tempest-ProjectMemberTests-1434405994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:05:01 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-ff73a043-e38a-4b18-9de1-f55f9d7a4621 tempest-ProjectMemberTests-1434405994 None] Creating offline snapshot d0dd7ce7-8425-4216-8741-44f9494861ed of volume 9760807c-d3c1-475e-84db-98e9305fd47c {{(pid=86984) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 12:05:01 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[582c4401-0aeb-4001-9c3a-bd4e602e108f]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:05:01 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ff73a043-e38a-4b18-9de1-f55f9d7a4621 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9760807c-d3c1-475e-84db-98e9305fd47c {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:05:01 devstack sudo[108955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9760807c-d3c1-475e-84db-98e9305fd47c Sep 25 12:05:01 devstack sudo[108955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:05:02 devstack sudo[108955]: pam_unix(sudo:session): session closed for user root Sep 25 12:05:02 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ff73a043-e38a-4b18-9de1-f55f9d7a4621 tempest-ProjectMemberTests-1434405994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9760807c-d3c1-475e-84db-98e9305fd47c" returned: 0 in 0.502s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:05:02 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ff73a043-e38a-4b18-9de1-f55f9d7a4621 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9760807c-d3c1-475e-84db-98e9305fd47c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9760807c-d3c1-475e-84db-98e9305fd47c.d0dd7ce7-8425-4216-8741-44f9494861ed 1G {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:05:02 devstack sudo[108960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9760807c-d3c1-475e-84db-98e9305fd47c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9760807c-d3c1-475e-84db-98e9305fd47c.d0dd7ce7-8425-4216-8741-44f9494861ed 1G Sep 25 12:05:02 devstack sudo[108960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:05:02 devstack sudo[108960]: pam_unix(sudo:session): session closed for user root Sep 25 12:05:02 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ff73a043-e38a-4b18-9de1-f55f9d7a4621 tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9760807c-d3c1-475e-84db-98e9305fd47c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9760807c-d3c1-475e-84db-98e9305fd47c.d0dd7ce7-8425-4216-8741-44f9494861ed 1G" returned: 0 in 0.510s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:05:02 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ff73a043-e38a-4b18-9de1-f55f9d7a4621 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9760807c-d3c1-475e-84db-98e9305fd47c -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9760807c-d3c1-475e-84db-98e9305fd47c.d0dd7ce7-8425-4216-8741-44f9494861ed {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:05:02 devstack sudo[108966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9760807c-d3c1-475e-84db-98e9305fd47c -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9760807c-d3c1-475e-84db-98e9305fd47c.d0dd7ce7-8425-4216-8741-44f9494861ed Sep 25 12:05:02 devstack sudo[108966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:05:03 devstack sudo[108966]: pam_unix(sudo:session): session closed for user root Sep 25 12:05:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ff73a043-e38a-4b18-9de1-f55f9d7a4621 tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9760807c-d3c1-475e-84db-98e9305fd47c -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9760807c-d3c1-475e-84db-98e9305fd47c.d0dd7ce7-8425-4216-8741-44f9494861ed" returned: 0 in 0.352s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:05:03 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-ff73a043-e38a-4b18-9de1-f55f9d7a4621 tempest-ProjectMemberTests-1434405994 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9760807c-d3c1-475e-84db-98e9305fd47c.d0dd7ce7-8425-4216-8741-44f9494861ed is being set with open permissions: ugo+rw Sep 25 12:05:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ff73a043-e38a-4b18-9de1-f55f9d7a4621 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9760807c-d3c1-475e-84db-98e9305fd47c.d0dd7ce7-8425-4216-8741-44f9494861ed {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:05:03 devstack sudo[108971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9760807c-d3c1-475e-84db-98e9305fd47c.d0dd7ce7-8425-4216-8741-44f9494861ed Sep 25 12:05:03 devstack sudo[108971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:05:03 devstack sudo[108971]: pam_unix(sudo:session): session closed for user root Sep 25 12:05:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ff73a043-e38a-4b18-9de1-f55f9d7a4621 tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9760807c-d3c1-475e-84db-98e9305fd47c.d0dd7ce7-8425-4216-8741-44f9494861ed" returned: 0 in 0.350s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:05:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ff73a043-e38a-4b18-9de1-f55f9d7a4621 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9760807c-d3c1-475e-84db-98e9305fd47c.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:05:03 devstack sudo[108974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9760807c-d3c1-475e-84db-98e9305fd47c.info Sep 25 12:05:03 devstack sudo[108974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:05:03 devstack sudo[108974]: pam_unix(sudo:session): session closed for user root Sep 25 12:05:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ff73a043-e38a-4b18-9de1-f55f9d7a4621 tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9760807c-d3c1-475e-84db-98e9305fd47c.info" returned: 0 in 0.306s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:05:03 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-ff73a043-e38a-4b18-9de1-f55f9d7a4621 tempest-ProjectMemberTests-1434405994 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9760807c-d3c1-475e-84db-98e9305fd47c.info is being set with open permissions: ugo+rw Sep 25 12:05:03 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ff73a043-e38a-4b18-9de1-f55f9d7a4621 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9760807c-d3c1-475e-84db-98e9305fd47c.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:05:03 devstack sudo[108977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9760807c-d3c1-475e-84db-98e9305fd47c.info Sep 25 12:05:03 devstack sudo[108977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:05:04 devstack sudo[108977]: pam_unix(sudo:session): session closed for user root Sep 25 12:05:04 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ff73a043-e38a-4b18-9de1-f55f9d7a4621 tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9760807c-d3c1-475e-84db-98e9305fd47c.info" returned: 0 in 0.363s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:05:04 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-ff73a043-e38a-4b18-9de1-f55f9d7a4621 tempest-ProjectMemberTests-1434405994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.507s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:05:04 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-ff73a043-e38a-4b18-9de1-f55f9d7a4621 tempest-ProjectMemberTests-1434405994 None] Create snapshot completed successfully Sep 25 12:05:04 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-35879307-d822-4394-9964-5954df119fcb tempest-ProjectMemberTests-1434405994 None] Acquiring lock "cinder-d0dd7ce7-8425-4216-8741-44f9494861ed-delete_snapshot" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:05:04 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-35879307-d822-4394-9964-5954df119fcb tempest-ProjectMemberTests-1434405994 None] Lock "cinder-d0dd7ce7-8425-4216-8741-44f9494861ed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:05:04 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-35879307-d822-4394-9964-5954df119fcb tempest-ProjectMemberTests-1434405994 None] Acquiring lock "cinder-quobyte-9760807c-d3c1-475e-84db-98e9305fd47c" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:05:04 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-35879307-d822-4394-9964-5954df119fcb tempest-ProjectMemberTests-1434405994 None] Lock "cinder-quobyte-9760807c-d3c1-475e-84db-98e9305fd47c" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:05:04 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-35879307-d822-4394-9964-5954df119fcb tempest-ProjectMemberTests-1434405994 None] Acquiring lock "cinder-quobyte-d0dd7ce7-8425-4216-8741-44f9494861ed" by "_delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:05:04 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-35879307-d822-4394-9964-5954df119fcb tempest-ProjectMemberTests-1434405994 None] Lock "cinder-quobyte-d0dd7ce7-8425-4216-8741-44f9494861ed" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:05:04 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-35879307-d822-4394-9964-5954df119fcb tempest-ProjectMemberTests-1434405994 None] Deleting offline snapshot d0dd7ce7-8425-4216-8741-44f9494861ed of volume 9760807c-d3c1-475e-84db-98e9305fd47c {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 12:05:05 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-35879307-d822-4394-9964-5954df119fcb tempest-ProjectMemberTests-1434405994 None] snapshot_file for this snap is: volume-9760807c-d3c1-475e-84db-98e9305fd47c.d0dd7ce7-8425-4216-8741-44f9494861ed {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 12:05:05 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f6a8ab-feec-411d-910e-2d558d7e32fe]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:05:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-35879307-d822-4394-9964-5954df119fcb tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9760807c-d3c1-475e-84db-98e9305fd47c.d0dd7ce7-8425-4216-8741-44f9494861ed {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:05:05 devstack sudo[108981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9760807c-d3c1-475e-84db-98e9305fd47c.d0dd7ce7-8425-4216-8741-44f9494861ed Sep 25 12:05:05 devstack sudo[108981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:05:05 devstack sudo[108981]: pam_unix(sudo:session): session closed for user root Sep 25 12:05:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-35879307-d822-4394-9964-5954df119fcb tempest-ProjectMemberTests-1434405994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9760807c-d3c1-475e-84db-98e9305fd47c.d0dd7ce7-8425-4216-8741-44f9494861ed" returned: 0 in 0.483s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:05:05 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-35879307-d822-4394-9964-5954df119fcb tempest-ProjectMemberTests-1434405994 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9760807c-d3c1-475e-84db-98e9305fd47c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86984) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:05:05 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[920c801d-727a-4308-a030-46f2a1bec0a1]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:05:05 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-35879307-d822-4394-9964-5954df119fcb tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9760807c-d3c1-475e-84db-98e9305fd47c {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:05:05 devstack sudo[108986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9760807c-d3c1-475e-84db-98e9305fd47c Sep 25 12:05:05 devstack sudo[108986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:05:06 devstack sudo[108986]: pam_unix(sudo:session): session closed for user root Sep 25 12:05:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-35879307-d822-4394-9964-5954df119fcb tempest-ProjectMemberTests-1434405994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9760807c-d3c1-475e-84db-98e9305fd47c" returned: 0 in 0.447s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:05:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-35879307-d822-4394-9964-5954df119fcb tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9760807c-d3c1-475e-84db-98e9305fd47c.d0dd7ce7-8425-4216-8741-44f9494861ed {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:05:06 devstack sudo[108991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9760807c-d3c1-475e-84db-98e9305fd47c.d0dd7ce7-8425-4216-8741-44f9494861ed Sep 25 12:05:06 devstack sudo[108991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:05:06 devstack sudo[108991]: pam_unix(sudo:session): session closed for user root Sep 25 12:05:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-35879307-d822-4394-9964-5954df119fcb tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9760807c-d3c1-475e-84db-98e9305fd47c.d0dd7ce7-8425-4216-8741-44f9494861ed" returned: 0 in 0.439s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:05:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-35879307-d822-4394-9964-5954df119fcb tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9760807c-d3c1-475e-84db-98e9305fd47c.d0dd7ce7-8425-4216-8741-44f9494861ed {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:05:06 devstack sudo[108996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9760807c-d3c1-475e-84db-98e9305fd47c.d0dd7ce7-8425-4216-8741-44f9494861ed Sep 25 12:05:06 devstack sudo[108996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:05:06 devstack sudo[108996]: pam_unix(sudo:session): session closed for user root Sep 25 12:05:06 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-35879307-d822-4394-9964-5954df119fcb tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9760807c-d3c1-475e-84db-98e9305fd47c.d0dd7ce7-8425-4216-8741-44f9494861ed" returned: 0 in 0.318s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:05:06 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-35879307-d822-4394-9964-5954df119fcb tempest-ProjectMemberTests-1434405994 None] Lock "cinder-quobyte-d0dd7ce7-8425-4216-8741-44f9494861ed" released by "_delete_snapshot" :: held 1.830s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:05:06 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-35879307-d822-4394-9964-5954df119fcb tempest-ProjectMemberTests-1434405994 None] Lock "cinder-quobyte-9760807c-d3c1-475e-84db-98e9305fd47c" released by "delete_snapshot" :: held 1.861s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:05:06 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-35879307-d822-4394-9964-5954df119fcb tempest-ProjectMemberTests-1434405994 None] Created reservations ['e08e2b1e-5563-456b-90b4-1ea58c273424', 'f8b58272-488b-4b1d-aa55-dde50d6a488c', '1edd00a3-52bb-464a-a71d-9f28642cbca9', '80a18dbc-152c-4e4d-afcd-bd9700d2b208'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:05:06 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-35879307-d822-4394-9964-5954df119fcb tempest-ProjectMemberTests-1434405994 None] Delete snapshot completed successfully. Sep 25 12:05:06 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-35879307-d822-4394-9964-5954df119fcb tempest-ProjectMemberTests-1434405994 None] Lock "cinder-d0dd7ce7-8425-4216-8741-44f9494861ed-delete_snapshot" released by "delete_snapshot" :: held 2.040s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:05:07 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-27b1a12e-7d92-4d72-b14d-c86d9e9ca2f1 tempest-ProjectMemberTests-1434405994 None] Acquiring lock "cinder-9760807c-d3c1-475e-84db-98e9305fd47c-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:05:07 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-27b1a12e-7d92-4d72-b14d-c86d9e9ca2f1 tempest-ProjectMemberTests-1434405994 None] Lock "cinder-9760807c-d3c1-475e-84db-98e9305fd47c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:05:07 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-27b1a12e-7d92-4d72-b14d-c86d9e9ca2f1 tempest-ProjectMemberTests-1434405994 None] Acquiring lock "cinder-quobyte-9760807c-d3c1-475e-84db-98e9305fd47c" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:05:07 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-27b1a12e-7d92-4d72-b14d-c86d9e9ca2f1 tempest-ProjectMemberTests-1434405994 None] Lock "cinder-quobyte-9760807c-d3c1-475e-84db-98e9305fd47c" acquired by "delete_volume" :: waited 0.019s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:05:07 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fca84fd-424a-4f4a-9647-064d58c2d055]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:05:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-27b1a12e-7d92-4d72-b14d-c86d9e9ca2f1 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9760807c-d3c1-475e-84db-98e9305fd47c {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:05:07 devstack sudo[108999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9760807c-d3c1-475e-84db-98e9305fd47c Sep 25 12:05:07 devstack sudo[108999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:05:07 devstack sudo[108999]: pam_unix(sudo:session): session closed for user root Sep 25 12:05:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-27b1a12e-7d92-4d72-b14d-c86d9e9ca2f1 tempest-ProjectMemberTests-1434405994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9760807c-d3c1-475e-84db-98e9305fd47c" returned: 0 in 0.481s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:05:07 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-27b1a12e-7d92-4d72-b14d-c86d9e9ca2f1 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9760807c-d3c1-475e-84db-98e9305fd47c {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:05:07 devstack sudo[109004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9760807c-d3c1-475e-84db-98e9305fd47c Sep 25 12:05:07 devstack sudo[109004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:05:08 devstack sudo[109004]: pam_unix(sudo:session): session closed for user root Sep 25 12:05:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-27b1a12e-7d92-4d72-b14d-c86d9e9ca2f1 tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-9760807c-d3c1-475e-84db-98e9305fd47c" returned: 0 in 0.321s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:05:08 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-27b1a12e-7d92-4d72-b14d-c86d9e9ca2f1 tempest-ProjectMemberTests-1434405994 None] Lock "cinder-quobyte-9760807c-d3c1-475e-84db-98e9305fd47c" released by "delete_volume" :: held 0.890s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:05:08 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-27b1a12e-7d92-4d72-b14d-c86d9e9ca2f1 tempest-ProjectMemberTests-1434405994 None] Created reservations ['8e619300-0b3c-4082-a58c-71870e54bf55', '6b0ae45f-6b46-4c5d-bad2-cd1616593433', '3333fba0-ee04-403b-b574-860beb155069', 'e7e3c8c9-33af-4e0d-9bb6-8548bf933299'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:05:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-27b1a12e-7d92-4d72-b14d-c86d9e9ca2f1 tempest-ProjectMemberTests-1434405994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:05:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-27b1a12e-7d92-4d72-b14d-c86d9e9ca2f1 tempest-ProjectMemberTests-1434405994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:05:08 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-27b1a12e-7d92-4d72-b14d-c86d9e9ca2f1 tempest-ProjectMemberTests-1434405994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:05:08 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-27b1a12e-7d92-4d72-b14d-c86d9e9ca2f1 tempest-ProjectMemberTests-1434405994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:05:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-27b1a12e-7d92-4d72-b14d-c86d9e9ca2f1 tempest-ProjectMemberTests-1434405994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:05:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-27b1a12e-7d92-4d72-b14d-c86d9e9ca2f1 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:05:08 devstack sudo[109007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 12:05:08 devstack sudo[109007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:05:08 devstack sudo[109007]: pam_unix(sudo:session): session closed for user root Sep 25 12:05:08 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-27b1a12e-7d92-4d72-b14d-c86d9e9ca2f1 tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.406s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:05:08 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-27b1a12e-7d92-4d72-b14d-c86d9e9ca2f1 tempest-ProjectMemberTests-1434405994 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:05:08 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-27b1a12e-7d92-4d72-b14d-c86d9e9ca2f1 tempest-ProjectMemberTests-1434405994 None] Deleted volume successfully. Sep 25 12:05:08 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-27b1a12e-7d92-4d72-b14d-c86d9e9ca2f1 tempest-ProjectMemberTests-1434405994 None] Lock "cinder-9760807c-d3c1-475e-84db-98e9305fd47c-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:05:09 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d70be66-2e9c-4a64-acde-a7c39c103407 tempest-ProjectMemberTests-1434405994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:05:09 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4d70be66-2e9c-4a64-acde-a7c39c103407 tempest-ProjectMemberTests-1434405994 None] Flow 'volume_create_manager' (f68861e3-5ee1-47e1-abf5-dc5c7a52e88b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:05:09 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4d70be66-2e9c-4a64-acde-a7c39c103407 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00057f0b-b44d-4643-acb9-b4217229f0f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:05:09 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4d70be66-2e9c-4a64-acde-a7c39c103407 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00057f0b-b44d-4643-acb9-b4217229f0f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:05:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-113445152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f026d96-d05e-466f-bd14-e209cd3ce518,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c75afeac65f84f13b7d0325fa4b21b65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:05:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:05:09Z,use_quota=True,user_id='770f7e0a81074bae8bcd048c8d7f7347',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:05:09 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4d70be66-2e9c-4a64-acde-a7c39c103407 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4ac8081-c739-4bbf-a832-9a931499c0a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:05:09 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4d70be66-2e9c-4a64-acde-a7c39c103407 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4ac8081-c739-4bbf-a832-9a931499c0a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:05:09 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4d70be66-2e9c-4a64-acde-a7c39c103407 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d571c71-1d9f-43b1-9ac0-160c9c6f1434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:05:09 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4d70be66-2e9c-4a64-acde-a7c39c103407 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d571c71-1d9f-43b1-9ac0-160c9c6f1434) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f026d96-d05e-466f-bd14-e209cd3ce518', 'volume_name': 'volume-4f026d96-d05e-466f-bd14-e209cd3ce518', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:05:09 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4d70be66-2e9c-4a64-acde-a7c39c103407 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee68d93e-9e5a-4334-a7ce-480651445bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:05:09 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4d70be66-2e9c-4a64-acde-a7c39c103407 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee68d93e-9e5a-4334-a7ce-480651445bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:05:09 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4d70be66-2e9c-4a64-acde-a7c39c103407 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae2c345b-27f5-43ce-8476-bd6f9c4591d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:05:09 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-4d70be66-2e9c-4a64-acde-a7c39c103407 tempest-ProjectMemberTests-1434405994 None] Volume 4f026d96-d05e-466f-bd14-e209cd3ce518: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f026d96-d05e-466f-bd14-e209cd3ce518', 'volume_size': 1} Sep 25 12:05:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-4d70be66-2e9c-4a64-acde-a7c39c103407 tempest-ProjectMemberTests-1434405994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:05:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-4d70be66-2e9c-4a64-acde-a7c39c103407 tempest-ProjectMemberTests-1434405994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:05:09 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-4d70be66-2e9c-4a64-acde-a7c39c103407 tempest-ProjectMemberTests-1434405994 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:05:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-113445152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f026d96-d05e-466f-bd14-e209cd3ce518,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c75afeac65f84f13b7d0325fa4b21b65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:05:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:05:09Z,use_quota=True,user_id='770f7e0a81074bae8bcd048c8d7f7347',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:05:09 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-4d70be66-2e9c-4a64-acde-a7c39c103407 tempest-ProjectMemberTests-1434405994 None] Creating volume 4f026d96-d05e-466f-bd14-e209cd3ce518 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:05:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-4d70be66-2e9c-4a64-acde-a7c39c103407 tempest-ProjectMemberTests-1434405994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:05:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-4d70be66-2e9c-4a64-acde-a7c39c103407 tempest-ProjectMemberTests-1434405994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:05:09 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-4d70be66-2e9c-4a64-acde-a7c39c103407 tempest-ProjectMemberTests-1434405994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:05:09 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-4d70be66-2e9c-4a64-acde-a7c39c103407 tempest-ProjectMemberTests-1434405994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:05:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-4d70be66-2e9c-4a64-acde-a7c39c103407 tempest-ProjectMemberTests-1434405994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:05:09 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-4d70be66-2e9c-4a64-acde-a7c39c103407 tempest-ProjectMemberTests-1434405994 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:05:09 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-4d70be66-2e9c-4a64-acde-a7c39c103407 tempest-ProjectMemberTests-1434405994 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 12:05:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-4d70be66-2e9c-4a64-acde-a7c39c103407 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-4f026d96-d05e-466f-bd14-e209cd3ce518 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:05:09 devstack sudo[109010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-4f026d96-d05e-466f-bd14-e209cd3ce518 1073741824 Sep 25 12:05:09 devstack sudo[109010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:05:09 devstack sudo[109010]: pam_unix(sudo:session): session closed for user root Sep 25 12:05:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-4d70be66-2e9c-4a64-acde-a7c39c103407 tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-4f026d96-d05e-466f-bd14-e209cd3ce518 1073741824" returned: 0 in 0.528s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:05:09 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-4d70be66-2e9c-4a64-acde-a7c39c103407 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-4f026d96-d05e-466f-bd14-e209cd3ce518 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:05:09 devstack sudo[109016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-4f026d96-d05e-466f-bd14-e209cd3ce518 Sep 25 12:05:09 devstack sudo[109016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:05:10 devstack sudo[109016]: pam_unix(sudo:session): session closed for user root Sep 25 12:05:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-4d70be66-2e9c-4a64-acde-a7c39c103407 tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-4f026d96-d05e-466f-bd14-e209cd3ce518" returned: 0 in 0.326s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:05:10 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-4d70be66-2e9c-4a64-acde-a7c39c103407 tempest-ProjectMemberTests-1434405994 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:05:10 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-4d70be66-2e9c-4a64-acde-a7c39c103407 tempest-ProjectMemberTests-1434405994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:05:10 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4d70be66-2e9c-4a64-acde-a7c39c103407 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae2c345b-27f5-43ce-8476-bd6f9c4591d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f026d96-d05e-466f-bd14-e209cd3ce518', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:05:10 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4d70be66-2e9c-4a64-acde-a7c39c103407 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7901db6-1012-484f-b7ff-19f51827a61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:05:10 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-4d70be66-2e9c-4a64-acde-a7c39c103407 tempest-ProjectMemberTests-1434405994 None] Volume volume-4f026d96-d05e-466f-bd14-e209cd3ce518 (4f026d96-d05e-466f-bd14-e209cd3ce518): created successfully Sep 25 12:05:10 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4d70be66-2e9c-4a64-acde-a7c39c103407 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7901db6-1012-484f-b7ff-19f51827a61a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:05:10 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-4d70be66-2e9c-4a64-acde-a7c39c103407 tempest-ProjectMemberTests-1434405994 None] Flow 'volume_create_manager' (f68861e3-5ee1-47e1-abf5-dc5c7a52e88b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:05:10 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-4d70be66-2e9c-4a64-acde-a7c39c103407 tempest-ProjectMemberTests-1434405994 None] Created volume successfully. Sep 25 12:05:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-68022be4-5708-48e5-be07-4bae22ee5133 tempest-ProjectMemberTests-1434405994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:05:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-68022be4-5708-48e5-be07-4bae22ee5133 tempest-ProjectMemberTests-1434405994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:05:11 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-68022be4-5708-48e5-be07-4bae22ee5133 tempest-ProjectMemberTests-1434405994 None] Creating offline snapshot bb3594ce-94d3-42f6-8a0f-5567f766edd1 of volume 4f026d96-d05e-466f-bd14-e209cd3ce518 {{(pid=86984) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 12:05:11 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c1befd-9353-4b3e-b2d2-92c22931fd6c]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:05:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-68022be4-5708-48e5-be07-4bae22ee5133 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-4f026d96-d05e-466f-bd14-e209cd3ce518 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:05:11 devstack sudo[109019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-4f026d96-d05e-466f-bd14-e209cd3ce518 Sep 25 12:05:11 devstack sudo[109019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:05:11 devstack sudo[109019]: pam_unix(sudo:session): session closed for user root Sep 25 12:05:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-68022be4-5708-48e5-be07-4bae22ee5133 tempest-ProjectMemberTests-1434405994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-4f026d96-d05e-466f-bd14-e209cd3ce518" returned: 0 in 0.399s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:05:11 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-68022be4-5708-48e5-be07-4bae22ee5133 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-4f026d96-d05e-466f-bd14-e209cd3ce518,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-4f026d96-d05e-466f-bd14-e209cd3ce518.bb3594ce-94d3-42f6-8a0f-5567f766edd1 1G {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:05:11 devstack sudo[109024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-4f026d96-d05e-466f-bd14-e209cd3ce518,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-4f026d96-d05e-466f-bd14-e209cd3ce518.bb3594ce-94d3-42f6-8a0f-5567f766edd1 1G Sep 25 12:05:11 devstack sudo[109024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:05:12 devstack sudo[109024]: pam_unix(sudo:session): session closed for user root Sep 25 12:05:12 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-68022be4-5708-48e5-be07-4bae22ee5133 tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-4f026d96-d05e-466f-bd14-e209cd3ce518,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-4f026d96-d05e-466f-bd14-e209cd3ce518.bb3594ce-94d3-42f6-8a0f-5567f766edd1 1G" returned: 0 in 0.444s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:05:12 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-68022be4-5708-48e5-be07-4bae22ee5133 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f026d96-d05e-466f-bd14-e209cd3ce518 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-4f026d96-d05e-466f-bd14-e209cd3ce518.bb3594ce-94d3-42f6-8a0f-5567f766edd1 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:05:12 devstack sudo[109029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f026d96-d05e-466f-bd14-e209cd3ce518 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-4f026d96-d05e-466f-bd14-e209cd3ce518.bb3594ce-94d3-42f6-8a0f-5567f766edd1 Sep 25 12:05:12 devstack sudo[109029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:05:12 devstack sudo[109029]: pam_unix(sudo:session): session closed for user root Sep 25 12:05:12 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-68022be4-5708-48e5-be07-4bae22ee5133 tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f026d96-d05e-466f-bd14-e209cd3ce518 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-4f026d96-d05e-466f-bd14-e209cd3ce518.bb3594ce-94d3-42f6-8a0f-5567f766edd1" returned: 0 in 0.328s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:05:12 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-68022be4-5708-48e5-be07-4bae22ee5133 tempest-ProjectMemberTests-1434405994 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-4f026d96-d05e-466f-bd14-e209cd3ce518.bb3594ce-94d3-42f6-8a0f-5567f766edd1 is being set with open permissions: ugo+rw Sep 25 12:05:12 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-68022be4-5708-48e5-be07-4bae22ee5133 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-4f026d96-d05e-466f-bd14-e209cd3ce518.bb3594ce-94d3-42f6-8a0f-5567f766edd1 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:05:12 devstack sudo[109034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-4f026d96-d05e-466f-bd14-e209cd3ce518.bb3594ce-94d3-42f6-8a0f-5567f766edd1 Sep 25 12:05:12 devstack sudo[109034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:05:12 devstack sudo[109034]: pam_unix(sudo:session): session closed for user root Sep 25 12:05:12 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-68022be4-5708-48e5-be07-4bae22ee5133 tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-4f026d96-d05e-466f-bd14-e209cd3ce518.bb3594ce-94d3-42f6-8a0f-5567f766edd1" returned: 0 in 0.286s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:05:12 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-68022be4-5708-48e5-be07-4bae22ee5133 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-4f026d96-d05e-466f-bd14-e209cd3ce518.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:05:12 devstack sudo[109037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-4f026d96-d05e-466f-bd14-e209cd3ce518.info Sep 25 12:05:12 devstack sudo[109037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:05:13 devstack sudo[109037]: pam_unix(sudo:session): session closed for user root Sep 25 12:05:13 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-68022be4-5708-48e5-be07-4bae22ee5133 tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-4f026d96-d05e-466f-bd14-e209cd3ce518.info" returned: 0 in 0.298s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:05:13 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-68022be4-5708-48e5-be07-4bae22ee5133 tempest-ProjectMemberTests-1434405994 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-4f026d96-d05e-466f-bd14-e209cd3ce518.info is being set with open permissions: ugo+rw Sep 25 12:05:13 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-68022be4-5708-48e5-be07-4bae22ee5133 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-4f026d96-d05e-466f-bd14-e209cd3ce518.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:05:13 devstack sudo[109040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-4f026d96-d05e-466f-bd14-e209cd3ce518.info Sep 25 12:05:13 devstack sudo[109040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:05:13 devstack sudo[109040]: pam_unix(sudo:session): session closed for user root Sep 25 12:05:13 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-68022be4-5708-48e5-be07-4bae22ee5133 tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-4f026d96-d05e-466f-bd14-e209cd3ce518.info" returned: 0 in 0.314s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:05:13 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-68022be4-5708-48e5-be07-4bae22ee5133 tempest-ProjectMemberTests-1434405994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.166s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:05:13 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-68022be4-5708-48e5-be07-4bae22ee5133 tempest-ProjectMemberTests-1434405994 None] Create snapshot completed successfully Sep 25 12:05:14 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-4eebb5b9-9aec-48d7-a6b6-39a746b77302 tempest-ProjectMemberTests-1434405994 None] Acquiring lock "cinder-bb3594ce-94d3-42f6-8a0f-5567f766edd1-delete_snapshot" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:05:14 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-4eebb5b9-9aec-48d7-a6b6-39a746b77302 tempest-ProjectMemberTests-1434405994 None] Lock "cinder-bb3594ce-94d3-42f6-8a0f-5567f766edd1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:05:14 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-4eebb5b9-9aec-48d7-a6b6-39a746b77302 tempest-ProjectMemberTests-1434405994 None] Acquiring lock "cinder-quobyte-4f026d96-d05e-466f-bd14-e209cd3ce518" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:05:14 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-4eebb5b9-9aec-48d7-a6b6-39a746b77302 tempest-ProjectMemberTests-1434405994 None] Lock "cinder-quobyte-4f026d96-d05e-466f-bd14-e209cd3ce518" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:05:14 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-4eebb5b9-9aec-48d7-a6b6-39a746b77302 tempest-ProjectMemberTests-1434405994 None] Acquiring lock "cinder-quobyte-bb3594ce-94d3-42f6-8a0f-5567f766edd1" by "_delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:05:14 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-4eebb5b9-9aec-48d7-a6b6-39a746b77302 tempest-ProjectMemberTests-1434405994 None] Lock "cinder-quobyte-bb3594ce-94d3-42f6-8a0f-5567f766edd1" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:05:14 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-4eebb5b9-9aec-48d7-a6b6-39a746b77302 tempest-ProjectMemberTests-1434405994 None] Deleting offline snapshot bb3594ce-94d3-42f6-8a0f-5567f766edd1 of volume 4f026d96-d05e-466f-bd14-e209cd3ce518 {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 12:05:14 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-4eebb5b9-9aec-48d7-a6b6-39a746b77302 tempest-ProjectMemberTests-1434405994 None] snapshot_file for this snap is: volume-4f026d96-d05e-466f-bd14-e209cd3ce518.bb3594ce-94d3-42f6-8a0f-5567f766edd1 {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 12:05:14 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7af5bfe-5372-4844-9c58-b133c6fe6b3d]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:05:14 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-4eebb5b9-9aec-48d7-a6b6-39a746b77302 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-4f026d96-d05e-466f-bd14-e209cd3ce518.bb3594ce-94d3-42f6-8a0f-5567f766edd1 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:05:14 devstack sudo[109044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-4f026d96-d05e-466f-bd14-e209cd3ce518.bb3594ce-94d3-42f6-8a0f-5567f766edd1 Sep 25 12:05:14 devstack sudo[109044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:05:15 devstack sudo[109044]: pam_unix(sudo:session): session closed for user root Sep 25 12:05:15 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-4eebb5b9-9aec-48d7-a6b6-39a746b77302 tempest-ProjectMemberTests-1434405994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-4f026d96-d05e-466f-bd14-e209cd3ce518.bb3594ce-94d3-42f6-8a0f-5567f766edd1" returned: 0 in 0.411s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:05:15 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-4eebb5b9-9aec-48d7-a6b6-39a746b77302 tempest-ProjectMemberTests-1434405994 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f026d96-d05e-466f-bd14-e209cd3ce518(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86984) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:05:15 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[21206bc9-2f1f-4927-a4b7-5c1496d8c2e3]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:05:15 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-4eebb5b9-9aec-48d7-a6b6-39a746b77302 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-4f026d96-d05e-466f-bd14-e209cd3ce518 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:05:15 devstack sudo[109050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-4f026d96-d05e-466f-bd14-e209cd3ce518 Sep 25 12:05:15 devstack sudo[109050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:05:15 devstack sudo[109050]: pam_unix(sudo:session): session closed for user root Sep 25 12:05:15 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-4eebb5b9-9aec-48d7-a6b6-39a746b77302 tempest-ProjectMemberTests-1434405994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-4f026d96-d05e-466f-bd14-e209cd3ce518" returned: 0 in 0.406s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:05:15 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-4eebb5b9-9aec-48d7-a6b6-39a746b77302 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-4f026d96-d05e-466f-bd14-e209cd3ce518.bb3594ce-94d3-42f6-8a0f-5567f766edd1 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:05:15 devstack sudo[109055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-4f026d96-d05e-466f-bd14-e209cd3ce518.bb3594ce-94d3-42f6-8a0f-5567f766edd1 Sep 25 12:05:15 devstack sudo[109055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:05:15 devstack sudo[109055]: pam_unix(sudo:session): session closed for user root Sep 25 12:05:15 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-4eebb5b9-9aec-48d7-a6b6-39a746b77302 tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-4f026d96-d05e-466f-bd14-e209cd3ce518.bb3594ce-94d3-42f6-8a0f-5567f766edd1" returned: 0 in 0.335s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:05:15 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-4eebb5b9-9aec-48d7-a6b6-39a746b77302 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-4f026d96-d05e-466f-bd14-e209cd3ce518.bb3594ce-94d3-42f6-8a0f-5567f766edd1 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:05:15 devstack sudo[109060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-4f026d96-d05e-466f-bd14-e209cd3ce518.bb3594ce-94d3-42f6-8a0f-5567f766edd1 Sep 25 12:05:15 devstack sudo[109060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:05:16 devstack sudo[109060]: pam_unix(sudo:session): session closed for user root Sep 25 12:05:16 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-4eebb5b9-9aec-48d7-a6b6-39a746b77302 tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-4f026d96-d05e-466f-bd14-e209cd3ce518.bb3594ce-94d3-42f6-8a0f-5567f766edd1" returned: 0 in 0.319s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:05:16 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-4eebb5b9-9aec-48d7-a6b6-39a746b77302 tempest-ProjectMemberTests-1434405994 None] Lock "cinder-quobyte-bb3594ce-94d3-42f6-8a0f-5567f766edd1" released by "_delete_snapshot" :: held 1.577s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:05:16 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-4eebb5b9-9aec-48d7-a6b6-39a746b77302 tempest-ProjectMemberTests-1434405994 None] Lock "cinder-quobyte-4f026d96-d05e-466f-bd14-e209cd3ce518" released by "delete_snapshot" :: held 1.603s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:05:16 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-4eebb5b9-9aec-48d7-a6b6-39a746b77302 tempest-ProjectMemberTests-1434405994 None] Created reservations ['b82b8895-7cb3-4733-83be-93924d188bd4', '9ed4a3a8-03ce-4ce7-93f6-b53d4a645f3a', 'f7fbc802-c61c-40ab-829c-95af1b47154b', '594f99f9-b6ac-4140-9327-55a4f476f06e'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:05:16 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-4eebb5b9-9aec-48d7-a6b6-39a746b77302 tempest-ProjectMemberTests-1434405994 None] Delete snapshot completed successfully. Sep 25 12:05:16 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-4eebb5b9-9aec-48d7-a6b6-39a746b77302 tempest-ProjectMemberTests-1434405994 None] Lock "cinder-bb3594ce-94d3-42f6-8a0f-5567f766edd1-delete_snapshot" released by "delete_snapshot" :: held 1.766s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:05:16 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-cbd31fb1-3009-4293-9a79-fac68c355a69 tempest-ProjectMemberTests-1434405994 None] Acquiring lock "cinder-4f026d96-d05e-466f-bd14-e209cd3ce518-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:05:16 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-cbd31fb1-3009-4293-9a79-fac68c355a69 tempest-ProjectMemberTests-1434405994 None] Lock "cinder-4f026d96-d05e-466f-bd14-e209cd3ce518-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:05:16 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-cbd31fb1-3009-4293-9a79-fac68c355a69 tempest-ProjectMemberTests-1434405994 None] Acquiring lock "cinder-quobyte-4f026d96-d05e-466f-bd14-e209cd3ce518" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:05:16 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-cbd31fb1-3009-4293-9a79-fac68c355a69 tempest-ProjectMemberTests-1434405994 None] Lock "cinder-quobyte-4f026d96-d05e-466f-bd14-e209cd3ce518" acquired by "delete_volume" :: waited 0.017s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:05:16 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d8404c-0ef4-47a4-9479-160100e5f160]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:05:16 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cbd31fb1-3009-4293-9a79-fac68c355a69 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-4f026d96-d05e-466f-bd14-e209cd3ce518 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:05:16 devstack sudo[109063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-4f026d96-d05e-466f-bd14-e209cd3ce518 Sep 25 12:05:16 devstack sudo[109063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:05:17 devstack sudo[109063]: pam_unix(sudo:session): session closed for user root Sep 25 12:05:17 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cbd31fb1-3009-4293-9a79-fac68c355a69 tempest-ProjectMemberTests-1434405994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-4f026d96-d05e-466f-bd14-e209cd3ce518" returned: 0 in 0.405s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:05:17 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cbd31fb1-3009-4293-9a79-fac68c355a69 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-4f026d96-d05e-466f-bd14-e209cd3ce518 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:05:17 devstack sudo[109068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-4f026d96-d05e-466f-bd14-e209cd3ce518 Sep 25 12:05:17 devstack sudo[109068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:05:17 devstack sudo[109068]: pam_unix(sudo:session): session closed for user root Sep 25 12:05:17 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cbd31fb1-3009-4293-9a79-fac68c355a69 tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-4f026d96-d05e-466f-bd14-e209cd3ce518" returned: 0 in 0.274s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:05:17 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-cbd31fb1-3009-4293-9a79-fac68c355a69 tempest-ProjectMemberTests-1434405994 None] Lock "cinder-quobyte-4f026d96-d05e-466f-bd14-e209cd3ce518" released by "delete_volume" :: held 0.749s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:05:17 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-cbd31fb1-3009-4293-9a79-fac68c355a69 tempest-ProjectMemberTests-1434405994 None] Created reservations ['ce675d4e-347e-43a1-853b-7dcb6c41784d', '25ead09d-cfd0-4468-afe2-ee3aaffe716d', 'bbe44d9c-9441-4786-9639-74e3f5ef1389', 'b3e4139f-c91b-41e2-ab1c-a4cc1c3247ca'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:05:17 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-cbd31fb1-3009-4293-9a79-fac68c355a69 tempest-ProjectMemberTests-1434405994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:05:17 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-cbd31fb1-3009-4293-9a79-fac68c355a69 tempest-ProjectMemberTests-1434405994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:05:17 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-cbd31fb1-3009-4293-9a79-fac68c355a69 tempest-ProjectMemberTests-1434405994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:05:17 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-cbd31fb1-3009-4293-9a79-fac68c355a69 tempest-ProjectMemberTests-1434405994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:05:17 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-cbd31fb1-3009-4293-9a79-fac68c355a69 tempest-ProjectMemberTests-1434405994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:05:17 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cbd31fb1-3009-4293-9a79-fac68c355a69 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:05:17 devstack sudo[109071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 12:05:17 devstack sudo[109071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:05:17 devstack sudo[109071]: pam_unix(sudo:session): session closed for user root Sep 25 12:05:17 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-cbd31fb1-3009-4293-9a79-fac68c355a69 tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.294s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:05:17 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-cbd31fb1-3009-4293-9a79-fac68c355a69 tempest-ProjectMemberTests-1434405994 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:05:17 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-cbd31fb1-3009-4293-9a79-fac68c355a69 tempest-ProjectMemberTests-1434405994 None] Deleted volume successfully. Sep 25 12:05:17 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-cbd31fb1-3009-4293-9a79-fac68c355a69 tempest-ProjectMemberTests-1434405994 None] Lock "cinder-4f026d96-d05e-466f-bd14-e209cd3ce518-delete_volume" released by "delete_volume" :: held 1.287s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:05:18 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0a3347e-713b-4ed6-b388-2fdbaf555005 tempest-ProjectMemberTests-1434405994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:05:18 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b0a3347e-713b-4ed6-b388-2fdbaf555005 tempest-ProjectMemberTests-1434405994 None] Flow 'volume_create_manager' (158191eb-5ed8-4678-86bc-72b45d3f405c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:05:18 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b0a3347e-713b-4ed6-b388-2fdbaf555005 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37830396-b81d-4191-83ed-7f63bb245b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:05:18 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b0a3347e-713b-4ed6-b388-2fdbaf555005 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37830396-b81d-4191-83ed-7f63bb245b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:05:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-512391041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa4588e3-7efa-4f25-95cb-221355551c81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c75afeac65f84f13b7d0325fa4b21b65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:05:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:05:18Z,use_quota=True,user_id='770f7e0a81074bae8bcd048c8d7f7347',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:05:18 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b0a3347e-713b-4ed6-b388-2fdbaf555005 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68dfc72f-bf2a-4128-b4a7-837c32da7da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:05:18 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b0a3347e-713b-4ed6-b388-2fdbaf555005 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68dfc72f-bf2a-4128-b4a7-837c32da7da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:05:18 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b0a3347e-713b-4ed6-b388-2fdbaf555005 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c10f549c-bfff-423e-b861-da9657e365c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:05:18 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b0a3347e-713b-4ed6-b388-2fdbaf555005 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c10f549c-bfff-423e-b861-da9657e365c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa4588e3-7efa-4f25-95cb-221355551c81', 'volume_name': 'volume-aa4588e3-7efa-4f25-95cb-221355551c81', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:05:18 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b0a3347e-713b-4ed6-b388-2fdbaf555005 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cec8446-20d0-409b-8e4e-d11a9a0cccf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:05:18 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b0a3347e-713b-4ed6-b388-2fdbaf555005 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cec8446-20d0-409b-8e4e-d11a9a0cccf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:05:18 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b0a3347e-713b-4ed6-b388-2fdbaf555005 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1aa6007e-34d3-415e-93d8-26e9528f2724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:05:18 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-b0a3347e-713b-4ed6-b388-2fdbaf555005 tempest-ProjectMemberTests-1434405994 None] Volume aa4588e3-7efa-4f25-95cb-221355551c81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa4588e3-7efa-4f25-95cb-221355551c81', 'volume_size': 1} Sep 25 12:05:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-b0a3347e-713b-4ed6-b388-2fdbaf555005 tempest-ProjectMemberTests-1434405994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:05:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-b0a3347e-713b-4ed6-b388-2fdbaf555005 tempest-ProjectMemberTests-1434405994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:05:18 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-b0a3347e-713b-4ed6-b388-2fdbaf555005 tempest-ProjectMemberTests-1434405994 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:05:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-512391041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa4588e3-7efa-4f25-95cb-221355551c81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c75afeac65f84f13b7d0325fa4b21b65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:05:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:05:18Z,use_quota=True,user_id='770f7e0a81074bae8bcd048c8d7f7347',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:05:18 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-b0a3347e-713b-4ed6-b388-2fdbaf555005 tempest-ProjectMemberTests-1434405994 None] Creating volume aa4588e3-7efa-4f25-95cb-221355551c81 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:05:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-b0a3347e-713b-4ed6-b388-2fdbaf555005 tempest-ProjectMemberTests-1434405994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:05:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-b0a3347e-713b-4ed6-b388-2fdbaf555005 tempest-ProjectMemberTests-1434405994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:05:18 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-b0a3347e-713b-4ed6-b388-2fdbaf555005 tempest-ProjectMemberTests-1434405994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:05:18 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-b0a3347e-713b-4ed6-b388-2fdbaf555005 tempest-ProjectMemberTests-1434405994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:05:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-b0a3347e-713b-4ed6-b388-2fdbaf555005 tempest-ProjectMemberTests-1434405994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:05:18 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-b0a3347e-713b-4ed6-b388-2fdbaf555005 tempest-ProjectMemberTests-1434405994 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:05:18 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-b0a3347e-713b-4ed6-b388-2fdbaf555005 tempest-ProjectMemberTests-1434405994 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 12:05:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-b0a3347e-713b-4ed6-b388-2fdbaf555005 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aa4588e3-7efa-4f25-95cb-221355551c81 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:05:18 devstack sudo[109074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aa4588e3-7efa-4f25-95cb-221355551c81 1073741824 Sep 25 12:05:18 devstack sudo[109074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:05:18 devstack sudo[109074]: pam_unix(sudo:session): session closed for user root Sep 25 12:05:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-b0a3347e-713b-4ed6-b388-2fdbaf555005 tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aa4588e3-7efa-4f25-95cb-221355551c81 1073741824" returned: 0 in 0.470s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:05:18 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-b0a3347e-713b-4ed6-b388-2fdbaf555005 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aa4588e3-7efa-4f25-95cb-221355551c81 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:05:19 devstack sudo[109080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aa4588e3-7efa-4f25-95cb-221355551c81 Sep 25 12:05:19 devstack sudo[109080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:05:19 devstack sudo[109080]: pam_unix(sudo:session): session closed for user root Sep 25 12:05:19 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-b0a3347e-713b-4ed6-b388-2fdbaf555005 tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aa4588e3-7efa-4f25-95cb-221355551c81" returned: 0 in 0.278s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:05:19 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-b0a3347e-713b-4ed6-b388-2fdbaf555005 tempest-ProjectMemberTests-1434405994 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:05:19 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-b0a3347e-713b-4ed6-b388-2fdbaf555005 tempest-ProjectMemberTests-1434405994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:05:19 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b0a3347e-713b-4ed6-b388-2fdbaf555005 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1aa6007e-34d3-415e-93d8-26e9528f2724) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa4588e3-7efa-4f25-95cb-221355551c81', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:05:19 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b0a3347e-713b-4ed6-b388-2fdbaf555005 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b856c8e4-3dc8-4230-9940-e08e370b67c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:05:19 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-b0a3347e-713b-4ed6-b388-2fdbaf555005 tempest-ProjectMemberTests-1434405994 None] Volume volume-aa4588e3-7efa-4f25-95cb-221355551c81 (aa4588e3-7efa-4f25-95cb-221355551c81): created successfully Sep 25 12:05:19 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b0a3347e-713b-4ed6-b388-2fdbaf555005 tempest-ProjectMemberTests-1434405994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b856c8e4-3dc8-4230-9940-e08e370b67c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:05:19 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-b0a3347e-713b-4ed6-b388-2fdbaf555005 tempest-ProjectMemberTests-1434405994 None] Flow 'volume_create_manager' (158191eb-5ed8-4678-86bc-72b45d3f405c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:05:19 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-b0a3347e-713b-4ed6-b388-2fdbaf555005 tempest-ProjectMemberTests-1434405994 None] Created volume successfully. Sep 25 12:05:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-a5cde015-579a-42f1-81c6-3c32013bc377 tempest-ProjectMemberTests-1434405994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:05:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-a5cde015-579a-42f1-81c6-3c32013bc377 tempest-ProjectMemberTests-1434405994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:05:20 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-a5cde015-579a-42f1-81c6-3c32013bc377 tempest-ProjectMemberTests-1434405994 None] Creating offline snapshot 24ecf27e-e14e-49b6-aebd-0166d359e2a0 of volume aa4588e3-7efa-4f25-95cb-221355551c81 {{(pid=86984) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 12:05:20 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e2106d-34ef-4ffa-a39f-1d29c54e22be]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:05:20 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a5cde015-579a-42f1-81c6-3c32013bc377 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aa4588e3-7efa-4f25-95cb-221355551c81 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:05:20 devstack sudo[109083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aa4588e3-7efa-4f25-95cb-221355551c81 Sep 25 12:05:20 devstack sudo[109083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:05:21 devstack sudo[109083]: pam_unix(sudo:session): session closed for user root Sep 25 12:05:21 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a5cde015-579a-42f1-81c6-3c32013bc377 tempest-ProjectMemberTests-1434405994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aa4588e3-7efa-4f25-95cb-221355551c81" returned: 0 in 0.410s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:05:21 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a5cde015-579a-42f1-81c6-3c32013bc377 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aa4588e3-7efa-4f25-95cb-221355551c81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aa4588e3-7efa-4f25-95cb-221355551c81.24ecf27e-e14e-49b6-aebd-0166d359e2a0 1G {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:05:21 devstack sudo[109088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aa4588e3-7efa-4f25-95cb-221355551c81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aa4588e3-7efa-4f25-95cb-221355551c81.24ecf27e-e14e-49b6-aebd-0166d359e2a0 1G Sep 25 12:05:21 devstack sudo[109088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:05:21 devstack sudo[109088]: pam_unix(sudo:session): session closed for user root Sep 25 12:05:21 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a5cde015-579a-42f1-81c6-3c32013bc377 tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aa4588e3-7efa-4f25-95cb-221355551c81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aa4588e3-7efa-4f25-95cb-221355551c81.24ecf27e-e14e-49b6-aebd-0166d359e2a0 1G" returned: 0 in 0.432s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:05:21 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a5cde015-579a-42f1-81c6-3c32013bc377 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa4588e3-7efa-4f25-95cb-221355551c81 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aa4588e3-7efa-4f25-95cb-221355551c81.24ecf27e-e14e-49b6-aebd-0166d359e2a0 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:05:21 devstack sudo[109093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa4588e3-7efa-4f25-95cb-221355551c81 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aa4588e3-7efa-4f25-95cb-221355551c81.24ecf27e-e14e-49b6-aebd-0166d359e2a0 Sep 25 12:05:21 devstack sudo[109093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:05:21 devstack sudo[109093]: pam_unix(sudo:session): session closed for user root Sep 25 12:05:21 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a5cde015-579a-42f1-81c6-3c32013bc377 tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa4588e3-7efa-4f25-95cb-221355551c81 -F qcow2 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aa4588e3-7efa-4f25-95cb-221355551c81.24ecf27e-e14e-49b6-aebd-0166d359e2a0" returned: 0 in 0.317s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:05:21 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-a5cde015-579a-42f1-81c6-3c32013bc377 tempest-ProjectMemberTests-1434405994 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aa4588e3-7efa-4f25-95cb-221355551c81.24ecf27e-e14e-49b6-aebd-0166d359e2a0 is being set with open permissions: ugo+rw Sep 25 12:05:21 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a5cde015-579a-42f1-81c6-3c32013bc377 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aa4588e3-7efa-4f25-95cb-221355551c81.24ecf27e-e14e-49b6-aebd-0166d359e2a0 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:05:21 devstack sudo[109099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aa4588e3-7efa-4f25-95cb-221355551c81.24ecf27e-e14e-49b6-aebd-0166d359e2a0 Sep 25 12:05:21 devstack sudo[109099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:05:22 devstack sudo[109099]: pam_unix(sudo:session): session closed for user root Sep 25 12:05:22 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a5cde015-579a-42f1-81c6-3c32013bc377 tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aa4588e3-7efa-4f25-95cb-221355551c81.24ecf27e-e14e-49b6-aebd-0166d359e2a0" returned: 0 in 0.279s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:05:22 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a5cde015-579a-42f1-81c6-3c32013bc377 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aa4588e3-7efa-4f25-95cb-221355551c81.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:05:22 devstack sudo[109102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aa4588e3-7efa-4f25-95cb-221355551c81.info Sep 25 12:05:22 devstack sudo[109102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:05:22 devstack sudo[109102]: pam_unix(sudo:session): session closed for user root Sep 25 12:05:22 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a5cde015-579a-42f1-81c6-3c32013bc377 tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aa4588e3-7efa-4f25-95cb-221355551c81.info" returned: 0 in 0.278s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:05:22 devstack cinder-volume[86984]: WARNING cinder.volume.drivers.remotefs [None req-a5cde015-579a-42f1-81c6-3c32013bc377 tempest-ProjectMemberTests-1434405994 None] /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aa4588e3-7efa-4f25-95cb-221355551c81.info is being set with open permissions: ugo+rw Sep 25 12:05:22 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a5cde015-579a-42f1-81c6-3c32013bc377 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aa4588e3-7efa-4f25-95cb-221355551c81.info {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:05:22 devstack sudo[109105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aa4588e3-7efa-4f25-95cb-221355551c81.info Sep 25 12:05:22 devstack sudo[109105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:05:22 devstack sudo[109105]: pam_unix(sudo:session): session closed for user root Sep 25 12:05:22 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-a5cde015-579a-42f1-81c6-3c32013bc377 tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aa4588e3-7efa-4f25-95cb-221355551c81.info" returned: 0 in 0.285s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:05:22 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-a5cde015-579a-42f1-81c6-3c32013bc377 tempest-ProjectMemberTests-1434405994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.098s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:05:22 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-a5cde015-579a-42f1-81c6-3c32013bc377 tempest-ProjectMemberTests-1434405994 None] Create snapshot completed successfully Sep 25 12:05:23 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ed941987-e59d-41da-8605-12b6ac9bb5b3 tempest-ProjectMemberTests-1434405994 None] Acquiring lock "cinder-24ecf27e-e14e-49b6-aebd-0166d359e2a0-delete_snapshot" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:05:24 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ed941987-e59d-41da-8605-12b6ac9bb5b3 tempest-ProjectMemberTests-1434405994 None] Lock "cinder-24ecf27e-e14e-49b6-aebd-0166d359e2a0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:05:24 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ed941987-e59d-41da-8605-12b6ac9bb5b3 tempest-ProjectMemberTests-1434405994 None] Acquiring lock "cinder-quobyte-aa4588e3-7efa-4f25-95cb-221355551c81" by "delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:05:24 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ed941987-e59d-41da-8605-12b6ac9bb5b3 tempest-ProjectMemberTests-1434405994 None] Lock "cinder-quobyte-aa4588e3-7efa-4f25-95cb-221355551c81" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:05:24 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ed941987-e59d-41da-8605-12b6ac9bb5b3 tempest-ProjectMemberTests-1434405994 None] Acquiring lock "cinder-quobyte-24ecf27e-e14e-49b6-aebd-0166d359e2a0" by "_delete_snapshot" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:05:24 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ed941987-e59d-41da-8605-12b6ac9bb5b3 tempest-ProjectMemberTests-1434405994 None] Lock "cinder-quobyte-24ecf27e-e14e-49b6-aebd-0166d359e2a0" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:05:24 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-ed941987-e59d-41da-8605-12b6ac9bb5b3 tempest-ProjectMemberTests-1434405994 None] Deleting offline snapshot 24ecf27e-e14e-49b6-aebd-0166d359e2a0 of volume aa4588e3-7efa-4f25-95cb-221355551c81 {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 12:05:24 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-ed941987-e59d-41da-8605-12b6ac9bb5b3 tempest-ProjectMemberTests-1434405994 None] snapshot_file for this snap is: volume-aa4588e3-7efa-4f25-95cb-221355551c81.24ecf27e-e14e-49b6-aebd-0166d359e2a0 {{(pid=86984) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 12:05:24 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdfd700b-2275-48e8-bc45-b02be16eccfa]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:05:24 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ed941987-e59d-41da-8605-12b6ac9bb5b3 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aa4588e3-7efa-4f25-95cb-221355551c81.24ecf27e-e14e-49b6-aebd-0166d359e2a0 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:05:24 devstack sudo[109109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aa4588e3-7efa-4f25-95cb-221355551c81.24ecf27e-e14e-49b6-aebd-0166d359e2a0 Sep 25 12:05:24 devstack sudo[109109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:05:24 devstack sudo[109109]: pam_unix(sudo:session): session closed for user root Sep 25 12:05:24 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ed941987-e59d-41da-8605-12b6ac9bb5b3 tempest-ProjectMemberTests-1434405994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aa4588e3-7efa-4f25-95cb-221355551c81.24ecf27e-e14e-49b6-aebd-0166d359e2a0" returned: 0 in 0.406s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:05:24 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-ed941987-e59d-41da-8605-12b6ac9bb5b3 tempest-ProjectMemberTests-1434405994 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa4588e3-7efa-4f25-95cb-221355551c81(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86984) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:05:24 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[a449c9c1-dfe9-49ba-8491-d77bede2ed31]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:05:24 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ed941987-e59d-41da-8605-12b6ac9bb5b3 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aa4588e3-7efa-4f25-95cb-221355551c81 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:05:24 devstack sudo[109115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aa4588e3-7efa-4f25-95cb-221355551c81 Sep 25 12:05:24 devstack sudo[109115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:05:24 devstack sudo[109115]: pam_unix(sudo:session): session closed for user root Sep 25 12:05:24 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ed941987-e59d-41da-8605-12b6ac9bb5b3 tempest-ProjectMemberTests-1434405994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aa4588e3-7efa-4f25-95cb-221355551c81" returned: 0 in 0.398s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:05:24 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ed941987-e59d-41da-8605-12b6ac9bb5b3 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aa4588e3-7efa-4f25-95cb-221355551c81.24ecf27e-e14e-49b6-aebd-0166d359e2a0 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:05:24 devstack sudo[109120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aa4588e3-7efa-4f25-95cb-221355551c81.24ecf27e-e14e-49b6-aebd-0166d359e2a0 Sep 25 12:05:24 devstack sudo[109120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:05:25 devstack sudo[109120]: pam_unix(sudo:session): session closed for user root Sep 25 12:05:25 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ed941987-e59d-41da-8605-12b6ac9bb5b3 tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aa4588e3-7efa-4f25-95cb-221355551c81.24ecf27e-e14e-49b6-aebd-0166d359e2a0" returned: 0 in 0.365s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:05:25 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ed941987-e59d-41da-8605-12b6ac9bb5b3 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aa4588e3-7efa-4f25-95cb-221355551c81.24ecf27e-e14e-49b6-aebd-0166d359e2a0 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:05:25 devstack sudo[109125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aa4588e3-7efa-4f25-95cb-221355551c81.24ecf27e-e14e-49b6-aebd-0166d359e2a0 Sep 25 12:05:25 devstack sudo[109125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:05:25 devstack sudo[109125]: pam_unix(sudo:session): session closed for user root Sep 25 12:05:25 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ed941987-e59d-41da-8605-12b6ac9bb5b3 tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aa4588e3-7efa-4f25-95cb-221355551c81.24ecf27e-e14e-49b6-aebd-0166d359e2a0" returned: 0 in 0.270s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:05:25 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ed941987-e59d-41da-8605-12b6ac9bb5b3 tempest-ProjectMemberTests-1434405994 None] Lock "cinder-quobyte-24ecf27e-e14e-49b6-aebd-0166d359e2a0" released by "_delete_snapshot" :: held 1.557s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:05:25 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ed941987-e59d-41da-8605-12b6ac9bb5b3 tempest-ProjectMemberTests-1434405994 None] Lock "cinder-quobyte-aa4588e3-7efa-4f25-95cb-221355551c81" released by "delete_snapshot" :: held 1.585s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:05:25 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-ed941987-e59d-41da-8605-12b6ac9bb5b3 tempest-ProjectMemberTests-1434405994 None] Created reservations ['16f24bc0-8635-47d1-8fc3-e18afb6d09bf', '58806467-63f6-4ffd-aba3-e22b48086b15', '2b91da7b-d59b-4f5d-9f0f-d85001dfd248', 'c2d8fc68-005e-4970-9dba-f2e3f81867e9'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:05:25 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-ed941987-e59d-41da-8605-12b6ac9bb5b3 tempest-ProjectMemberTests-1434405994 None] Delete snapshot completed successfully. Sep 25 12:05:25 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ed941987-e59d-41da-8605-12b6ac9bb5b3 tempest-ProjectMemberTests-1434405994 None] Lock "cinder-24ecf27e-e14e-49b6-aebd-0166d359e2a0-delete_snapshot" released by "delete_snapshot" :: held 1.743s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:05:26 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-34ab1410-c7cd-4afb-9095-5ffa681e7723 tempest-ProjectMemberTests-1434405994 None] Acquiring lock "cinder-aa4588e3-7efa-4f25-95cb-221355551c81-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:05:26 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-34ab1410-c7cd-4afb-9095-5ffa681e7723 tempest-ProjectMemberTests-1434405994 None] Lock "cinder-aa4588e3-7efa-4f25-95cb-221355551c81-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:05:26 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-34ab1410-c7cd-4afb-9095-5ffa681e7723 tempest-ProjectMemberTests-1434405994 None] Acquiring lock "cinder-quobyte-aa4588e3-7efa-4f25-95cb-221355551c81" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:05:26 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-34ab1410-c7cd-4afb-9095-5ffa681e7723 tempest-ProjectMemberTests-1434405994 None] Lock "cinder-quobyte-aa4588e3-7efa-4f25-95cb-221355551c81" acquired by "delete_volume" :: waited 0.019s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:05:26 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[62296b4c-ff35-49dd-a2f9-059ad5106ca2]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:05:26 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-34ab1410-c7cd-4afb-9095-5ffa681e7723 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aa4588e3-7efa-4f25-95cb-221355551c81 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:05:26 devstack sudo[109128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aa4588e3-7efa-4f25-95cb-221355551c81 Sep 25 12:05:26 devstack sudo[109128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:05:26 devstack sudo[109128]: pam_unix(sudo:session): session closed for user root Sep 25 12:05:26 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-34ab1410-c7cd-4afb-9095-5ffa681e7723 tempest-ProjectMemberTests-1434405994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aa4588e3-7efa-4f25-95cb-221355551c81" returned: 0 in 0.423s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:05:26 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-34ab1410-c7cd-4afb-9095-5ffa681e7723 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aa4588e3-7efa-4f25-95cb-221355551c81 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:05:26 devstack sudo[109133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aa4588e3-7efa-4f25-95cb-221355551c81 Sep 25 12:05:26 devstack sudo[109133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:05:26 devstack sudo[109133]: pam_unix(sudo:session): session closed for user root Sep 25 12:05:26 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-34ab1410-c7cd-4afb-9095-5ffa681e7723 tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-aa4588e3-7efa-4f25-95cb-221355551c81" returned: 0 in 0.268s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:05:26 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-34ab1410-c7cd-4afb-9095-5ffa681e7723 tempest-ProjectMemberTests-1434405994 None] Lock "cinder-quobyte-aa4588e3-7efa-4f25-95cb-221355551c81" released by "delete_volume" :: held 0.764s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:05:27 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-34ab1410-c7cd-4afb-9095-5ffa681e7723 tempest-ProjectMemberTests-1434405994 None] Created reservations ['d4707e96-921c-45f0-9252-fcea9b8c0a81', 'a47c82a0-5bda-430f-a936-5724e9c5a3b7', '771b65f6-b5a3-419e-a03f-91aedccfae84', '5f486860-adf8-4bc2-878f-931f2f34e5d5'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:05:27 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-34ab1410-c7cd-4afb-9095-5ffa681e7723 tempest-ProjectMemberTests-1434405994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:05:27 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-34ab1410-c7cd-4afb-9095-5ffa681e7723 tempest-ProjectMemberTests-1434405994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:05:27 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-34ab1410-c7cd-4afb-9095-5ffa681e7723 tempest-ProjectMemberTests-1434405994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:05:27 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-34ab1410-c7cd-4afb-9095-5ffa681e7723 tempest-ProjectMemberTests-1434405994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:05:27 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-34ab1410-c7cd-4afb-9095-5ffa681e7723 tempest-ProjectMemberTests-1434405994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:05:27 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-34ab1410-c7cd-4afb-9095-5ffa681e7723 tempest-ProjectMemberTests-1434405994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:05:27 devstack sudo[109136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 12:05:27 devstack sudo[109136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:05:27 devstack sudo[109136]: pam_unix(sudo:session): session closed for user root Sep 25 12:05:27 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-34ab1410-c7cd-4afb-9095-5ffa681e7723 tempest-ProjectMemberTests-1434405994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.277s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:05:27 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-34ab1410-c7cd-4afb-9095-5ffa681e7723 tempest-ProjectMemberTests-1434405994 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:05:27 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-34ab1410-c7cd-4afb-9095-5ffa681e7723 tempest-ProjectMemberTests-1434405994 None] Deleted volume successfully. Sep 25 12:05:27 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-34ab1410-c7cd-4afb-9095-5ffa681e7723 tempest-ProjectMemberTests-1434405994 None] Lock "cinder-aa4588e3-7efa-4f25-95cb-221355551c81-delete_volume" released by "delete_volume" :: held 1.256s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:05:37 devstack cinder-volume[86984]: DEBUG dbcounter [-] [86984] Writing DB stats cinder:SELECT=125,cinder:UPDATE=172,cinder:INSERT=45,cinder:DELETE=13 {{(pid=86984) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:05:37 devstack cinder-volume[86984]: DEBUG dbcounter [-] [86984] Writing DB stats cinder:UPDATE=165,cinder:SELECT=132,cinder:INSERT=49,cinder:DELETE=15 {{(pid=86984) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:05:38 devstack cinder-volume[86984]: DEBUG oslo_service.periodic_task [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:05:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:05:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:05:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:05:38 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:05:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:05:38 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:05:38 devstack sudo[109144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 12:05:38 devstack sudo[109144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:05:39 devstack sudo[109144]: pam_unix(sudo:session): session closed for user root Sep 25 12:05:39 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.300s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:05:39 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:05:39 devstack cinder-volume[86984]: DEBUG oslo_service.periodic_task [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] Running periodic task VolumeManager._thread_info {{(pid=86984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:05:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] thread count: 28 {{(pid=86984) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 12:05:39 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-3d88b458-327d-4015-b0b3-0f36bdf01b5b None None] thread info: [<_MainThread(MainThread, started 132046492332160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86984) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 12:05:41 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-97e2ea85-d688-4732-abcb-b71b5d8a1915 tempest-ProjectReaderTests-1674305306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:05:41 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-97e2ea85-d688-4732-abcb-b71b5d8a1915 tempest-ProjectReaderTests-1674305306 None] Flow 'volume_create_manager' (9c1cb3c9-d85e-43c0-857d-95083d06dbb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:05:41 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-97e2ea85-d688-4732-abcb-b71b5d8a1915 tempest-ProjectReaderTests-1674305306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd65ab7f-c128-4fa6-926b-aa36141f34ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:05:41 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-97e2ea85-d688-4732-abcb-b71b5d8a1915 tempest-ProjectReaderTests-1674305306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd65ab7f-c128-4fa6-926b-aa36141f34ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:05:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2117900963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1078886-9509-485d-adfa-7106496eaf2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='418c84a11c5a4d29a5b6efc46b169d8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:05:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:05:41Z,use_quota=True,user_id='13259e41fb6b4878a7d8655a711f064a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:05:41 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-97e2ea85-d688-4732-abcb-b71b5d8a1915 tempest-ProjectReaderTests-1674305306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c300d1eb-0f3c-438f-b877-4f366948b117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:05:41 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-97e2ea85-d688-4732-abcb-b71b5d8a1915 tempest-ProjectReaderTests-1674305306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c300d1eb-0f3c-438f-b877-4f366948b117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:05:41 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-97e2ea85-d688-4732-abcb-b71b5d8a1915 tempest-ProjectReaderTests-1674305306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9695473-98e2-4ec7-a0f9-d6acf0bbf34d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:05:41 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-97e2ea85-d688-4732-abcb-b71b5d8a1915 tempest-ProjectReaderTests-1674305306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9695473-98e2-4ec7-a0f9-d6acf0bbf34d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1078886-9509-485d-adfa-7106496eaf2e', 'volume_name': 'volume-f1078886-9509-485d-adfa-7106496eaf2e', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:05:41 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-97e2ea85-d688-4732-abcb-b71b5d8a1915 tempest-ProjectReaderTests-1674305306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2c39bb4-4448-4705-aa22-df339a7916ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:05:41 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-97e2ea85-d688-4732-abcb-b71b5d8a1915 tempest-ProjectReaderTests-1674305306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2c39bb4-4448-4705-aa22-df339a7916ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:05:41 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-97e2ea85-d688-4732-abcb-b71b5d8a1915 tempest-ProjectReaderTests-1674305306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cb8ea66-1428-4744-b743-8294019b8028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:05:41 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-97e2ea85-d688-4732-abcb-b71b5d8a1915 tempest-ProjectReaderTests-1674305306 None] Volume f1078886-9509-485d-adfa-7106496eaf2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1078886-9509-485d-adfa-7106496eaf2e', 'volume_size': 1} Sep 25 12:05:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-97e2ea85-d688-4732-abcb-b71b5d8a1915 tempest-ProjectReaderTests-1674305306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:05:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-97e2ea85-d688-4732-abcb-b71b5d8a1915 tempest-ProjectReaderTests-1674305306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:05:41 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-97e2ea85-d688-4732-abcb-b71b5d8a1915 tempest-ProjectReaderTests-1674305306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:05:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2117900963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1078886-9509-485d-adfa-7106496eaf2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='418c84a11c5a4d29a5b6efc46b169d8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:05:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:05:41Z,use_quota=True,user_id='13259e41fb6b4878a7d8655a711f064a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:05:41 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-97e2ea85-d688-4732-abcb-b71b5d8a1915 tempest-ProjectReaderTests-1674305306 None] Creating volume f1078886-9509-485d-adfa-7106496eaf2e {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:05:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-97e2ea85-d688-4732-abcb-b71b5d8a1915 tempest-ProjectReaderTests-1674305306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:05:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-97e2ea85-d688-4732-abcb-b71b5d8a1915 tempest-ProjectReaderTests-1674305306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:05:41 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-97e2ea85-d688-4732-abcb-b71b5d8a1915 tempest-ProjectReaderTests-1674305306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:05:41 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-97e2ea85-d688-4732-abcb-b71b5d8a1915 tempest-ProjectReaderTests-1674305306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:05:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-97e2ea85-d688-4732-abcb-b71b5d8a1915 tempest-ProjectReaderTests-1674305306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:05:41 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-97e2ea85-d688-4732-abcb-b71b5d8a1915 tempest-ProjectReaderTests-1674305306 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:05:41 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-97e2ea85-d688-4732-abcb-b71b5d8a1915 tempest-ProjectReaderTests-1674305306 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 12:05:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-97e2ea85-d688-4732-abcb-b71b5d8a1915 tempest-ProjectReaderTests-1674305306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f1078886-9509-485d-adfa-7106496eaf2e 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:05:41 devstack sudo[109153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f1078886-9509-485d-adfa-7106496eaf2e 1073741824 Sep 25 12:05:41 devstack sudo[109153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:05:41 devstack sudo[109153]: pam_unix(sudo:session): session closed for user root Sep 25 12:05:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-97e2ea85-d688-4732-abcb-b71b5d8a1915 tempest-ProjectReaderTests-1674305306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f1078886-9509-485d-adfa-7106496eaf2e 1073741824" returned: 0 in 0.490s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:05:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-97e2ea85-d688-4732-abcb-b71b5d8a1915 tempest-ProjectReaderTests-1674305306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f1078886-9509-485d-adfa-7106496eaf2e {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:05:41 devstack sudo[109158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f1078886-9509-485d-adfa-7106496eaf2e Sep 25 12:05:41 devstack sudo[109158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:05:41 devstack sudo[109158]: pam_unix(sudo:session): session closed for user root Sep 25 12:05:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-97e2ea85-d688-4732-abcb-b71b5d8a1915 tempest-ProjectReaderTests-1674305306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f1078886-9509-485d-adfa-7106496eaf2e" returned: 0 in 0.283s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:05:41 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-97e2ea85-d688-4732-abcb-b71b5d8a1915 tempest-ProjectReaderTests-1674305306 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:05:41 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-97e2ea85-d688-4732-abcb-b71b5d8a1915 tempest-ProjectReaderTests-1674305306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:05:41 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-97e2ea85-d688-4732-abcb-b71b5d8a1915 tempest-ProjectReaderTests-1674305306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cb8ea66-1428-4744-b743-8294019b8028) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1078886-9509-485d-adfa-7106496eaf2e', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:05:41 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-97e2ea85-d688-4732-abcb-b71b5d8a1915 tempest-ProjectReaderTests-1674305306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2c1911a-470b-42b1-b92f-fa885e1d5e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:05:41 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-97e2ea85-d688-4732-abcb-b71b5d8a1915 tempest-ProjectReaderTests-1674305306 None] Volume volume-f1078886-9509-485d-adfa-7106496eaf2e (f1078886-9509-485d-adfa-7106496eaf2e): created successfully Sep 25 12:05:41 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-97e2ea85-d688-4732-abcb-b71b5d8a1915 tempest-ProjectReaderTests-1674305306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2c1911a-470b-42b1-b92f-fa885e1d5e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:05:41 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-97e2ea85-d688-4732-abcb-b71b5d8a1915 tempest-ProjectReaderTests-1674305306 None] Flow 'volume_create_manager' (9c1cb3c9-d85e-43c0-857d-95083d06dbb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:05:42 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-97e2ea85-d688-4732-abcb-b71b5d8a1915 tempest-ProjectReaderTests-1674305306 None] Created volume successfully. Sep 25 12:05:43 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ab45a914-a905-40a2-8da5-688d026623ff tempest-ProjectReaderTests-1674305306 None] Acquiring lock "cinder-f1078886-9509-485d-adfa-7106496eaf2e-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:05:43 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ab45a914-a905-40a2-8da5-688d026623ff tempest-ProjectReaderTests-1674305306 None] Lock "cinder-f1078886-9509-485d-adfa-7106496eaf2e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:05:43 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ab45a914-a905-40a2-8da5-688d026623ff tempest-ProjectReaderTests-1674305306 None] Acquiring lock "cinder-quobyte-f1078886-9509-485d-adfa-7106496eaf2e" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:05:43 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ab45a914-a905-40a2-8da5-688d026623ff tempest-ProjectReaderTests-1674305306 None] Lock "cinder-quobyte-f1078886-9509-485d-adfa-7106496eaf2e" acquired by "delete_volume" :: waited 0.014s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:05:43 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[24930900-200a-4b2c-81a4-8b1e1283fd51]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:05:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ab45a914-a905-40a2-8da5-688d026623ff tempest-ProjectReaderTests-1674305306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f1078886-9509-485d-adfa-7106496eaf2e {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:05:43 devstack sudo[109161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f1078886-9509-485d-adfa-7106496eaf2e Sep 25 12:05:43 devstack sudo[109161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:05:43 devstack sudo[109161]: pam_unix(sudo:session): session closed for user root Sep 25 12:05:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ab45a914-a905-40a2-8da5-688d026623ff tempest-ProjectReaderTests-1674305306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f1078886-9509-485d-adfa-7106496eaf2e" returned: 0 in 0.398s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:05:43 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ab45a914-a905-40a2-8da5-688d026623ff tempest-ProjectReaderTests-1674305306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f1078886-9509-485d-adfa-7106496eaf2e {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:05:43 devstack sudo[109166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f1078886-9509-485d-adfa-7106496eaf2e Sep 25 12:05:43 devstack sudo[109166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:05:44 devstack sudo[109166]: pam_unix(sudo:session): session closed for user root Sep 25 12:05:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ab45a914-a905-40a2-8da5-688d026623ff tempest-ProjectReaderTests-1674305306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-f1078886-9509-485d-adfa-7106496eaf2e" returned: 0 in 0.267s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:05:44 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ab45a914-a905-40a2-8da5-688d026623ff tempest-ProjectReaderTests-1674305306 None] Lock "cinder-quobyte-f1078886-9509-485d-adfa-7106496eaf2e" released by "delete_volume" :: held 0.712s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:05:44 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-ab45a914-a905-40a2-8da5-688d026623ff tempest-ProjectReaderTests-1674305306 None] Created reservations ['a18a94dc-7f28-4ac9-8511-efb1c42aa83f', 'df43064f-1332-4627-a316-32de986f472d', '8f4ff8b4-9c5a-4b68-ae33-95192a77132f', '0d888cbe-8309-4d2b-9794-f2d9f243f4e2'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:05:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-ab45a914-a905-40a2-8da5-688d026623ff tempest-ProjectReaderTests-1674305306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:05:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-ab45a914-a905-40a2-8da5-688d026623ff tempest-ProjectReaderTests-1674305306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:05:44 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-ab45a914-a905-40a2-8da5-688d026623ff tempest-ProjectReaderTests-1674305306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:05:44 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-ab45a914-a905-40a2-8da5-688d026623ff tempest-ProjectReaderTests-1674305306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:05:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-ab45a914-a905-40a2-8da5-688d026623ff tempest-ProjectReaderTests-1674305306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:05:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ab45a914-a905-40a2-8da5-688d026623ff tempest-ProjectReaderTests-1674305306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:05:44 devstack sudo[109170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 12:05:44 devstack sudo[109170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:05:44 devstack sudo[109170]: pam_unix(sudo:session): session closed for user root Sep 25 12:05:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ab45a914-a905-40a2-8da5-688d026623ff tempest-ProjectReaderTests-1674305306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.283s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:05:44 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-ab45a914-a905-40a2-8da5-688d026623ff tempest-ProjectReaderTests-1674305306 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:05:44 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-ab45a914-a905-40a2-8da5-688d026623ff tempest-ProjectReaderTests-1674305306 None] Deleted volume successfully. Sep 25 12:05:44 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ab45a914-a905-40a2-8da5-688d026623ff tempest-ProjectReaderTests-1674305306 None] Lock "cinder-f1078886-9509-485d-adfa-7106496eaf2e-delete_volume" released by "delete_volume" :: held 1.239s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:05:44 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-31867ee1-fbc5-4dc7-8843-95553c6127a9 tempest-ProjectReaderTests-1674305306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:05:44 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-31867ee1-fbc5-4dc7-8843-95553c6127a9 tempest-ProjectReaderTests-1674305306 None] Flow 'volume_create_manager' (4d3a5954-3cdf-4540-8116-08c1b0a2a716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:05:44 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-31867ee1-fbc5-4dc7-8843-95553c6127a9 tempest-ProjectReaderTests-1674305306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69a7e03b-b27a-4020-b829-e585d4383ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:05:44 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-31867ee1-fbc5-4dc7-8843-95553c6127a9 tempest-ProjectReaderTests-1674305306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69a7e03b-b27a-4020-b829-e585d4383ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:05:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1332667724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd51e501-9754-40fe-8e15-fcc931b57c20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='418c84a11c5a4d29a5b6efc46b169d8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:05:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:05:45Z,use_quota=True,user_id='13259e41fb6b4878a7d8655a711f064a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:05:44 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-31867ee1-fbc5-4dc7-8843-95553c6127a9 tempest-ProjectReaderTests-1674305306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff890e6b-2dbc-4d39-858c-39ab59f4c7d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:05:44 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-31867ee1-fbc5-4dc7-8843-95553c6127a9 tempest-ProjectReaderTests-1674305306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff890e6b-2dbc-4d39-858c-39ab59f4c7d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:05:44 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-31867ee1-fbc5-4dc7-8843-95553c6127a9 tempest-ProjectReaderTests-1674305306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1621b499-8cd3-4c53-90c7-825737aa636d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:05:44 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-31867ee1-fbc5-4dc7-8843-95553c6127a9 tempest-ProjectReaderTests-1674305306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1621b499-8cd3-4c53-90c7-825737aa636d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd51e501-9754-40fe-8e15-fcc931b57c20', 'volume_name': 'volume-dd51e501-9754-40fe-8e15-fcc931b57c20', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:05:44 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-31867ee1-fbc5-4dc7-8843-95553c6127a9 tempest-ProjectReaderTests-1674305306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b806bfaa-3d99-49c6-a079-32181c0d8b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:05:44 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-31867ee1-fbc5-4dc7-8843-95553c6127a9 tempest-ProjectReaderTests-1674305306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b806bfaa-3d99-49c6-a079-32181c0d8b04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:05:44 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-31867ee1-fbc5-4dc7-8843-95553c6127a9 tempest-ProjectReaderTests-1674305306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (745e3883-182d-44a4-bded-a9093f942720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:05:44 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-31867ee1-fbc5-4dc7-8843-95553c6127a9 tempest-ProjectReaderTests-1674305306 None] Volume dd51e501-9754-40fe-8e15-fcc931b57c20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd51e501-9754-40fe-8e15-fcc931b57c20', 'volume_size': 1} Sep 25 12:05:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-31867ee1-fbc5-4dc7-8843-95553c6127a9 tempest-ProjectReaderTests-1674305306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:05:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-31867ee1-fbc5-4dc7-8843-95553c6127a9 tempest-ProjectReaderTests-1674305306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:05:44 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-31867ee1-fbc5-4dc7-8843-95553c6127a9 tempest-ProjectReaderTests-1674305306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:05:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1332667724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd51e501-9754-40fe-8e15-fcc931b57c20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='418c84a11c5a4d29a5b6efc46b169d8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:05:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:05:45Z,use_quota=True,user_id='13259e41fb6b4878a7d8655a711f064a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:05:44 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-31867ee1-fbc5-4dc7-8843-95553c6127a9 tempest-ProjectReaderTests-1674305306 None] Creating volume dd51e501-9754-40fe-8e15-fcc931b57c20 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:05:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-31867ee1-fbc5-4dc7-8843-95553c6127a9 tempest-ProjectReaderTests-1674305306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:05:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-31867ee1-fbc5-4dc7-8843-95553c6127a9 tempest-ProjectReaderTests-1674305306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:05:44 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-31867ee1-fbc5-4dc7-8843-95553c6127a9 tempest-ProjectReaderTests-1674305306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:05:44 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-31867ee1-fbc5-4dc7-8843-95553c6127a9 tempest-ProjectReaderTests-1674305306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:05:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-31867ee1-fbc5-4dc7-8843-95553c6127a9 tempest-ProjectReaderTests-1674305306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:05:44 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-31867ee1-fbc5-4dc7-8843-95553c6127a9 tempest-ProjectReaderTests-1674305306 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:05:44 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-31867ee1-fbc5-4dc7-8843-95553c6127a9 tempest-ProjectReaderTests-1674305306 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 12:05:44 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-31867ee1-fbc5-4dc7-8843-95553c6127a9 tempest-ProjectReaderTests-1674305306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-dd51e501-9754-40fe-8e15-fcc931b57c20 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:05:45 devstack sudo[109173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-dd51e501-9754-40fe-8e15-fcc931b57c20 1073741824 Sep 25 12:05:45 devstack sudo[109173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:05:45 devstack sudo[109173]: pam_unix(sudo:session): session closed for user root Sep 25 12:05:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-31867ee1-fbc5-4dc7-8843-95553c6127a9 tempest-ProjectReaderTests-1674305306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-dd51e501-9754-40fe-8e15-fcc931b57c20 1073741824" returned: 0 in 0.457s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:05:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-31867ee1-fbc5-4dc7-8843-95553c6127a9 tempest-ProjectReaderTests-1674305306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-dd51e501-9754-40fe-8e15-fcc931b57c20 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:05:45 devstack sudo[109179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-dd51e501-9754-40fe-8e15-fcc931b57c20 Sep 25 12:05:45 devstack sudo[109179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:05:45 devstack sudo[109179]: pam_unix(sudo:session): session closed for user root Sep 25 12:05:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-31867ee1-fbc5-4dc7-8843-95553c6127a9 tempest-ProjectReaderTests-1674305306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-dd51e501-9754-40fe-8e15-fcc931b57c20" returned: 0 in 0.265s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:05:45 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-31867ee1-fbc5-4dc7-8843-95553c6127a9 tempest-ProjectReaderTests-1674305306 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:05:45 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-31867ee1-fbc5-4dc7-8843-95553c6127a9 tempest-ProjectReaderTests-1674305306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:05:45 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-31867ee1-fbc5-4dc7-8843-95553c6127a9 tempest-ProjectReaderTests-1674305306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (745e3883-182d-44a4-bded-a9093f942720) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd51e501-9754-40fe-8e15-fcc931b57c20', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:05:45 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-31867ee1-fbc5-4dc7-8843-95553c6127a9 tempest-ProjectReaderTests-1674305306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eae93229-4214-4527-bf1e-a51da064b8d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:05:45 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-31867ee1-fbc5-4dc7-8843-95553c6127a9 tempest-ProjectReaderTests-1674305306 None] Volume volume-dd51e501-9754-40fe-8e15-fcc931b57c20 (dd51e501-9754-40fe-8e15-fcc931b57c20): created successfully Sep 25 12:05:45 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-31867ee1-fbc5-4dc7-8843-95553c6127a9 tempest-ProjectReaderTests-1674305306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eae93229-4214-4527-bf1e-a51da064b8d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:05:45 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-31867ee1-fbc5-4dc7-8843-95553c6127a9 tempest-ProjectReaderTests-1674305306 None] Flow 'volume_create_manager' (4d3a5954-3cdf-4540-8116-08c1b0a2a716) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:05:45 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-31867ee1-fbc5-4dc7-8843-95553c6127a9 tempest-ProjectReaderTests-1674305306 None] Created volume successfully. Sep 25 12:05:45 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-3d6fbf52-ac6c-40e6-9eba-0913e60d8f0e tempest-ProjectReaderTests-1674305306 None] Acquiring lock "cinder-dd51e501-9754-40fe-8e15-fcc931b57c20-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:05:46 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-3d6fbf52-ac6c-40e6-9eba-0913e60d8f0e tempest-ProjectReaderTests-1674305306 None] Lock "cinder-dd51e501-9754-40fe-8e15-fcc931b57c20-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:05:46 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-3d6fbf52-ac6c-40e6-9eba-0913e60d8f0e tempest-ProjectReaderTests-1674305306 None] Acquiring lock "cinder-quobyte-dd51e501-9754-40fe-8e15-fcc931b57c20" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:05:46 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-3d6fbf52-ac6c-40e6-9eba-0913e60d8f0e tempest-ProjectReaderTests-1674305306 None] Lock "cinder-quobyte-dd51e501-9754-40fe-8e15-fcc931b57c20" acquired by "delete_volume" :: waited 0.014s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:05:46 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f221e4d-cd43-4744-949c-1fbc57e5a229]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:05:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3d6fbf52-ac6c-40e6-9eba-0913e60d8f0e tempest-ProjectReaderTests-1674305306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-dd51e501-9754-40fe-8e15-fcc931b57c20 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:05:46 devstack sudo[109182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-dd51e501-9754-40fe-8e15-fcc931b57c20 Sep 25 12:05:46 devstack sudo[109182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:05:46 devstack sudo[109182]: pam_unix(sudo:session): session closed for user root Sep 25 12:05:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3d6fbf52-ac6c-40e6-9eba-0913e60d8f0e tempest-ProjectReaderTests-1674305306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-dd51e501-9754-40fe-8e15-fcc931b57c20" returned: 0 in 0.383s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:05:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3d6fbf52-ac6c-40e6-9eba-0913e60d8f0e tempest-ProjectReaderTests-1674305306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-dd51e501-9754-40fe-8e15-fcc931b57c20 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:05:46 devstack sudo[109187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-dd51e501-9754-40fe-8e15-fcc931b57c20 Sep 25 12:05:46 devstack sudo[109187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:05:46 devstack sudo[109187]: pam_unix(sudo:session): session closed for user root Sep 25 12:05:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3d6fbf52-ac6c-40e6-9eba-0913e60d8f0e tempest-ProjectReaderTests-1674305306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-dd51e501-9754-40fe-8e15-fcc931b57c20" returned: 0 in 0.277s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:05:46 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-3d6fbf52-ac6c-40e6-9eba-0913e60d8f0e tempest-ProjectReaderTests-1674305306 None] Lock "cinder-quobyte-dd51e501-9754-40fe-8e15-fcc931b57c20" released by "delete_volume" :: held 0.706s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:05:46 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-3d6fbf52-ac6c-40e6-9eba-0913e60d8f0e tempest-ProjectReaderTests-1674305306 None] Created reservations ['54f5c5a1-7a4a-482b-a5dd-d4eb0e8c4d2f', '544c11d3-ff4a-4cf2-b1af-11d6562aedf2', '6811535a-e4bd-426d-afb4-fccd3638350b', '8f4064ba-e876-4d9d-86e2-088c03f33ffb'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:05:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d6fbf52-ac6c-40e6-9eba-0913e60d8f0e tempest-ProjectReaderTests-1674305306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:05:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d6fbf52-ac6c-40e6-9eba-0913e60d8f0e tempest-ProjectReaderTests-1674305306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:05:46 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3d6fbf52-ac6c-40e6-9eba-0913e60d8f0e tempest-ProjectReaderTests-1674305306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:05:46 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-3d6fbf52-ac6c-40e6-9eba-0913e60d8f0e tempest-ProjectReaderTests-1674305306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:05:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-3d6fbf52-ac6c-40e6-9eba-0913e60d8f0e tempest-ProjectReaderTests-1674305306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:05:46 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3d6fbf52-ac6c-40e6-9eba-0913e60d8f0e tempest-ProjectReaderTests-1674305306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:05:46 devstack sudo[109190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 12:05:46 devstack sudo[109190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:05:47 devstack sudo[109190]: pam_unix(sudo:session): session closed for user root Sep 25 12:05:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-3d6fbf52-ac6c-40e6-9eba-0913e60d8f0e tempest-ProjectReaderTests-1674305306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.287s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:05:47 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-3d6fbf52-ac6c-40e6-9eba-0913e60d8f0e tempest-ProjectReaderTests-1674305306 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:05:47 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-3d6fbf52-ac6c-40e6-9eba-0913e60d8f0e tempest-ProjectReaderTests-1674305306 None] Deleted volume successfully. Sep 25 12:05:47 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-3d6fbf52-ac6c-40e6-9eba-0913e60d8f0e tempest-ProjectReaderTests-1674305306 None] Lock "cinder-dd51e501-9754-40fe-8e15-fcc931b57c20-delete_volume" released by "delete_volume" :: held 1.218s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:05:47 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-d731f5f6-3ea0-4296-93c8-188b2469b6d0 tempest-ProjectReaderTests-1674305306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:05:47 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d731f5f6-3ea0-4296-93c8-188b2469b6d0 tempest-ProjectReaderTests-1674305306 None] Flow 'volume_create_manager' (004da365-de18-41fd-a8e7-1e0b1d1af6d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:05:47 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d731f5f6-3ea0-4296-93c8-188b2469b6d0 tempest-ProjectReaderTests-1674305306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0b500fa-c9bf-4677-bde9-d24056fd025d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:05:47 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d731f5f6-3ea0-4296-93c8-188b2469b6d0 tempest-ProjectReaderTests-1674305306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0b500fa-c9bf-4677-bde9-d24056fd025d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:05:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1441124704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97cc153f-7f18-4a9f-adc4-e47b0c1f9505,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='418c84a11c5a4d29a5b6efc46b169d8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:05:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:05:48Z,use_quota=True,user_id='13259e41fb6b4878a7d8655a711f064a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:05:47 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d731f5f6-3ea0-4296-93c8-188b2469b6d0 tempest-ProjectReaderTests-1674305306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (514190b8-cc97-4c5a-96d9-71e858c17702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:05:47 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d731f5f6-3ea0-4296-93c8-188b2469b6d0 tempest-ProjectReaderTests-1674305306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (514190b8-cc97-4c5a-96d9-71e858c17702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:05:47 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d731f5f6-3ea0-4296-93c8-188b2469b6d0 tempest-ProjectReaderTests-1674305306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1aa56d8-0452-4696-93f8-b857c8032d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:05:47 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d731f5f6-3ea0-4296-93c8-188b2469b6d0 tempest-ProjectReaderTests-1674305306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1aa56d8-0452-4696-93f8-b857c8032d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97cc153f-7f18-4a9f-adc4-e47b0c1f9505', 'volume_name': 'volume-97cc153f-7f18-4a9f-adc4-e47b0c1f9505', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:05:47 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d731f5f6-3ea0-4296-93c8-188b2469b6d0 tempest-ProjectReaderTests-1674305306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dd0e5d9-fbec-46cf-9c06-586e4ed9dd76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:05:47 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d731f5f6-3ea0-4296-93c8-188b2469b6d0 tempest-ProjectReaderTests-1674305306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dd0e5d9-fbec-46cf-9c06-586e4ed9dd76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:05:47 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d731f5f6-3ea0-4296-93c8-188b2469b6d0 tempest-ProjectReaderTests-1674305306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15b9f991-19c4-4379-a316-8bbdb462bdfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:05:47 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-d731f5f6-3ea0-4296-93c8-188b2469b6d0 tempest-ProjectReaderTests-1674305306 None] Volume 97cc153f-7f18-4a9f-adc4-e47b0c1f9505: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97cc153f-7f18-4a9f-adc4-e47b0c1f9505', 'volume_size': 1} Sep 25 12:05:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d731f5f6-3ea0-4296-93c8-188b2469b6d0 tempest-ProjectReaderTests-1674305306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:05:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d731f5f6-3ea0-4296-93c8-188b2469b6d0 tempest-ProjectReaderTests-1674305306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:05:47 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-d731f5f6-3ea0-4296-93c8-188b2469b6d0 tempest-ProjectReaderTests-1674305306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:05:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1441124704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97cc153f-7f18-4a9f-adc4-e47b0c1f9505,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='418c84a11c5a4d29a5b6efc46b169d8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:05:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:05:48Z,use_quota=True,user_id='13259e41fb6b4878a7d8655a711f064a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:05:47 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-d731f5f6-3ea0-4296-93c8-188b2469b6d0 tempest-ProjectReaderTests-1674305306 None] Creating volume 97cc153f-7f18-4a9f-adc4-e47b0c1f9505 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:05:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d731f5f6-3ea0-4296-93c8-188b2469b6d0 tempest-ProjectReaderTests-1674305306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:05:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d731f5f6-3ea0-4296-93c8-188b2469b6d0 tempest-ProjectReaderTests-1674305306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:05:47 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-d731f5f6-3ea0-4296-93c8-188b2469b6d0 tempest-ProjectReaderTests-1674305306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:05:47 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-d731f5f6-3ea0-4296-93c8-188b2469b6d0 tempest-ProjectReaderTests-1674305306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:05:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d731f5f6-3ea0-4296-93c8-188b2469b6d0 tempest-ProjectReaderTests-1674305306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:05:47 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-d731f5f6-3ea0-4296-93c8-188b2469b6d0 tempest-ProjectReaderTests-1674305306 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:05:47 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-d731f5f6-3ea0-4296-93c8-188b2469b6d0 tempest-ProjectReaderTests-1674305306 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 12:05:47 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d731f5f6-3ea0-4296-93c8-188b2469b6d0 tempest-ProjectReaderTests-1674305306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-97cc153f-7f18-4a9f-adc4-e47b0c1f9505 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:05:47 devstack sudo[109193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-97cc153f-7f18-4a9f-adc4-e47b0c1f9505 1073741824 Sep 25 12:05:47 devstack sudo[109193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:05:48 devstack sudo[109193]: pam_unix(sudo:session): session closed for user root Sep 25 12:05:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d731f5f6-3ea0-4296-93c8-188b2469b6d0 tempest-ProjectReaderTests-1674305306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-97cc153f-7f18-4a9f-adc4-e47b0c1f9505 1073741824" returned: 0 in 0.465s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:05:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d731f5f6-3ea0-4296-93c8-188b2469b6d0 tempest-ProjectReaderTests-1674305306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-97cc153f-7f18-4a9f-adc4-e47b0c1f9505 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:05:48 devstack sudo[109199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-97cc153f-7f18-4a9f-adc4-e47b0c1f9505 Sep 25 12:05:48 devstack sudo[109199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:05:48 devstack sudo[109199]: pam_unix(sudo:session): session closed for user root Sep 25 12:05:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-d731f5f6-3ea0-4296-93c8-188b2469b6d0 tempest-ProjectReaderTests-1674305306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-97cc153f-7f18-4a9f-adc4-e47b0c1f9505" returned: 0 in 0.268s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:05:48 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-d731f5f6-3ea0-4296-93c8-188b2469b6d0 tempest-ProjectReaderTests-1674305306 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:05:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-d731f5f6-3ea0-4296-93c8-188b2469b6d0 tempest-ProjectReaderTests-1674305306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:05:48 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d731f5f6-3ea0-4296-93c8-188b2469b6d0 tempest-ProjectReaderTests-1674305306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15b9f991-19c4-4379-a316-8bbdb462bdfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97cc153f-7f18-4a9f-adc4-e47b0c1f9505', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:05:48 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d731f5f6-3ea0-4296-93c8-188b2469b6d0 tempest-ProjectReaderTests-1674305306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f739eb21-b24c-4917-a259-1dcd3d31251a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:05:48 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-d731f5f6-3ea0-4296-93c8-188b2469b6d0 tempest-ProjectReaderTests-1674305306 None] Volume volume-97cc153f-7f18-4a9f-adc4-e47b0c1f9505 (97cc153f-7f18-4a9f-adc4-e47b0c1f9505): created successfully Sep 25 12:05:48 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d731f5f6-3ea0-4296-93c8-188b2469b6d0 tempest-ProjectReaderTests-1674305306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f739eb21-b24c-4917-a259-1dcd3d31251a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:05:48 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-d731f5f6-3ea0-4296-93c8-188b2469b6d0 tempest-ProjectReaderTests-1674305306 None] Flow 'volume_create_manager' (004da365-de18-41fd-a8e7-1e0b1d1af6d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:05:48 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-d731f5f6-3ea0-4296-93c8-188b2469b6d0 tempest-ProjectReaderTests-1674305306 None] Created volume successfully. Sep 25 12:05:48 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-1b5d513e-b814-4047-b4e6-8a71efd72c13 tempest-ProjectReaderTests-1674305306 None] Acquiring lock "cinder-97cc153f-7f18-4a9f-adc4-e47b0c1f9505-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:05:48 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-1b5d513e-b814-4047-b4e6-8a71efd72c13 tempest-ProjectReaderTests-1674305306 None] Lock "cinder-97cc153f-7f18-4a9f-adc4-e47b0c1f9505-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:05:48 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-1b5d513e-b814-4047-b4e6-8a71efd72c13 tempest-ProjectReaderTests-1674305306 None] Acquiring lock "cinder-quobyte-97cc153f-7f18-4a9f-adc4-e47b0c1f9505" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:05:48 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-1b5d513e-b814-4047-b4e6-8a71efd72c13 tempest-ProjectReaderTests-1674305306 None] Lock "cinder-quobyte-97cc153f-7f18-4a9f-adc4-e47b0c1f9505" acquired by "delete_volume" :: waited 0.016s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:05:48 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b7fa45-1f52-4a20-8103-8c68e86e5812]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:05:48 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-1b5d513e-b814-4047-b4e6-8a71efd72c13 tempest-ProjectReaderTests-1674305306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-97cc153f-7f18-4a9f-adc4-e47b0c1f9505 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:05:48 devstack sudo[109202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-97cc153f-7f18-4a9f-adc4-e47b0c1f9505 Sep 25 12:05:48 devstack sudo[109202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:05:49 devstack sudo[109202]: pam_unix(sudo:session): session closed for user root Sep 25 12:05:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-1b5d513e-b814-4047-b4e6-8a71efd72c13 tempest-ProjectReaderTests-1674305306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-97cc153f-7f18-4a9f-adc4-e47b0c1f9505" returned: 0 in 0.407s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:05:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-1b5d513e-b814-4047-b4e6-8a71efd72c13 tempest-ProjectReaderTests-1674305306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-97cc153f-7f18-4a9f-adc4-e47b0c1f9505 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:05:49 devstack sudo[109207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-97cc153f-7f18-4a9f-adc4-e47b0c1f9505 Sep 25 12:05:49 devstack sudo[109207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:05:49 devstack sudo[109207]: pam_unix(sudo:session): session closed for user root Sep 25 12:05:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-1b5d513e-b814-4047-b4e6-8a71efd72c13 tempest-ProjectReaderTests-1674305306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-97cc153f-7f18-4a9f-adc4-e47b0c1f9505" returned: 0 in 0.257s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:05:49 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-1b5d513e-b814-4047-b4e6-8a71efd72c13 tempest-ProjectReaderTests-1674305306 None] Lock "cinder-quobyte-97cc153f-7f18-4a9f-adc4-e47b0c1f9505" released by "delete_volume" :: held 0.712s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:05:49 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-1b5d513e-b814-4047-b4e6-8a71efd72c13 tempest-ProjectReaderTests-1674305306 None] Created reservations ['87f73f37-b62f-489f-accb-7f22d1d1cb82', 'ab0497c0-ed9b-486a-be81-99998ce7573b', 'af7d8851-7676-4d76-aff5-e01a9162dfe0', '4a42dd11-4771-4fa3-80f4-cee0418e72ce'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:05:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-1b5d513e-b814-4047-b4e6-8a71efd72c13 tempest-ProjectReaderTests-1674305306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:05:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-1b5d513e-b814-4047-b4e6-8a71efd72c13 tempest-ProjectReaderTests-1674305306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:05:49 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-1b5d513e-b814-4047-b4e6-8a71efd72c13 tempest-ProjectReaderTests-1674305306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:05:49 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-1b5d513e-b814-4047-b4e6-8a71efd72c13 tempest-ProjectReaderTests-1674305306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:05:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-1b5d513e-b814-4047-b4e6-8a71efd72c13 tempest-ProjectReaderTests-1674305306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:05:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-1b5d513e-b814-4047-b4e6-8a71efd72c13 tempest-ProjectReaderTests-1674305306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:05:49 devstack sudo[109210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 12:05:49 devstack sudo[109210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:05:49 devstack sudo[109210]: pam_unix(sudo:session): session closed for user root Sep 25 12:05:49 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-1b5d513e-b814-4047-b4e6-8a71efd72c13 tempest-ProjectReaderTests-1674305306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.329s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:05:49 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-1b5d513e-b814-4047-b4e6-8a71efd72c13 tempest-ProjectReaderTests-1674305306 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:05:50 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-1b5d513e-b814-4047-b4e6-8a71efd72c13 tempest-ProjectReaderTests-1674305306 None] Deleted volume successfully. Sep 25 12:05:50 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-1b5d513e-b814-4047-b4e6-8a71efd72c13 tempest-ProjectReaderTests-1674305306 None] Lock "cinder-97cc153f-7f18-4a9f-adc4-e47b0c1f9505-delete_volume" released by "delete_volume" :: held 1.259s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:05:50 devstack cinder-volume[86984]: DEBUG cinder.volume.flows.manager.create_volume [None req-5056c752-2a6a-4d65-b9d0-b0d875ab06b1 tempest-ProjectReaderTests-1674305306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86984) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:05:50 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-5056c752-2a6a-4d65-b9d0-b0d875ab06b1 tempest-ProjectReaderTests-1674305306 None] Flow 'volume_create_manager' (a6b529b8-f28d-4acb-b2ed-403453cca1c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:05:50 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-5056c752-2a6a-4d65-b9d0-b0d875ab06b1 tempest-ProjectReaderTests-1674305306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa8973e4-07c2-4769-9d67-f278e2fd244c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:05:50 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-5056c752-2a6a-4d65-b9d0-b0d875ab06b1 tempest-ProjectReaderTests-1674305306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa8973e4-07c2-4769-9d67-f278e2fd244c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:05:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-227130840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1527f4d3-6566-4afa-bcc8-482ae07da831,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='418c84a11c5a4d29a5b6efc46b169d8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:05:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:05:50Z,use_quota=True,user_id='13259e41fb6b4878a7d8655a711f064a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:05:50 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-5056c752-2a6a-4d65-b9d0-b0d875ab06b1 tempest-ProjectReaderTests-1674305306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e96887dd-4b00-4748-8f79-3f4a41050e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:05:50 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-5056c752-2a6a-4d65-b9d0-b0d875ab06b1 tempest-ProjectReaderTests-1674305306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e96887dd-4b00-4748-8f79-3f4a41050e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:05:50 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-5056c752-2a6a-4d65-b9d0-b0d875ab06b1 tempest-ProjectReaderTests-1674305306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5eea2a36-f462-48db-b6b9-3bbda3f6e902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:05:50 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-5056c752-2a6a-4d65-b9d0-b0d875ab06b1 tempest-ProjectReaderTests-1674305306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5eea2a36-f462-48db-b6b9-3bbda3f6e902) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1527f4d3-6566-4afa-bcc8-482ae07da831', 'volume_name': 'volume-1527f4d3-6566-4afa-bcc8-482ae07da831', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:05:50 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-5056c752-2a6a-4d65-b9d0-b0d875ab06b1 tempest-ProjectReaderTests-1674305306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca39b57e-4b73-4b0a-9a5f-4d01098e5091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:05:50 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-5056c752-2a6a-4d65-b9d0-b0d875ab06b1 tempest-ProjectReaderTests-1674305306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca39b57e-4b73-4b0a-9a5f-4d01098e5091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:05:50 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-5056c752-2a6a-4d65-b9d0-b0d875ab06b1 tempest-ProjectReaderTests-1674305306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (138558a7-d86e-4d12-a02e-b02c21fbeecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:05:50 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-5056c752-2a6a-4d65-b9d0-b0d875ab06b1 tempest-ProjectReaderTests-1674305306 None] Volume 1527f4d3-6566-4afa-bcc8-482ae07da831: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1527f4d3-6566-4afa-bcc8-482ae07da831', 'volume_size': 1} Sep 25 12:05:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-5056c752-2a6a-4d65-b9d0-b0d875ab06b1 tempest-ProjectReaderTests-1674305306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:05:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-5056c752-2a6a-4d65-b9d0-b0d875ab06b1 tempest-ProjectReaderTests-1674305306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:05:50 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-5056c752-2a6a-4d65-b9d0-b0d875ab06b1 tempest-ProjectReaderTests-1674305306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:05:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-227130840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1527f4d3-6566-4afa-bcc8-482ae07da831,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='418c84a11c5a4d29a5b6efc46b169d8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:05:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:05:50Z,use_quota=True,user_id='13259e41fb6b4878a7d8655a711f064a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe4cd440-b64f-451c-b309-77fd1f9bb3c8),volume_type_id=fe4cd440-b64f-451c-b309-77fd1f9bb3c8)}" {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:05:50 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.remotefs [None req-5056c752-2a6a-4d65-b9d0-b0d875ab06b1 tempest-ProjectReaderTests-1674305306 None] Creating volume 1527f4d3-6566-4afa-bcc8-482ae07da831 {{(pid=86984) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:05:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-5056c752-2a6a-4d65-b9d0-b0d875ab06b1 tempest-ProjectReaderTests-1674305306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:05:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-5056c752-2a6a-4d65-b9d0-b0d875ab06b1 tempest-ProjectReaderTests-1674305306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:05:50 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-5056c752-2a6a-4d65-b9d0-b0d875ab06b1 tempest-ProjectReaderTests-1674305306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:05:50 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-5056c752-2a6a-4d65-b9d0-b0d875ab06b1 tempest-ProjectReaderTests-1674305306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:05:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-5056c752-2a6a-4d65-b9d0-b0d875ab06b1 tempest-ProjectReaderTests-1674305306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:05:50 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-5056c752-2a6a-4d65-b9d0-b0d875ab06b1 tempest-ProjectReaderTests-1674305306 None] Selected osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba as target Quobyte volume. {{(pid=86984) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:05:50 devstack cinder-volume[86984]: INFO cinder.volume.drivers.remotefs [None req-5056c752-2a6a-4d65-b9d0-b0d875ab06b1 tempest-ProjectReaderTests-1674305306 None] casted to osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba Sep 25 12:05:50 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-5056c752-2a6a-4d65-b9d0-b0d875ab06b1 tempest-ProjectReaderTests-1674305306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1527f4d3-6566-4afa-bcc8-482ae07da831 1073741824 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:05:50 devstack sudo[109213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1527f4d3-6566-4afa-bcc8-482ae07da831 1073741824 Sep 25 12:05:50 devstack sudo[109213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:05:51 devstack sudo[109213]: pam_unix(sudo:session): session closed for user root Sep 25 12:05:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-5056c752-2a6a-4d65-b9d0-b0d875ab06b1 tempest-ProjectReaderTests-1674305306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1527f4d3-6566-4afa-bcc8-482ae07da831 1073741824" returned: 0 in 0.491s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:05:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-5056c752-2a6a-4d65-b9d0-b0d875ab06b1 tempest-ProjectReaderTests-1674305306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1527f4d3-6566-4afa-bcc8-482ae07da831 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:05:51 devstack sudo[109219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1527f4d3-6566-4afa-bcc8-482ae07da831 Sep 25 12:05:51 devstack sudo[109219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:05:51 devstack sudo[109219]: pam_unix(sudo:session): session closed for user root Sep 25 12:05:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-5056c752-2a6a-4d65-b9d0-b0d875ab06b1 tempest-ProjectReaderTests-1674305306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1527f4d3-6566-4afa-bcc8-482ae07da831" returned: 0 in 0.273s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:05:51 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-5056c752-2a6a-4d65-b9d0-b0d875ab06b1 tempest-ProjectReaderTests-1674305306 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'} {{(pid=86984) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:05:51 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-5056c752-2a6a-4d65-b9d0-b0d875ab06b1 tempest-ProjectReaderTests-1674305306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:05:51 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-5056c752-2a6a-4d65-b9d0-b0d875ab06b1 tempest-ProjectReaderTests-1674305306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (138558a7-d86e-4d12-a02e-b02c21fbeecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1527f4d3-6566-4afa-bcc8-482ae07da831', 'volume_size': 1}' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:05:51 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-5056c752-2a6a-4d65-b9d0-b0d875ab06b1 tempest-ProjectReaderTests-1674305306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f38a133d-9459-4319-bb61-be8362c6aa0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:05:51 devstack cinder-volume[86984]: INFO cinder.volume.flows.manager.create_volume [None req-5056c752-2a6a-4d65-b9d0-b0d875ab06b1 tempest-ProjectReaderTests-1674305306 None] Volume volume-1527f4d3-6566-4afa-bcc8-482ae07da831 (1527f4d3-6566-4afa-bcc8-482ae07da831): created successfully Sep 25 12:05:51 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-5056c752-2a6a-4d65-b9d0-b0d875ab06b1 tempest-ProjectReaderTests-1674305306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f38a133d-9459-4319-bb61-be8362c6aa0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86984) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:05:51 devstack cinder-volume[86984]: DEBUG cinder.volume.manager [None req-5056c752-2a6a-4d65-b9d0-b0d875ab06b1 tempest-ProjectReaderTests-1674305306 None] Flow 'volume_create_manager' (a6b529b8-f28d-4acb-b2ed-403453cca1c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86984) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:05:51 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-5056c752-2a6a-4d65-b9d0-b0d875ab06b1 tempest-ProjectReaderTests-1674305306 None] Created volume successfully. Sep 25 12:05:52 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ad580bdb-d049-441e-a012-bbf3af3285e7 tempest-ProjectReaderTests-1674305306 None] Acquiring lock "cinder-1527f4d3-6566-4afa-bcc8-482ae07da831-delete_volume" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:05:52 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ad580bdb-d049-441e-a012-bbf3af3285e7 tempest-ProjectReaderTests-1674305306 None] Lock "cinder-1527f4d3-6566-4afa-bcc8-482ae07da831-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:05:52 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ad580bdb-d049-441e-a012-bbf3af3285e7 tempest-ProjectReaderTests-1674305306 None] Acquiring lock "cinder-quobyte-1527f4d3-6566-4afa-bcc8-482ae07da831" by "delete_volume" {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:05:52 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ad580bdb-d049-441e-a012-bbf3af3285e7 tempest-ProjectReaderTests-1674305306 None] Lock "cinder-quobyte-1527f4d3-6566-4afa-bcc8-482ae07da831" acquired by "delete_volume" :: waited 0.023s {{(pid=86984) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:05:52 devstack cinder-volume[86984]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccaeffc3-7574-42ef-9e86-a899e91055ab]: (4, 'qcow2') {{(pid=88733) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:05:52 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ad580bdb-d049-441e-a012-bbf3af3285e7 tempest-ProjectReaderTests-1674305306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1527f4d3-6566-4afa-bcc8-482ae07da831 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:05:52 devstack sudo[109222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1527f4d3-6566-4afa-bcc8-482ae07da831 Sep 25 12:05:52 devstack sudo[109222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:05:53 devstack sudo[109222]: pam_unix(sudo:session): session closed for user root Sep 25 12:05:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ad580bdb-d049-441e-a012-bbf3af3285e7 tempest-ProjectReaderTests-1674305306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1527f4d3-6566-4afa-bcc8-482ae07da831" returned: 0 in 0.430s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:05:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ad580bdb-d049-441e-a012-bbf3af3285e7 tempest-ProjectReaderTests-1674305306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1527f4d3-6566-4afa-bcc8-482ae07da831 {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:05:53 devstack sudo[109227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1527f4d3-6566-4afa-bcc8-482ae07da831 Sep 25 12:05:53 devstack sudo[109227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:05:53 devstack sudo[109227]: pam_unix(sudo:session): session closed for user root Sep 25 12:05:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ad580bdb-d049-441e-a012-bbf3af3285e7 tempest-ProjectReaderTests-1674305306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a/volume-1527f4d3-6566-4afa-bcc8-482ae07da831" returned: 0 in 0.266s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:05:53 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ad580bdb-d049-441e-a012-bbf3af3285e7 tempest-ProjectReaderTests-1674305306 None] Lock "cinder-quobyte-1527f4d3-6566-4afa-bcc8-482ae07da831" released by "delete_volume" :: held 0.745s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:05:53 devstack cinder-volume[86984]: DEBUG cinder.quota [None req-ad580bdb-d049-441e-a012-bbf3af3285e7 tempest-ProjectReaderTests-1674305306 None] Created reservations ['86330a59-f689-4724-a206-60835b0f3c3c', 'd07705ed-7f2f-4cbe-895d-0d2906e14db7', '28048c13-8a81-4a17-95fb-ec646ea4b8ca', '310d91cc-5537-42c6-8b2a-0f6d969bf4d9'] {{(pid=86984) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:05:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-ad580bdb-d049-441e-a012-bbf3af3285e7 tempest-ProjectReaderTests-1674305306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:05:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-ad580bdb-d049-441e-a012-bbf3af3285e7 tempest-ProjectReaderTests-1674305306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:05:53 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-ad580bdb-d049-441e-a012-bbf3af3285e7 tempest-ProjectReaderTests-1674305306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba': None} {{(pid=86984) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:05:53 devstack cinder-volume[86984]: DEBUG cinder.volume.drivers.quobyte [None req-ad580bdb-d049-441e-a012-bbf3af3285e7 tempest-ProjectReaderTests-1674305306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e198c36-4020-43b8-99af-314c28fba1ba'] {{(pid=86984) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:05:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.lockutils [None req-ad580bdb-d049-441e-a012-bbf3af3285e7 tempest-ProjectReaderTests-1674305306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:05:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ad580bdb-d049-441e-a012-bbf3af3285e7 tempest-ProjectReaderTests-1674305306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:05:53 devstack sudo[109230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a Sep 25 12:05:53 devstack sudo[109230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:05:53 devstack sudo[109230]: pam_unix(sudo:session): session closed for user root Sep 25 12:05:53 devstack cinder-volume[86984]: DEBUG oslo_concurrency.processutils [None req-ad580bdb-d049-441e-a012-bbf3af3285e7 tempest-ProjectReaderTests-1674305306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94471d07a2223642a3bd263d1774553a" returned: 0 in 0.280s {{(pid=86984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:05:53 devstack cinder-volume[86984]: DEBUG cinder.manager [None req-ad580bdb-d049-441e-a012-bbf3af3285e7 tempest-ProjectReaderTests-1674305306 None] Notifying Schedulers of capabilities ... {{(pid=86984) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:05:53 devstack cinder-volume[86984]: INFO cinder.volume.manager [None req-ad580bdb-d049-441e-a012-bbf3af3285e7 tempest-ProjectReaderTests-1674305306 None] Deleted volume successfully. Sep 25 12:05:53 devstack cinder-volume[86984]: DEBUG cinder.coordination [None req-ad580bdb-d049-441e-a012-bbf3af3285e7 tempest-ProjectReaderTests-1674305306 None] Lock "cinder-1527f4d3-6566-4afa-bcc8-482ae07da831-delete_volume" released by "delete_volume" :: held 1.252s {{(pid=86984) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:06:03 devstack cinder-volume[86984]: DEBUG dbcounter [-] [86984] Writing DB stats cinder:SELECT=25,cinder:UPDATE=47,cinder:INSERT=10,cinder:DELETE=5 {{(pid=86984) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:06:03 devstack cinder-volume[86984]: DEBUG dbcounter [-] [86984] Writing DB stats cinder:SELECT=31,cinder:UPDATE=41,cinder:INSERT=10,cinder:DELETE=3 {{(pid=86984) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:06:22 devstack cinder-volume[86984]: DEBUG dbcounter [-] [86984] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=86984) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}